00010000:00010000:3.0:1789129956.393510:0:32353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce7fae lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129956.393529:0:32353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce7fae lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129956.393549:0:32353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789129956.393685:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+17:28142:x1876037604774784:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1345us (4620us total) trans 25769803810 rc 0/0 00000100:00100000:3.0:1789129956.393696:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000020:00080000:3.0:1789129956.393703:0:32353:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789129956.408107:0:32349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604775296 00000100:00100000:3.0:1789129956.408123:0:32349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604775296 00000100:00100000:3.0:1789129956.623718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129956.797330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129956.810815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129956.835989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129956.849586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129956.866888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129957.033336:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604777600 00000100:00100000:3.0:1789129957.033351:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604777600 00000100:00100000:3.0:1789129957.033444:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129957.033458:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+22:28119:x1876037604777600:12345-192.168.201.39@tcp:35:multiop.0 00000100:00100000:3.0:1789129957.033865:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+23:28119:x1876037604777600:12345-192.168.201.39@tcp:35:multiop.0 Request processed in 410us (706us total) trans 25769803818 rc 0/0 00000100:00100000:3.0:1789129957.033873:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129957.126869:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.126977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129957.127102:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626756352:0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.127161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129957.127191:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626756864:0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.127217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129957.127235:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129957.127244:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626756480:0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.127271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129957.127326:0:33040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626756352 00000100:00100000:3.0:1789129957.127332:0:33040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626756352 00000100:00100000:3.0:1789129957.127416:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626756608:0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.127446:0:33366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626756480 00000100:00100000:3.0:1789129957.127450:0:33366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626756480 00000100:00100000:3.0:1789129957.127487:0:33366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789129957.127495:0:33366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626756352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.136597:0:33366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626756352:12345-0@lo:400:kworker.0 Request processed in 9089us (9423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.136628:0:33366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789129957.136773:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626756992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129957.137001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129957.137141:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129957.137164:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626756736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.137243:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626756736:12345-0@lo:400:kworker.0 Request processed in 90us (10133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.137970:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129957.138024:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626756992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129957.138053:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789129957.138083:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626756864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129957.138139:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626756864:12345-0@lo:400:kworker.0 Request processed in 60us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.138146:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789129957.146393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129957.228313:0:33366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604778240 00000100:00100000:3.0:1789129957.228328:0:33366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604778240 00000100:00100000:3.0:1789129957.228436:0:33366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789129957.228449:0:33366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+8:2370:x1876037604778240:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789129957.228477:0:33366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129957.228505:0:33366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab72a expref: -99 pid: 33366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.228558:0:33366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1789129957.228565:0:33366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1789129957.228578:0:33366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 9 pid: 33366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.228656:0:33366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 9 pid: 33366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.228683:0:33366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129957.228771:0:33366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+9:2370:x1876037604778240:12345-192.168.201.39@tcp:101:cat.0 Request processed in 324us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.228779:0:33366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789129957.242004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129957.264113:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604778624 00000100:00100000:3.0:1789129957.264130:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604778624 00000100:00100000:3.0:1789129957.264211:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789129957.264224:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+13:28181:x1876037604778624:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:3.0:1789129957.264571:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+14:28181:x1876037604778624:12345-192.168.201.39@tcp:35:cat.0 Request processed in 347us (998us total) trans 25769803821 rc 0/0 00000100:00100000:3.0:1789129957.264580:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00010000:00010000:3.0:1789129957.327544:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129957.339022:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339046:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339054:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339061:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129957.339066:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339076:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339098:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:3.0:1789129957.339101:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129957.339107:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.339115:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8064 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129957.342457:0:33039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604779520 00000100:00100000:3.0:1789129957.342472:0:33039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604779520 00000100:00100000:3.0:1789129957.342545:0:33039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789129957.342558:0:33039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+9:25827:x1876037604779520:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129957.342585:0:33039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129957.342635:0:33039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce806b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab738 expref: -99 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342687:0:33039:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce8009 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab715 expref: 6 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342699:0:33039:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 10 pid: 33366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342708:0:33039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1789129957.342722:0:33039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1789129957.342729:0:33039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce806b lrc: 5/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab738 expref: 10 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342774:0:33039:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 10 pid: 33366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342791:0:33039:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 10 pid: 33366 timeout: 1220 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129957.342835:0:33039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:33039:1876037626757376:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129957.342964:0:33039:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce8009 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab715 expref: 6 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.342976:0:33039:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce8009 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab715 expref: 6 pid: 33039 timeout: 1220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129957.346280:0:33039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:33039:1876037626757504:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129957.346454:0:33039:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29900 going to sleep for 11 seconds 00010000:00010000:3.0:1789129957.367155:0:33039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce8048 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab72a expref: 10 pid: 33366 timeout: 1220 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129957.367189:0:33039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:33039:1876037626757376:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129957.367208:0:33039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce8009 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab715 expref: 7 pid: 33039 timeout: 1220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129957.367219:0:33039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:33039:1876037626757504:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129957.367266:0:33039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab738 expref: 9 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129957.367284:0:33039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789129957.373080:0:33039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+9:25827:x1876037604779520:12345-192.168.201.39@tcp:101:bash.0 Request processed in 30502us (31286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.373133:0:33039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789129957.376947:0:32335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17e7c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:32335:1876037626757632:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789129957.376983:0:32335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129957.377417:0:32335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2370:x1876037604779776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 19100us (20385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129957.377432:0:32335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789129958.150217:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626757760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129958.150333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129958.154518:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626757760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129959.370023:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129960.989220:0:32344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604780032 00000100:00100000:3.0:1789129960.989231:0:32344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604780032 00000100:00100000:3.0:1789129961.000039:0:33045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604780800 00000100:00100000:3.0:1789129961.000045:0:33045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604780800 00002000:00100000:3.0:1789129961.000088:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff90b4c17e70c0 x1876037604780800/t0(0) o4->76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e@192.168.201.39@tcp:431/0 lens 504/0 e 0 to 0 dl 1789129971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129961.000101:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c17e70c0 with x1876037604780800 ext(0->13) 00002000:00010000:3.0:1789129961.000109:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c17e70c0 00000100:00100000:3.0:1789129961.000135:0:33045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789129961.000144:0:33045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+11:2367:x1876037604780800:12345-192.168.201.39@tcp:4:bash.0 00000100:00100000:3.0:1789129961.000762:0:33045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+13:2367:x1876037604780800:12345-192.168.201.39@tcp:4:bash.0 Request processed in 616us (1578us total) trans 25769803786 rc 0/0 00000100:00100000:3.0:1789129961.000773:0:33045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00100000:3.0:1789129961.000782:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff90b4c17e70c0 x1876037604780800/t25769803786(0) o4->76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e@192.168.201.39@tcp:431/0 lens 504/448 e 0 to 0 dl 1789129971 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129961.000796:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c17e70c0 with x1876037604780800 ext(0->13) 00002000:00010000:3.0:1789129961.000800:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c17e70c0 00010000:00010000:3.0:1789129961.016477:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129961.123110:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803783 is committed 00000001:00080000:3.0:1789129961.123129:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803785 is committed 00000001:00080000:3.0:1789129961.123136:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803782 is committed 00000001:00080000:3.0:1789129961.123152:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803781 is committed 00000001:00100000:3.0:1789129961.356469:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000020:00000080:3.0:1789129961.356482:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b485296800/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000020:00000080:3.0:1789129961.356518:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485296800/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e for lustre-OST0000 00000020:00000080:3.0:1789129961.356578:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b485295000 for lustre-OST0000 00000001:00080000:3.0:1789129961.369580:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803824 is committed 00000001:00080000:3.0:1789129961.369630:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803814 is committed 00000001:00080000:3.0:1789129961.369659:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803819 is committed 00000020:00080000:3.0:1789129961.369683:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4c1911e40 refcount 2 committed 0 result 0 batchid 21474836517 00000020:00080000:3.0:1789129961.369690:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4989b3600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b484fc6540 00000020:00080000:3.0:1789129961.369694:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4989b3800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4874d8400 00000020:00080000:3.0:1789129961.369734:0:32388:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836517 committed batchid 21474836516 00000020:00080000:3.0:1789129961.369982:0:32388:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000100:00100000:3.0:1789129962.246183:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626758144:0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129962.246388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789129962.246395:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626758016:0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129962.246448:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626758528:0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129962.246533:0:33039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626758144 00000100:00100000:3.0:1789129962.246542:0:33039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626758144 00000100:00100000:3.0:1789129962.246643:0:33039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626758016 00000100:00100000:3.0:1789129962.246647:0:33039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626758016 00000100:00100000:3.0:1789129962.246675:0:33039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129962.246685:0:33039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626758144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246746:0:33039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626758144:12345-0@lo:400:kworker.0 Request processed in 62us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129962.246755:0:33039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129962.246774:0:33039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789129962.246780:0:33039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48900bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626758016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246810:0:33039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48900bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626758016:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129962.246815:0:33039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789129962.246860:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626758016:0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.246871:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803782 gen 2 00000004:00080000:3.0:1789129962.246878:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803782 00000100:00100000:3.0:1789129962.246908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626758144:0@lo:400:kworker.0 00000100:00100000:3.0:1789129962.247959:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626758528:0@lo:400:kworker.0 00010000:00010000:3.0:1789129962.438112:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129964.036961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129964.037018:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604781056 00000100:00100000:3.0:1789129964.037032:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604781056 00000100:00100000:3.0:1789129964.037124:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1789129964.037137:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+10:28071:x1876037604781056:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789129964.037314:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+10:28071:x1876037604781056:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129964.037323:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00080000:3.0:1789129964.037348:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129964.043037:0:32352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604781312 00000100:00100000:3.0:1789129964.043051:0:32352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604781312 00000100:00100000:3.0:1789129964.043137:0:32352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789129964.043150:0:32352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+10:28071:x1876037604781312:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789129964.043824:0:32352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+11:28071:x1876037604781312:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 673us (846us total) trans 25769803825 rc 0/0 00000100:00100000:3.0:1789129964.043836:0:32352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:3.0:1789129964.486332:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129966.109832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.109899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.109942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.109978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.110000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.110044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129966.110086:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604781696 00000100:00100000:3.0:1789129966.110098:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604781696 00000100:00100000:3.0:1789129966.110595:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604782080 00000100:00100000:3.0:1789129966.110598:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604782080 00000001:00080000:3.0:1789129966.413445:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803825 is committed 00000020:00080000:3.0:1789129966.413470:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836517 batchid updated 00000001:00080000:3.0:1789129966.451270:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803786 is committed 00010000:00010000:3.0:1789129966.534357:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129967.367372:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129967.367415:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626758912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129967.367637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129967.367757:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626759296:0@lo:400:kworker.0 00000100:00100000:3.0:1789129967.389037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129967.389128:0:32341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626759040 00000100:00100000:3.0:1789129967.389137:0:32341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626759040 00000100:00100000:3.0:1789129967.389188:0:32341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789129967.389198:0:32341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0088ea47-949f-4d5d-9556-e30911137ffd+19:3306:x1876037626759040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129967.389266:0:32341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485cba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0088ea47-949f-4d5d-9556-e30911137ffd+19:3306:x1876037626759040:12345-0@lo:400:kworker.0 Request processed in 70us (21774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129967.389275:0:32341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000001:02000400:3.0:1789129968.334500:0:34683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 08:32:46 (1789129966) 00000100:00100000:3.0:1789129968.403918:0:33041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626759808 00000100:00100000:3.0:1789129968.404030:0:33041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626759808 00000100:00100000:3.0:1789129968.404095:0:33041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789129968.404106:0:33041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626759808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129968.404356:0:33041:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789129968.404456:0:33041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626759808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 352us (13181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129968.404464:0:33041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789129968.584374:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129968.907266:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604782592 00000100:00100000:3.0:1789129968.907279:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604782592 00000100:00100000:3.0:1789129968.907345:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789129968.907356:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+11:28818:x1876037604782592:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789129968.907482:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+11:28818:x1876037604782592:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129968.907516:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789129969.097596:0:32335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604782976 00000100:00100000:3.0:1789129969.097635:0:32335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604782976 00010000:00010000:3.0:1789129969.097701:0:32335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce7e96 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab6a5 expref: 9 pid: 32350 timeout: 1232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129969.097748:0:32335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789129969.097758:0:32335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+9:2370:x1876037604782976:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129969.097772:0:32335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129969.097780:0:32335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce7e96 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab6a5 expref: 9 pid: 32350 timeout: 1232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.097794:0:32335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce7e96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab6a5 expref: 9 pid: 32350 timeout: 1232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.097817:0:32335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:3.0:1789129969.097822:0:32335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8095 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.097832:0:32335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8095 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.097839:0:32335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8095 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.097858:0:32335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129969.097912:0:32335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+9:2370:x1876037604782976:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 156us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129969.097940:0:32335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00010000:00010000:3.0:1789129969.111828:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111848:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111856:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111862:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129969.111867:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111875:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111892:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff90b4909bd600) 00010000:00010000:3.0:1789129969.111894:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129969.111900:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.111906:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce809c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129969.137979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.160317:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604783488 00000100:00100000:3.0:1789129969.160327:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604783488 00000100:00100000:3.0:1789129969.160398:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789129969.160409:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:28834:x1876037604783488:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789129969.160447:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129969.160481:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce80cd lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab754 expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160687:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160701:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160713:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160730:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce80db lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160737:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce80db lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.160743:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce80db lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789129969.162888:0:32351:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa3:0x0], index 0: 0 00010000:00010000:3.0:1789129969.164308:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce80e2 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.164328:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce80e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.164340:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce80e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.165319:0:32351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.165331:0:32351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.165338:0:32351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.165344:0:32351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129969.165349:0:32351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.165357:0:32351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.166248:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129969.166254:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129969.166261:0:32351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.166269:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce80d4 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129969.166287:0:32351:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000631ae1fb reply state 00000000327ab040 transno 25769803828 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce80db lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129969.166297:0:32351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789129969.166348:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce80cd lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab754 expref: 13 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.166681:0:32351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce80e2 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab754 expref: 12 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.166690:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789129969.166692:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129969.166695:0:32351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129969.166782:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+13:28834:x1876037604783488:12345-192.168.201.39@tcp:101:dd.0 Request processed in 6374us (6721us total) trans 25769803828 rc 0/0 00000100:00100000:3.0:1789129969.166792:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789129969.197971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.207359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.382381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.392127:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604784256 00000100:00100000:3.0:1789129969.392148:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604784256 00000100:00100000:3.0:1789129969.392214:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789129969.392227:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+12:28840:x1876037604784256:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129969.392252:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129969.392274:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce810c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab769 expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392346:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392373:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392392:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392421:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392430:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392437:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392557:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392566:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392573:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129969.392659:0:32351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00000004:00200000:3.0:1789129969.392664:0:32351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129969.392688:0:32351:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392701:0:32351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392707:0:32351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392714:0:32351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392732:0:32351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129969.392737:0:32351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392745:0:32351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392758:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789129969.392761:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129969.392766:0:32351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392772:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392786:0:32351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392803:0:32351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392809:0:32351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392814:0:32351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129969.392816:0:32351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392823:0:32351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392841:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff90b496419600) 00010000:00010000:3.0:1789129969.392844:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129969.392847:0:32351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392854:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce811a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392887:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce810c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab769 expref: 14 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392899:0:32351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab769 expref: 13 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.392906:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129969.392908:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129969.392911:0:32351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2200, rc 0) 00000100:00100000:3.0:1789129969.392984:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+13:28840:x1876037604784256:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 759us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129969.392992:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789129969.397418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.417350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.431423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.469869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.485702:0:33045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604785408 00000100:00100000:3.0:1789129969.485714:0:33045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604785408 00002000:00100000:3.0:1789129969.485770:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff90b489048000 x1876037604785408/t0(0) o4->76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e@192.168.201.39@tcp:440/0 lens 1512/0 e 0 to 0 dl 1789129980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129969.485813:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489048000 with x1876037604785408 ext(0->1023) 00010000:00010000:3.0:1789129969.485825:0:33045:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce80f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab75b expref: 7 pid: 33039 timeout: 1232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.485842:0:33045:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce80f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab75b expref: 7 pid: 33039 timeout: 1232 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129969.485851:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b489048000 00000100:00100000:3.0:1789129969.485887:0:33045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1789129969.485908:0:33045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+7:2370:x1876037604785408:12345-192.168.201.39@tcp:4:dd.0 00000001:00100000:3.0:1789129969.561295:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000001:00080000:3.0:1789129969.665878:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000100:00100000:3.0:1789129969.671336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.692586:0:33043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604785664 00000100:00100000:3.0:1789129969.692596:0:33043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604785664 00002000:00100000:3.0:1789129969.692679:0:33043:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff90b489049a40 x1876037604785664/t0(0) o3->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:440/0 lens 488/0 e 0 to 0 dl 1789129980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129969.692690:0:33043:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049a40 with x1876037604785664 ext(0->4095) 00002000:00010000:3.0:1789129969.692696:0:33043:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489049a40 00000100:00100000:3.0:1789129969.692725:0:33043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129969.692734:0:33043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2369:x1876037604785664:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789129969.692936:0:33043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2369:x1876037604785664:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 202us (696us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789129969.692953:0:33043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:3.0:1789129969.692974:0:33043:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff90b489049a40 x1876037604785664/t0(0) o3->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:440/0 lens 488/4536 e 0 to 0 dl 1789129980 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129969.692983:0:33043:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049a40 with x1876037604785664 ext(0->4095) 00002000:00010000:3.0:1789129969.692986:0:33043:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489049a40 00000100:00100000:3.0:1789129969.751803:0:32353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:32353:1876037626760832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789129969.752907:0:32353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803838 00000100:00100000:3.0:1789129969.753704:0:32353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:32353:1876037626760960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789129969.753772:0:32353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129969.753823:0:32353:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44780 going to sleep for 11 seconds 00000100:00100000:3.0:1789129969.754795:0:32353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:32353:1876037626760960:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:3.0:1789129969.754835:0:32353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754845:0:32353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754852:0:32353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754858:0:32353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129969.754863:0:32353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754870:0:32353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754885:0:32353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789129969.754888:0:32353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789129969.754908:0:32353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129969.754914:0:32353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8183 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789129969.759107:0:32353:0:(mdd_object.c:4024:mdd_close()) Object [0x200002b11:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789129969.759367:0:32353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].3, 64 off8384 00000004:00080000:3.0:1789129969.759381:0:32353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1132856778409ns, next at 1133856774680ns, rc = 0 00000001:00080000:3.0:1789129969.759393:0:32353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803839 00010000:00010000:3.0:1789129969.762668:0:32353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789129969.762678:0:32353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789129969.762689:0:32353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8167 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab785 expref: 25 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129969.762846:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+24:28840:x1876037604786176:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 27337us (28018us total) trans 25769803840 rc 0/0 00000100:00100000:3.0:1789129969.762856:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000020:00080000:3.0:1789129969.762862:0:32353:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789129969.791776:0:32352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604786816 00000100:00100000:3.0:1789129969.791787:0:32352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604786816 00000100:00100000:3.0:1789129969.791851:0:32352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789129969.791862:0:32352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+25:28840:x1876037604786816:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129969.792146:0:32352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+26:28840:x1876037604786816:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 284us (479us total) trans 25769803841 rc 0/0 00000100:00100000:3.0:1789129969.792154:0:32352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789129969.953158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129969.967175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129970.080835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129970.088419:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604787840 00000100:00100000:3.0:1789129970.088428:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604787840 00000100:00100000:3.0:1789129970.088510:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789129970.088521:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+29:28857:x1876037604787840:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129970.088545:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.088568:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81d0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7a8 expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.088708:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce81d7 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.088727:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce81d7 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.088741:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce81d7 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129970.088755:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789129970.088916:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81d0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7a8 expref: 32 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.088934:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce81d7 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7a8 expref: 31 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.088943:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789129970.088946:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129970.088950:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789129970.089647:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+31:28857:x1876037604787840:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1122us (1331us total) trans 25769803844 rc 0/0 00000100:00100000:3.0:1789129970.089679:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789129970.094909:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604788096 00000100:00100000:3.0:1789129970.094922:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604788096 00000100:00100000:3.0:1789129970.094977:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789129970.094987:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+31:28857:x1876037604788096:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129970.095318:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+32:28857:x1876037604788096:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 331us (538us total) trans 25769803845 rc 0/0 00000100:00100000:3.0:1789129970.095326:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789129970.178079:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604788480 00000100:00100000:3.0:1789129970.178090:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604788480 00000100:00100000:3.0:1789129970.178169:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789129970.178181:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+31:28867:x1876037604788480:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129970.178208:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.178231:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7af expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129970.178354:0:32351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00010000:00010000:3.0:1789129970.178715:0:32351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7af expref: 33 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.178731:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789129970.178734:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129970.178740:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7af expref: 33 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.178754:0:32351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129970.184940:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604788736 00000100:00100000:3.0:1789129970.184951:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604788736 00000100:00100000:3.0:1789129970.185013:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789129970.185024:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+32:28867:x1876037604788736:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129970.185335:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+33:28867:x1876037604788736:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 311us (769us total) trans 25769803847 rc 0/0 00000100:00100000:3.0:1789129970.185343:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789129970.308489:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604788992 00000100:00100000:3.0:1789129970.308499:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604788992 00000100:00100000:3.0:1789129970.308572:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789129970.308582:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+33:28873:x1876037604788992:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129970.308633:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.308658:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81f3 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7b6 expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.308759:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce81fa lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.308774:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce81fa lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.308785:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce81fa lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129970.308807:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789129970.308938:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce81f3 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7b6 expref: 36 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.308957:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce81fa lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7b6 expref: 35 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.308980:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789129970.308983:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129970.308987:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129970.309055:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+35:28873:x1876037604788992:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 474us (1137us total) trans 25769803848 rc 0/0 00000100:00100000:3.0:1789129970.309062:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:3.0:1789129970.630062:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129970.721911:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604790400 00000100:00100000:3.0:1789129970.721921:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604790400 00000100:00100000:3.0:1789129970.721983:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789129970.721994:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+35:28874:x1876037604790400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.722017:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.722045:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8240 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7cb expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722703:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/1,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722721:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722734:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129970.722759:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789129970.722878:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722908:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722914:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722920:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129970.722924:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722932:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722944:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789129970.722947:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789129970.722952:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.722958:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8247 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.723011:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8240 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7cb expref: 37 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.723022:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08700) 00010000:00010000:3.0:1789129970.723024:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129970.723028:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8240 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7cb expref: 37 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.723037:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129970.723137:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+36:28874:x1876037604790400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1144us (1311us total) trans 25769803850 rc 301/301 00000100:00100000:3.0:1789129970.723146:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789129970.737572:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604790784 00000100:00100000:3.0:1789129970.737584:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604790784 00000100:00100000:3.0:1789129970.737677:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789129970.737687:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+36:28874:x1876037604790784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.737709:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.737713:0:32350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789129970.737754:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8121 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab769 expref: 36 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.737773:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129970.737780:0:32350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129970.737804:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8255 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7d2 expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789129970.740098:0:32350:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa3:0x0], index 1: 0 00010000:00010000:3.0:1789129970.740414:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce825c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.740430:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce825c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.740442:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce825c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.740525:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8255 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7d2 expref: 38 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.740567:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce825c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7d2 expref: 37 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.740575:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789129970.740578:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129970.740581:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129970.740683:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+37:28874:x1876037604790784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2998us (3488us total) trans 25769803851 rc 0/0 00000100:00100000:3.0:1789129970.740692:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789129970.758979:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604791168 00000100:00100000:3.0:1789129970.758990:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604791168 00000100:00100000:3.0:1789129970.759051:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:3.0:1789129970.759074:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+38:28874:x1876037604791168:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.759135:0:32350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129970.759165:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce825c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7d2 expref: 38 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759183:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789129970.759206:0:32350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129970.759230:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759244:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759264:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759295:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759303:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759310:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759858:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759868:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759875:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759880:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129970.759885:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759892:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759902:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129970.759905:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129970.759909:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759915:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8286 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759932:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759938:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759944:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759949:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129970.759952:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759958:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759966:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x7fe6ced6 (ffff90b496419700) 00010000:00010000:3.0:1789129970.759968:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129970.759972:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.759978:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce828d lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x7fe6ced6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.760087:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+37:28874:x1876037604791168:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1015us (1274us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129970.760096:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:3.0:1789129970.763836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129970.769900:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604791552 00000100:00100000:3.0:1789129970.769916:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604791552 00000100:00100000:3.0:1789129970.769972:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789129970.769981:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+38:28874:x1876037604791552:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.770060:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.770076:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.770088:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789129970.770507:0:32350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].3, 88 off8432 00000004:00080000:3.0:1789129970.770517:0:32350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1133867914539ns, next at 1134867912204ns, rc = 0 00000004:00010000:3.0:1789129970.770638:0:32350:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004a24cbe3 reply state 00000000489bcd3f transno 25769803852 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.770649:0:32350:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789129970.770747:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+40:28874:x1876037604791552:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 766us (1105us total) trans 25769803852 rc 0/0 00000100:00100000:3.0:1789129970.770755:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00010000:00010000:3.0:1789129970.776293:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776311:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776319:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776326:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129970.776360:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776368:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776385:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:3.0:1789129970.776389:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789129970.776395:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.776402:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82a2 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.791587:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604792064 00000100:00100000:3.0:1789129970.791596:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604792064 00000100:00100000:3.0:1789129970.791692:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789129970.791703:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+40:28874:x1876037604792064:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789129970.791956:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+41:28874:x1876037604792064:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 255us (486us total) trans 25769803853 rc 0/0 00000100:00100000:3.0:1789129970.791964:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789129970.800593:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604792448 00000100:00100000:3.0:1789129970.800627:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604792448 00000100:00100000:3.0:1789129970.800688:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789129970.800699:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+41:28874:x1876037604792448:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.800719:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129970.800741:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82b0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab7ee expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800851:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce82b7 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800865:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce82b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800877:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce82b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129970.800915:0:32350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129970.800933:0:32350:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce82b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800957:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82b0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7ee expref: 43 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800974:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce82b7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7ee expref: 42 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.800983:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:3.0:1789129970.800997:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789129970.801002:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129970.801062:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+42:28874:x1876037604792448:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 365us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129970.801069:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789129970.813669:0:32349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604792832 00000100:00100000:3.0:1789129970.813678:0:32349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604792832 00000100:00100000:3.0:1789129970.813731:0:32349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789129970.813757:0:32349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+42:28874:x1876037604792832:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789129970.813866:0:32349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+42:28874:x1876037604792832:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 111us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129970.813874:0:32349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789129970.827852:0:32334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604793088 00000100:00100000:3.0:1789129970.827861:0:32334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604793088 00010000:00010000:3.0:1789129970.827900:0:32334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce82be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7f5 expref: 8 pid: 33366 timeout: 1233 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.827938:0:32334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:3.0:1789129970.827948:0:32334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+8:2369:x1876037604793088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129970.827982:0:32334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129970.828008:0:32334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce82be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7f5 expref: 8 pid: 33366 timeout: 1233 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.828022:0:32334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce82be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7f5 expref: 8 pid: 33366 timeout: 1233 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.828045:0:32334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce82be lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7f5 expref: 8 pid: 33366 timeout: 1233 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.828062:0:32334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129970.828066:0:32334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129970.828074:0:32334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.828096:0:32334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.828148:0:32334:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.828161:0:32334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:32334:1876037626761344:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789129970.828561:0:32334:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129970.840526:0:33045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604793216 00000100:00100000:3.0:1789129970.840540:0:33045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604793216 00002000:00100000:3.0:1789129970.840597:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff90b4be5f1680 x1876037604793216/t0(0) o4->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:441/0 lens 1512/0 e 0 to 0 dl 1789129981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129970.840633:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f1680 with x1876037604793216 ext(0->1023) 00002000:00010000:3.0:1789129970.840640:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f1680 00000100:00100000:3.0:1789129970.840778:0:33045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789129970.840788:0:33045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2370:x1876037604793216:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789129970.841539:0:33045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+9:2370:x1876037604793216:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 747us (2604us total) trans 25769803788 rc 0/0 00000100:00100000:3.0:1789129970.841548:0:33045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00002000:00100000:3.0:1789129970.841556:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff90b4be5f1680 x1876037604793216/t25769803788(0) o4->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:441/0 lens 1512/448 e 0 to 0 dl 1789129981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129970.841566:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f1680 with x1876037604793216 ext(0->1023) 00002000:00010000:3.0:1789129970.841578:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f1680 00000001:00080000:3.0:1789129970.903534:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803843 is committed 00000001:00080000:3.0:1789129970.903574:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803849 is committed 00000001:00080000:3.0:1789129970.903580:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803829 is committed 00000001:00080000:3.0:1789129970.903584:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803853 is committed 00000004:00080000:3.0:1789129970.903591:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789129970.903643:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789129970.903657:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4bad44240 refcount 2 committed 0 result 0 batchid 21474836518 00000020:00080000:3.0:1789129970.909498:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b489075e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bad44c00 00000020:00080000:3.0:1789129970.909503:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b489075c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5801000 00000004:00080000:3.0:1789129970.911647:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4bae78b40/2, rc 0, transno 25769803783 00000100:00100000:3.0:1789129970.911654:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626761600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789129970.967001:0:33039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2370:x1876037604793472:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 50466us (50698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129970.967012:0:33039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789129970.982379:0:33366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604793856 00000100:00100000:3.0:1789129970.982389:0:33366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604793856 00000100:00100000:3.0:1789129970.982462:0:33366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789129970.982483:0:33366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2370:x1876037604793856:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789129970.982810:0:33366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1789129970.982814:0:33366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime from disk: 1789129970 -> 1789129968 00002000:00010000:3.0:1789129970.982817:0:33366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb atime from disk: 0 -> 1789129969 00002000:00010000:3.0:1789129970.982820:0:33366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime from disk: 1789129970 -> 1789129969 00002000:00010000:3.0:1789129970.982822:0:33366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789129970.986799:0:33366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2370:x1876037604793856:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 4315us (4814us total) trans 25769803790 rc 0/0 00000100:00100000:3.0:1789129970.986837:0:33366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789129970.992787:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604794112 00000100:00100000:3.0:1789129970.992797:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604794112 00000100:00100000:3.0:1789129970.992860:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789129970.992871:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+16:28874:x1876037604794112:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789129970.992945:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.992963:0:32351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce829b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e0 expref: 16 pid: 32349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.992973:0:32351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.993008:0:32351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce829b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e0 expref: 16 pid: 32349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.993023:0:32351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce829b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e0 expref: 16 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.993037:0:32351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:32351:1876037626761728:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129970.993135:0:32351:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789129970.998665:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce829b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e0 expref: 16 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.998681:0:32351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:32351:1876037626761728:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129970.998710:0:32351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998720:0:32351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998725:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998755:0:32351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998761:0:32351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998768:0:32351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998774:0:32351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129970.998779:0:32351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998787:0:32351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998798:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:3.0:1789129970.998801:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789129970.998805:0:32351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129970.998812:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82da lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129970.998874:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+15:28874:x1876037604794112:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 6005us (6293us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789129970.998883:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789129971.003621:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604794368 00000100:00100000:3.0:1789129971.003632:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604794368 00000100:00100000:3.0:1789129971.003690:0:33037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129971.003702:0:33037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2367:x1876037604794368:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789129971.003753:0:33037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce82e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.003775:0:33037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.003785:0:33037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789129971.003803:0:33037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129971.003808:0:33037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce82e1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.003845:0:33037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.003860:0:33037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce82c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7fc expref: 7 pid: 33040 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.004028:0:33037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:33037:1876037626761856:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129971.004131:0:33037:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129971.008814:0:33037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:33037:1876037626761856:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129971.008846:0:33037:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce82e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.028090:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604794752 00000100:00100000:3.0:1789129971.028114:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604794752 00000100:00100000:3.0:1789129971.035262:0:34474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604794880 00000100:00100000:3.0:1789129971.035269:0:34474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604794880 00010000:00010000:3.0:1789129971.035310:0:34474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdda00/0x5c74554e47ce82a9 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e7 expref: 17 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.035348:0:34474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1789129971.035358:0:34474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be594780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+17:2369:x1876037604794880:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129971.035372:0:34474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129971.035379:0:34474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdda00/0x5c74554e47ce82a9 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e7 expref: 17 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035392:0:34474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdda00/0x5c74554e47ce82a9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e7 expref: 17 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035414:0:34474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdda00/0x5c74554e47ce82a9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7e7 expref: 17 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035441:0:34474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:3.0:1789129971.035446:0:34474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce82ef lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035482:0:34474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce82ef lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035490:0:34474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce82ef lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.035520:0:34474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129971.035569:0:34474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be594780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+16:2369:x1876037604794880:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 212us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.035578:0:34474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1789129971.047257:0:32350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be597c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:32350:1876037626762368:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789129971.047290:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce821d lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047299:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce821d lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 32349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047332:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047347:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047358:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047367:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047373:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047395:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047401:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.047404:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047412:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047435:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789129971.047438:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.047441:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047447:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82f6 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047457:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047463:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047477:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047482:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.047484:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047499:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 4/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047507:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789129971.047509:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789129971.047512:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 2/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.047517:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce82e8 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.048450:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be594f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+20:28874:x1876037604794752:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 19859us (24423us total) trans 25769803860 rc 0/0 00000100:00100000:3.0:1789129971.048463:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000020:00080000:3.0:1789129971.048478:0:32350:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1789129971.053434:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795008 00000100:00100000:3.0:1789129971.053446:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795008 00000100:00100000:3.0:1789129971.053523:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789129971.053535:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48644c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+20:28873:x1876037604795008:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:3.0:1789129971.053719:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48644c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+20:28873:x1876037604795008:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 186us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.053728:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789129971.061833:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795264 00000100:00100000:3.0:1789129971.061845:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795264 00000100:00100000:3.0:1789129971.061933:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789129971.061944:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+20:28874:x1876037604795264:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789129971.063573:0:32353:0:(mdd_object.c:4024:mdd_close()) Object [0x200002b11:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789129971.063704:0:32353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803861 00010000:00010000:3.0:1789129971.063759:0:32353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.063776:0:32353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.063787:0:32353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.065535:0:32353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.065543:0:32353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.065549:0:32353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce82fd lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 32353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.065661:0:32353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789129971.065798:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+22:28874:x1876037604795264:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3851us (4466us total) trans 25769803862 rc 0/0 00000100:00100000:3.0:1789129971.065810:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000020:00080000:3.0:1789129971.065818:0:32353:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789129971.069990:0:33366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795392 00000100:00100000:3.0:1789129971.070006:0:33366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795392 00000100:00100000:3.0:1789129971.070077:0:33366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789129971.070087:0:33366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+6:28873:x1876037604795392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.070115:0:33366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.070137:0:33366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab803 expref: -99 pid: 33366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129971.070184:0:33366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6aa3f4f0, atime: 0x6aa3f4f1, ctime: 0x6aa3f4f1, blocks: 0xb 00010000:00010000:3.0:1789129971.070208:0:33366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=1134s v=(0 0) 00010000:00010000:3.0:1789129971.070214:0:33366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129971.070224:0:33366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 7 pid: 33366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.070253:0:33366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 7 pid: 33366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.070269:0:33366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789129971.070342:0:33366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93af2732-639b-4543-b895-cd82ddb7ac1a+7:28873:x1876037604795392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 257us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.070349:0:33366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789129971.080140:0:33044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795520 00000100:00100000:3.0:1789129971.080153:0:33044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795520 00002000:00100000:3.0:1789129971.080214:0:33044:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff90b4be594b40 x1876037604795520/t0(0) o3->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:442/0 lens 488/0 e 0 to 0 dl 1789129982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129971.080226:0:33044:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be594b40 with x1876037604795520 ext(0->4095) 00002000:00010000:3.0:1789129971.080233:0:33044:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be594b40 00000100:00100000:3.0:1789129971.080275:0:33044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129971.080285:0:33044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be594b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2368:x1876037604795520:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789129971.080528:0:33044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be594b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2368:x1876037604795520:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 243us (733us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789129971.080537:0:33044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00002000:00100000:3.0:1789129971.080552:0:33044:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff90b4be594b40 x1876037604795520/t0(0) o3->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:442/0 lens 488/4536 e 0 to 0 dl 1789129982 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129971.080561:0:33044:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be594b40 with x1876037604795520 ext(0->4095) 00002000:00010000:3.0:1789129971.080565:0:33044:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be594b40 00000100:00100000:3.0:1789129971.096382:0:33039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795648 00000100:00100000:3.0:1789129971.096396:0:33039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795648 00000100:00100000:3.0:1789129971.102183:0:32336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604795776 00000100:00100000:3.0:1789129971.102192:0:32336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604795776 00010000:00010000:3.0:1789129971.102239:0:32336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 8 pid: 33366 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.102288:0:32336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129971.102298:0:32336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+8:2370:x1876037604795776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129971.102314:0:32336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129971.102337:0:32336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 8 pid: 33366 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.102351:0:32336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 8 pid: 33366 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.102375:0:32336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a38c335/0x5c74554e47ce8304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab803 expref: 8 pid: 33366 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.102393:0:32336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129971.102397:0:32336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129971.102403:0:32336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce830b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.102437:0:32336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce830b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.102477:0:32336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129971.102530:0:32336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+7:2370:x1876037604795776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 233us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.102540:0:32336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129971.108840:0:32352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604796032 00000100:00100000:3.0:1789129971.108856:0:32352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604796032 00000100:00100000:3.0:1789129971.108937:0:32352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789129971.108948:0:32352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+22:28873:x1876037604796032:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:3.0:1789129971.109018:0:32352:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce820f lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7bd expref: 22 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129971.109276:0:32352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803863 00000001:00080000:3.0:1789129971.110055:0:32352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803864 00010000:00010000:3.0:1789129971.110178:0:32352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce8312 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.110196:0:32352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8224 lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7c4 expref: 25 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.110204:0:32352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce8312 lrc: 4/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.110303:0:32352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8224 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7c4 expref: 25 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.110337:0:32352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8224 lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7c4 expref: 25 pid: 32351 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.110353:0:32352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:32352:1876037626762624:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129971.110630:0:32352:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44900 going to sleep for 11 seconds 00010000:00010000:3.0:1789129971.117808:0:32352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8224 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab7c4 expref: 25 pid: 32351 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.117827:0:32352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:32352:1876037626762624:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129971.117846:0:32352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce8312 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.117855:0:32352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce8312 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.117862:0:32352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce8312 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32352 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129971.118820:0:32352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803865 00000001:00080000:3.0:1789129971.119407:0:32352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803866 00000001:00080000:3.0:1789129971.119534:0:32352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803867 00000100:00100000:3.0:1789129971.121058:0:32355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626762752 00000100:00100000:3.0:1789129971.121066:0:32355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626762752 00000100:00100000:3.0:1789129971.121775:0:32355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129971.121790:0:32355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32352:x1876037626762752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789129971.121993:0:32355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32352:x1876037626762752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 208us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.122020:0:32355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129971.133688:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604796288 00000100:00100000:3.0:1789129971.133700:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604796288 00000100:00100000:3.0:1789129971.133803:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789129971.133814:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+28:28873:x1876037604796288:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.133842:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.133880:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce8319 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab80a expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.133952:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce8319 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab80a expref: 29 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.133967:0:32351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce8319 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab80a expref: 29 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.133986:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419200) 00010000:00010000:3.0:1789129971.133989:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789129971.133993:0:32351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129971.134058:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+29:28873:x1876037604796288:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 245us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.134065:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789129971.139904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.231897:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604796928 00000100:00100000:3.0:1789129971.231903:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604796928 00000100:00100000:3.0:1789129971.231948:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129971.231957:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be596d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:2370:x1876037604796928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129971.232009:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be596d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:2370:x1876037604796928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.232016:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129971.286366:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604797440 00000100:00100000:3.0:1789129971.286376:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604797440 00000100:00100000:3.0:1789129971.286588:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789129971.286619:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+30:28884:x1876037604797440:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.286642:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.286661:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce8320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab811 expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129971.286904:0:32351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 7680 00010000:00010000:3.0:1789129971.287239:0:32351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce8320 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab811 expref: 32 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.287254:0:32351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789129971.287257:0:32351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129971.287262:0:32351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce8320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab811 expref: 32 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.287275:0:32351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00100000:3.0:1789129971.287589:0:32351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be597840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+31:28884:x1876037604797440:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 990us (1764us total) trans 25769803872 rc 301/301 00000100:00100000:3.0:1789129971.287597:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789129971.405355:0:32351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604797952 00000100:00100000:3.0:1789129971.405363:0:32351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604797952 00000100:00100000:3.0:1789129971.405416:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1789129971.405441:0:32351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be596580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+32:28890:x1876037604797952:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.405473:0:32351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.405499:0:32351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce8343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab818 expref: -99 pid: 32351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.405581:0:32351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce834a lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.405596:0:32351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce834a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.405909:0:32351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce834a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.419816:0:32336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604798464 00000100:00100000:3.0:1789129971.419823:0:32336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604798464 00010000:00010000:3.0:1789129971.419867:0:32336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc000/0x5c74554e47ce8366 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab81f expref: 36 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.419906:0:32336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129971.419916:0:32336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+36:2369:x1876037604798464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129971.419933:0:32336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129971.419941:0:32336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc000/0x5c74554e47ce8366 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab81f expref: 36 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.419952:0:32336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc000/0x5c74554e47ce8366 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab81f expref: 36 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.419971:0:32336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc000/0x5c74554e47ce8366 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab81f expref: 36 pid: 32349 timeout: 1234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.419999:0:32336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419200) 00010000:00010000:3.0:1789129971.420004:0:32336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8374 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.420014:0:32336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8374 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.420021:0:32336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8374 lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.420050:0:32336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129971.420115:0:32336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+35:2369:x1876037604798464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 199us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.420123:0:32336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129971.544177:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604798720 00000100:00100000:3.0:1789129971.544187:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604798720 00000100:00100000:3.0:1789129971.544248:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1789129971.544258:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+35:28900:x1876037604798720:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.544281:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.544303:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab82d expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129971.544561:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 7680 00010000:00010000:3.0:1789129971.544777:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8382 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab82d expref: 37 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.544792:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789129971.544801:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129971.544807:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab82d expref: 37 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.544821:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2200, rc 0) 00000100:00100000:3.0:1789129971.544937:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+36:28900:x1876037604798720:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 680us (893us total) trans 25769803875 rc 301/301 00000100:00100000:3.0:1789129971.544945:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1789129971.592130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.599447:0:32350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be595a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:32350:1876037626763136:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129971.599490:0:32350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.601390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789129971.605722:0:32350:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605731:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129971.605775:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:3.0:1789129971.605780:0:32350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129971.605816:0:32350:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605829:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605838:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605858:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605865:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605871:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.605875:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605883:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605894:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129971.605897:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.605901:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605907:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce83ac lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605919:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605925:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605930:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605934:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.605944:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605950:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605958:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff90b488939300) 00010000:00010000:3.0:1789129971.605961:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.605964:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.605970:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce83b3 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.606010:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce83a5 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab834 expref: 39 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.606024:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce83ba lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab834 expref: 38 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.606030:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff90b496419200) 00010000:00010000:3.0:1789129971.606032:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129971.606034:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789129971.606060:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+38:28901:x1876037604799232:12345-192.168.201.39@tcp:101:rm.0 Request processed in 13721us (13942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.606068:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1789129971.613283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.624379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789129971.631115:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631152:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631160:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631167:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.631173:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631182:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631199:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff90b4909bd600) 00010000:00010000:3.0:1789129971.631202:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.631207:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.631213:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd200/0x5c74554e47ce83eb lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34695 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129971.632116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.640352:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604800512 00000100:00100000:3.0:1789129971.640362:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604800512 00000100:00100000:3.0:1789129971.640431:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1789129971.640442:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+38:28650:x1876037604800512:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789129971.641019:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+39:28650:x1876037604800512:12345-192.168.201.39@tcp:35:bash.0 Request processed in 578us (757us total) trans 25769803880 rc 0/0 00000100:00100000:3.0:1789129971.641029:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1789129971.709564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.720220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129971.733529:0:33045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604801280 00000100:00100000:3.0:1789129971.733540:0:33045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604801280 00002000:00100000:3.0:1789129971.733594:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa4:0x0] (0->10) req@ffff90b4be596940 x1876037604801280/t0(0) o4->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:442/0 lens 504/0 e 0 to 0 dl 1789129982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129971.733632:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be596940 with x1876037604801280 ext(0->10) 00002000:00010000:3.0:1789129971.733638:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4be596940 00000100:00100000:3.0:1789129971.733665:0:33045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129971.733675:0:33045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be596940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2369:x1876037604801280:12345-192.168.201.39@tcp:4:bash.0 00000100:00100000:3.0:1789129971.734271:0:33045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be596940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+8:2369:x1876037604801280:12345-192.168.201.39@tcp:4:bash.0 Request processed in 595us (900us total) trans 25769803784 rc 0/0 00000100:00100000:3.0:1789129971.734280:0:33045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00002000:00100000:3.0:1789129971.734287:0:33045:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa4:0x0] (0->10) req@ffff90b4be596940 x1876037604801280/t25769803784(0) o4->93af2732-639b-4543-b895-cd82ddb7ac1a@192.168.201.39@tcp:442/0 lens 504/448 e 0 to 0 dl 1789129982 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129971.734296:0:33045:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be596940 with x1876037604801280 ext(0->10) 00002000:00010000:3.0:1789129971.734300:0:33045:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4be596940 00000100:00100000:3.0:1789129971.750021:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604801664 00000100:00100000:3.0:1789129971.750030:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604801664 00000100:00100000:3.0:1789129971.750096:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:3.0:1789129971.750106:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+42:28907:x1876037604801664:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129971.750331:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+43:28907:x1876037604801664:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 226us (597us total) trans 25769803883 rc 0/0 00000100:00100000:3.0:1789129971.750339:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:3.0:1789129971.937304:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604802176 00000100:00100000:3.0:1789129971.937321:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604802176 00000100:00100000:3.0:1789129971.937386:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789129971.937397:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+45:28923:x1876037604802176:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129971.937593:0:32350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129971.937644:0:32350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8469 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab865 expref: -99 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.937708:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.937725:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.937740:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938006:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938015:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938022:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938509:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938518:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938526:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129971.938574:0:32350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00000004:00200000:3.0:1789129971.938578:0:32350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129971.938596:0:32350:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938633:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938642:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938648:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938653:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938659:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.938663:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938670:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938680:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129971.938683:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.938687:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938693:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce8470 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938716:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938721:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938725:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938730:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129971.938733:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938738:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938744:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff90b496419d00) 00010000:00010000:3.0:1789129971.938747:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129971.938750:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938755:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce8477 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938798:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8469 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab865 expref: 47 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938811:0:32350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab865 expref: 46 pid: 32350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.938830:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff90b4a2a08b00) 00010000:00010000:3.0:1789129971.938832:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129971.938834:0:32350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789129971.938904:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+46:28923:x1876037604802176:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1508us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.938912:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789129971.952598:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604802688 00000100:00100000:3.0:1789129971.952646:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604802688 00000100:00100000:3.0:1789129971.952705:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789129971.952717:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+48:28923:x1876037604802688:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129971.953067:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+49:28923:x1876037604802688:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 350us (630us total) trans 25769803886 rc 0/0 00000100:00100000:3.0:1789129971.953076:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789129971.958104:0:32336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604802816 00000100:00100000:3.0:1789129971.958114:0:32336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604802816 00000100:00100000:3.0:1789129971.958183:0:32336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129971.958193:0:32336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+49:2370:x1876037604802816:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129971.958210:0:32336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129971.958236:0:32336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce848c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab86c expref: 49 pid: 32349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129971.958256:0:32336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff90b4a2a08b00) 00010000:00010000:3.0:1789129971.958262:0:32336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129971.958322:0:32336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+48:2370:x1876037604802816:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129971.958344:0:32336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129972.335516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129972.339343:0:32336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604803840 00000100:00100000:3.0:1789129972.339352:0:32336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604803840 00010000:00010000:3.0:1789129972.339389:0:32336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab865 expref: 52 pid: 32350 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129972.339437:0:32336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1789129972.339456:0:32336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+52:2370:x1876037604803840:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129972.339471:0:32336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129972.339478:0:32336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab865 expref: 52 pid: 32350 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.339490:0:32336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2e00/0x5c74554e47ce847e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab865 expref: 52 pid: 32350 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.339511:0:32336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff90b4a2a08b00) 00010000:00010000:3.0:1789129972.339516:0:32336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce84b6 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.339525:0:32336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce84b6 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.339532:0:32336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce84b6 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 32351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.339549:0:32336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129972.339623:0:32336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93af2732-639b-4543-b895-cd82ddb7ac1a+52:2370:x1876037604803840:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129972.339645:0:32336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1789129972.399668:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604803968 00000100:00100000:3.0:1789129972.399676:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604803968 00000100:00100000:3.0:1789129972.400061:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789129972.400079:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+51:28965:x1876037604803968:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789129972.400155:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400169:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400178:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400188:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400192:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400196:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400274:0:32350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400279:0:32350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400283:0:32350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129972.400329:0:32350:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400337:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400341:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400346:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400349:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129972.400353:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400357:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400365:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129972.400367:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129972.400371:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400375:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce84c4 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400384:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400387:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400598:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400674:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129972.400677:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400681:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400688:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff90b496419d00) 00010000:00010000:3.0:1789129972.400689:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129972.400691:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400695:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce84cb lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400707:0:32350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400711:0:32350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400715:0:32350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400718:0:32350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129972.400719:0:32350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400735:0:32350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400743:0:32350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff90b4a2a08b00) 00010000:00010000:3.0:1789129972.400746:0:32350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129972.400748:0:32350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129972.400754:0:32350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce84d2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129972.400849:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+51:28965:x1876037604803968:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 778us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129972.400855:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789129973.512074:0:33042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626764288 00000100:00100000:3.0:1789129973.512082:0:33042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626764288 00000100:00100000:3.0:1789129973.512140:0:33042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789129973.512152:0:33042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626764288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129973.512194:0:33042:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789129973.513546:0:33042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626764288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1388us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129973.513560:0:33042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1789129973.706521:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129975.096891:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803783 is committed 00000001:00080000:3.0:1789129975.096912:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803784 is committed 00000001:00080000:3.0:1789129976.140517:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803791 is committed 00000001:00080000:3.0:1789129976.140535:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803792 is committed 00000001:00080000:3.0:1789129976.140543:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803790 is committed 00000100:00100000:3.0:1789129976.186685:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626764416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789129976.186942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129976.191293:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803792 gen 2 00000004:00080000:3.0:1789129976.191299:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803791 committed transno 25769803792 00000004:00080000:3.0:1789129976.191321:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803792 committed transno 25769803792 00000100:00100000:3.0:1789129976.191467:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b4876de1c0 x1876037626764416/t25769803793(25769803793) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789129992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789129976.191479:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4876de1c0/2, rc 0, transno 25769803793 00000100:00100000:3.0:1789129976.191485:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626764416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789129976.352213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129976.352491:0:32341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604804096 00000100:00100000:3.0:1789129976.352498:0:32341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604804096 00000100:00100000:3.0:1789129976.352543:0:32341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789129976.352559:0:32341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a779f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23de0179-b53b-4fdb-b42d-12b6ac2e5dd1+13:2369:x1876037604804096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129976.353039:0:32341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a779f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23de0179-b53b-4fdb-b42d-12b6ac2e5dd1+13:2369:x1876037604804096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 485us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129976.353048:0:32341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00080000:3.0:1789129976.353207:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129976.353212:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129976.353214:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129978.108911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129978.630560:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626765312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129981.475966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129981.476169:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604805632 00000100:00100000:3.0:1789129981.476179:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604805632 00000100:00100000:3.0:1789129981.476246:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604806144 00000100:00100000:3.0:1789129981.476250:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604806144 00000100:00100000:3.0:1789129981.476265:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604805760 00000100:00100000:3.0:1789129981.476268:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604805760 00000100:00100000:3.0:1789129981.476280:0:33037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604806016 00000100:00100000:3.0:1789129981.476292:0:33037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604806016 00000100:00100000:3.0:1789129981.476311:0:33037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129981.476321:0:33037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2368:x1876037604805632:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476397:0:33037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+6:2368:x1876037604805632:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476405:0:33037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129981.476424:0:33037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789129981.476430:0:33037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+6:2368:x1876037604806144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476455:0:33037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+6:2368:x1876037604806144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476460:0:33037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789129981.476472:0:33037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789129981.476493:0:33037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48919ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+5:2368:x1876037604805760:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476516:0:33037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48919ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93af2732-639b-4543-b895-cd82ddb7ac1a+5:2368:x1876037604805760:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476522:0:33037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789129981.476534:0:33037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789129981.476540:0:33037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48919b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+5:2368:x1876037604806016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476560:0:33037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48919b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+5:2368:x1876037604806016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476565:0:33037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789129981.476584:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604805888 00000100:00100000:3.0:1789129981.476587:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604805888 00000100:00100000:3.0:1789129981.476646:0:32350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604805504 00000100:00100000:3.0:1789129981.476649:0:32350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604805504 00000100:00100000:3.0:1789129981.476671:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789129981.476678:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:2368:x1876037604805888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476706:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:2368:x1876037604805888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476712:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789129981.476723:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789129981.476729:0:32350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+15:2368:x1876037604805504:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129981.476757:0:32350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+15:2368:x1876037604805504:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129981.476763:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00080000:3.0:1789129981.476792:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129981.476802:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129981.476804:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129981.899104:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129982.728534:0:32341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626765440 00000100:00100000:3.0:1789129982.728539:0:32341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626765440 00000100:00100000:3.0:1789129982.728578:0:32341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789129982.728586:0:32341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a779f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0088ea47-949f-4d5d-9556-e30911137ffd+19:3307:x1876037626765440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129982.728650:0:32341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a779f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0088ea47-949f-4d5d-9556-e30911137ffd+19:3307:x1876037626765440:12345-0@lo:400:kworker.0 Request processed in 65us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129982.728657:0:32341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789129982.728704:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129982.728708:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129982.728711:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129982.734424:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626766208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789129983.953124:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129984.419409:0:32384:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789129984.419419:0:32384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129984.419463:0:32384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:3.0:1789129984.419471:0:32384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1789129985.993083:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129988.038540:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129988.911000:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604807808 00000100:00100000:3.0:1789129988.911013:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604807808 00000100:00100000:3.0:1789129988.911097:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129988.911118:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+17:29888:x1876037604807808:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789129988.911475:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93af2732-639b-4543-b895-cd82ddb7ac1a+18:29888:x1876037604807808:12345-192.168.201.39@tcp:35:umount.0 Request processed in 366us (698us total) trans 25769803893 rc 0/0 00000100:00100000:3.0:1789129988.911485:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:3.0:1789129988.929476:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129988.941259:0:34474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604808320 00000100:00100000:3.0:1789129988.941285:0:34474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604808320 00000100:00100000:3.0:1789129988.941454:0:34474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789129988.941467:0:34474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23de0179-b53b-4fdb-b42d-12b6ac2e5dd1+11:2368:x1876037604808320:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129988.941492:0:34474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129988.941516:0:34474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eae00/0x5c74554e47ce7ceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab62e expref: 11 pid: 32344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129988.941535:0:34474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129988.943549:0:34474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23de0179-b53b-4fdb-b42d-12b6ac2e5dd1+10:2368:x1876037604808320:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1891us (13284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129988.943570:0:34474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00080000:3.0:1789129988.953410:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129990.499842:0:32353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604809856 00000100:00100000:3.0:1789129990.499857:0:32353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604809856 00000100:00100000:3.0:1789129990.499932:0:32353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789129990.499943:0:32353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+10:29903:x1876037604809856:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789129990.500206:0:32353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e+11:29903:x1876037604809856:12345-192.168.201.39@tcp:35:umount.0 Request processed in 264us (2392us total) trans 25769803895 rc 0/0 00000100:00100000:3.0:1789129990.500214:0:32353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789129990.513754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:3.0:1789129990.516565:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789129990.539019:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 93af2732-639b-4543-b895-cd82ddb7ac1a 00000020:00000080:3.0:1789129990.539036:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b492732800/93af2732-639b-4543-b895-cd82ddb7ac1a 00000100:00100000:3.0:1789129990.540365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129990.569496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000001:00080000:3.0:1789129991.538267:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803892 is committed 00000001:00100000:3.0:1789129991.538294:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 93af2732-639b-4543-b895-cd82ddb7ac1a 00000001:00080000:3.0:1789129991.538302:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803894 is committed 00000001:00100000:3.0:1789129991.538307:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000001:00080000:3.0:1789129991.538314:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803896 is committed 00000020:00000080:3.0:1789129991.538320:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b4c1692800/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000020:00000080:3.0:1789129991.538343:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b492734800/93af2732-639b-4543-b895-cd82ddb7ac1a 00000020:00000080:3.0:1789129991.538358:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c1692800/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e for lustre-MDT0000 00000020:00000080:3.0:1789129991.538440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b492734800/93af2732-639b-4543-b895-cd82ddb7ac1a for lustre-MDT0000 00000020:00000080:3.0:1789129991.538477:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1690000 for lustre-MDT0000 00000020:00000080:3.0:1789129991.538482:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1692000 for lustre-MDT0000 00000020:00000080:3.0:1789129991.545499:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb7000/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e for lustre-OST0001 00000020:00000080:3.0:1789129991.545567:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b492730000/93af2732-639b-4543-b895-cd82ddb7ac1a for lustre-OST0001 00000020:00000080:3.0:1789129991.545591:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b489cb3000 for lustre-OST0001 00000020:00000080:3.0:1789129991.545598:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b486698000 for lustre-OST0001 00000100:00100000:3.0:1789129992.602623:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129992.602635:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0088ea47-949f-4d5d-9556-e30911137ffd:3306:1876037626767616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129992.602673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129992.608155:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0088ea47-949f-4d5d-9556-e30911137ffd:3306:1876037626767616:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789129992.609422:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129992.609428:0:32345:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789129992.720909:0:35180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129992.720932:0:35180:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789129992.720938:0:35180:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90b4b5763490) has no exports 00000020:00000080:3.0:1789129992.721781:0:35180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce7902 00000020:00000080:3.0:1789129992.721797:0:35180:0:(genops.c:885:class_export_put()) final put ffff90b497ef9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789129992.721878:0:35180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129992.721901:0:35180:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:01000000:3.0:1789129992.725593:0:35180:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b488130540 - data ffff90b4bfe6b0d8/ffff90b382b01800 00000020:01000000:3.0:1789129992.725822:0:35180:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4861cdcc0 - data ffff90b4bffcb6c0/ffff90b485c55400 00000001:00000004:3.0:1789129992.739919:0:35180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803896 00000100:00100000:3.0:1789129992.914695:0:34695:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90b48a286e00:34695] 3 exiting: rc = 0 00000100:00100000:3.0:1789129992.925593:0:32353:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90b489955a00:32353] 1 exiting: rc = 0 00000100:00100000:3.0:1789129992.927983:0:32355:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90b489954000:32355] 1 exiting: rc = 0 00000100:00100000:3.0:1789129992.943716:0:32359:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90b381159800:32359] 1 exiting: rc = 0 00000100:00100000:3.0:1789129992.945411:0:32360:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90b381bf7400:32360] 0 exiting: rc = 1 00000001:00100000:3.0:1789129995.672284:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789129995.672296:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4856bd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789129995.672512:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000020:00000080:3.0:1789129995.672515:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4afb59800/76e9ad7b-fd92-4be8-affd-c2a69a7c1d4e 00000100:00100000:3.0:1789129996.039137:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626768896:0@lo:39:umount.0 00000400:00000100:3.0:1789129996.039197:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876037626768896 offset 0 length 224: 4 00000100:00100000:3.0:1789129996.039627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0088ea47-949f-4d5d-9556-e30911137ffd:3307:1876037626769024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129996.039682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129996.040229:0:32334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789129996.040247:0:32334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1876037626769024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789129996.040253:0:32334:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789129996 with bad export cookie 6662043543488329881 00000100:00080000:3.0:1789129996.060536:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789129996.060543:0:3307:0:(import.c:65:import_set_state_nolock()) ffff90b4bda11000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789129996.060546:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789129996.074209:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.139@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789129996.074216:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789129996.074226:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4876bcb40 x1876037626768512/t0(0) o400->MGC192.168.201.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789130008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129996.074246:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b48904b840 x1876037626769024/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130012 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789129996.074256:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789129996.074277:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789129996.074279:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789129996.074283:0:3307:0:(import.c:65:import_set_state_nolock()) ffff90b4bda11000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789129996.074288:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 1054 00000100:00080000:3.0:1789129996.074296:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b4bda11000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789129996.075535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0088ea47-949f-4d5d-9556-e30911137ffd:3305:1876037626769152:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1789129996.075585:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876037626769152 offset 0 length 520: 4 00010000:00010000:1.0:1789129996.229857:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129997.254136:0:35182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129998.278733:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130000.325802:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130001.093873:0:31907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0088ea47-949f-4d5d-9556-e30911137ffd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130001.093886:0:31907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0088ea47-949f-4d5d-9556-e30911137ffd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789130001.351137:0:35182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130002.376496:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130004.422118:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130005.446167:0:35182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130006.277769:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129996/real 1789129996] req@ffff90b489048780 x1876037626769152/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789130006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130006.277806:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b489048780 x1876037626769152/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789130006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130006.277818:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129996/real 1789129996] req@ffff90b4876bda40 x1876037626768896/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130006.277829:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b4876bda40 x1876037626768896/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130006.277858:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4bda11000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130006.277879:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789130006.277883:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0088ea47-949f-4d5d-9556-e30911137ffd:3305:1876037626769152:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789130006.277890:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b492733000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789130006.277912:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626768896:0@lo:39:umount.0 00010000:00010000:1.0:1789130006.280993:0:35181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130006.281008:0:35181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281039:0:35181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130006.281044:0:35181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281055:0:35181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130006.281063:0:35181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130006.281069:0:35181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130006.281072:0:35181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789130006.281075:0:35181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789130006.281095:0:35181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4bda11000 00010000:00010000:1.0:1789130006.281099:0:35181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281106:0:35181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b490363000/0x5c74554e47ce79c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce79cd expref: -99 pid: 33036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281122:0:35181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130006.281126:0:35181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281131:0:35181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130006.281134:0:35181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281141:0:35181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130006.281153:0:35181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130006.281158:0:35181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789130006.281160:0:35181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789130006.281162:0:35181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789130006.281169:0:35181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4bda11000 00010000:00010000:1.0:1789130006.281172:0:35181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281178:0:35181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce7d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7d46 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130006.281187:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130006.281189:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130006.281191:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130006.284089:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130006.480919:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130008.519524:0:35181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789130009.258159:0:35489:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789130009.287569:0:35489:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789130009.288033:0:35489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.288051:0:35489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.288059:0:35489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.288066:0:35489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.288095:0:35489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789130009.288102:0:35489:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789130009.288128:0:35489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130009.288142:0:35489:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b48904b840 x1876037626769280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130009.288166:0:35489:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bfcd6d00 x1876037626769408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130009.288594:0:35489:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b48904b480 x1876037626769664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130009.288629:0:35489:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4be5f1a40 x1876037626769792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130009.288641:0:35489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789130009.288649:0:35489:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789130009.289435:0:32337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130009.289450:0:32337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.289462:0:32337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130009.289466:0:32337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.289479:0:32337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130009.289502:0:32337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130009.289508:0:32337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130009.289511:0:32337:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789130009.289515:0:32337:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789130009.289537:0:32337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4bda11000 00010000:00010000:1.0:1789130009.289541:0:32337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.289547:0:32337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151a400/0x5c74554e47ce7b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7b4e expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.289565:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130009.289567:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130009.289569:0:32337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130009.290479:0:35489:0:(import.c:65:import_set_state_nolock()) ffff90b4c1693000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789130009.290486:0:35489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130009.290490:0:35489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789130009.290494:0:35489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789130009.293135:0:35489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293155:0:35489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293163:0:35489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293170:0:35489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293315:0:35489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130009.293325:0:35489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293331:0:35489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293356:0:35489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293362:0:35489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293395:0:32338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130009.293402:0:32338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293410:0:32338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130009.293486:0:32338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293497:0:32338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130009.293504:0:32338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130009.293520:0:32338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130009.293523:0:32338:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789130009.293536:0:32338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4bda11000 00010000:00010000:1.0:1789130009.293540:0:32338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293547:0:32338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4afaa5a00/0x5c74554e47ce7b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7b24 expref: -99 pid: 33758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293561:0:32338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130009.293564:0:32338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293569:0:32338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130009.293572:0:32338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.293579:0:32338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130009.293584:0:32338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130009.293589:0:32338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789130009.293590:0:32338:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789130009.293594:0:32338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4bda11000 00010000:00010000:1.0:1789130009.293597:0:32338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130009.293724:0:35489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1789130009.293737:0:35489:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789130009.293742:0:35489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789130009.294033:0:32338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce7d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce7d38 expref: -99 pid: 32346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130009.294048:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130009.294049:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789130009.294068:0:35489:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789130009.294097:0:35489:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789130009.294102:0:35489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789130009.294109:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130009.294114:0:35489:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789130009.294120:0:35489:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90b487c73490) has no exports 00000020:00080000:3.0:1789130009.294356:0:35489:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90b487c73490) has no exports 00000020:01000000:3.0:1789130009.298885:0:35489:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4c095fb40 - data ffff90b49d3abe58/ffff90b382d05000 00000020:01000000:3.0:1789130009.299167:0:35489:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b48855e660 - data ffff90b4a24a3ca8/ffff90b382b06400 00010000:00010000:1.0:1789130009.299576:0:32338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789130009.311541:0:35489:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000100:00100000:1.0:1789130009.425185:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0088ea47-949f-4d5d-9556-e30911137ffd:3305:1876037626769536:0@lo:250:kworker.0 00000020:00000080:3.0:1789130009.425346:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48669d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1789130009.425552:0:32346:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1789130009.425694:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bda13800/0088ea47-949f-4d5d-9556-e30911137ffd for MGC192.168.201.139@tcp 00000020:00000080:3.0:1789130009.425959:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4bda11000 for MGC192.168.201.139@tcp 00000020:00000080:3.0:1789130009.425967:0:36:0:(genops.c:885:class_export_put()) final put ffff90b4bda10800/0088ea47-949f-4d5d-9556-e30911137ffd 00000020:00000080:3.0:1789130009.425969:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bda10800/0088ea47-949f-4d5d-9556-e30911137ffd for MGC192.168.201.139@tcp 00000020:01000000:3.0:1789130009.425974:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.139@tcp (0088ea47-949f-4d5d-9556-e30911137ffd) 00000020:00000080:3.0:1789130009.427369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c1694000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789130009.427617:0:35181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789130009.427871:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1693000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789130009.428697:0:32337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789130009.428952:0:35182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789130009.429083:0:32338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789130009.429331:0:32332:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90b4bfccf800:32332] 0 exiting: rc = 1 00000100:00100000:1.0:1789130009.429658:0:32333:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90b4bfcce800:32333] 1 exiting: rc = 0 00000100:00100000:3.0:1789130009.429890:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.430249:0:32336:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90b4bfccf200:32336] 2 exiting: rc = 0 00000100:00100000:3.0:1789130009.432904:0:32335:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90b4857a6200:32335] 1 exiting: rc = 0 00000100:00100000:1.0:1789130009.433136:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433144:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433155:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433161:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433167:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433258:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433265:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433271:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433278:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433283:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433287:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433292:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433297:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433302:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433307:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433325:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433330:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433336:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433340:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433345:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433349:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433355:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433359:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433363:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433367:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433371:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433376:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433380:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433385:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433390:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433394:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433399:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433404:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433416:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433422:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433427:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433432:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433437:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433442:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433447:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433452:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433457:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433462:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433466:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433471:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433475:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433480:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433484:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433488:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433493:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433503:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433507:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433512:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433517:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433521:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433526:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433531:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433536:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433540:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433545:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433550:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433554:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433559:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.433564:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789130009.434690:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130009.434702:0:35489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789130009.434708:0:35489:0:(genops.c:885:class_export_put()) final put ffff90b4c1697800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789130009.434712:0:35489:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c1697800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789130009.434718:0:35489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789130009.434908:0:35489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4856b8000 1 00000020:00000080:1.0:1789130009.434915:0:35489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce7b16 00000020:00000080:1.0:1789130009.434921:0:35489:0:(genops.c:885:class_export_put()) final put ffff90b4856be800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789130009.434930:0:35489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789130009.434934:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130009.434938:0:35489:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789130009.434942:0:35489:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90b4bb023490) has no exports 00000020:00000080:3.0:1789130009.435001:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4856be800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789130009.452940:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130009.452956:0:35489:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789130009.452962:0:35489:0:(genops.c:885:class_export_put()) final put ffff90b4856ba000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789130009.452966:0:35489:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4856ba000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789130009.452979:0:35489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789130009.453199:0:35489:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b4856ba800 00000020:01000000:1.0:1789130009.453226:0:35489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789130009.453241:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130009.453246:0:35489:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789130009.453251:0:35489:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90b487c74ed8) has no exports 00000020:00000080:1.0:1789130009.453279:0:35489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130009.453285:0:35489:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789130009.453288:0:35489:0:(genops.c:885:class_export_put()) final put ffff90b487d43800/OSS_uuid 00000020:00000080:1.0:1789130009.453290:0:35489:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487d43800/OSS_uuid for OSS 00000020:01000000:1.0:1789130009.453294:0:35489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789130009.456683:0:32345:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789130009.457022:0:33037:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90b4884caa00:33037] 0 exiting: rc = 1 00000100:00100000:1.0:1789130009.457901:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457915:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457921:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457926:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457931:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457935:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457940:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457944:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457949:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457953:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457957:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457962:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457966:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457971:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457975:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457980:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457985:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457990:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457994:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.457999:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458003:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458007:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458011:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458015:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458045:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458051:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458055:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458071:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458075:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458080:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458084:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458090:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458095:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458099:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458103:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458108:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458112:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458116:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458120:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458125:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458129:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458134:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458138:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458142:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458147:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458152:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458157:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458162:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458167:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458239:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458246:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458251:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458256:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458261:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458266:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458270:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458275:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458283:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458288:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458293:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458298:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458303:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458317:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.458322:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459552:0:33041:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90b486007600:33041] 0 exiting: rc = 1 00000100:00100000:3.0:1789130009.459738:0:33042:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90b488a48600:33042] 1 exiting: rc = 0 00000100:00100000:1.0:1789130009.459837:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459845:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459851:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459856:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459861:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459866:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459871:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459876:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459880:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459885:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459889:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459893:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459897:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459902:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459906:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459911:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459917:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459922:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459926:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459930:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459935:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459939:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459942:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459946:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459950:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459954:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459959:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459965:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459970:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459974:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459978:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459983:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.459996:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460001:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460006:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460010:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460014:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460019:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460023:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460027:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460031:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460037:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460044:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460051:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460056:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460061:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460066:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460071:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460076:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460081:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460085:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460090:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460094:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460098:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460103:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460107:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460111:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460116:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460120:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460124:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460128:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460132:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460136:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.460140:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130009.461977:0:33045:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90b488b74400:33045] 2 exiting: rc = 0 00000100:00100000:1.0:1789130009.466910:0:33043:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90b488b75a00:33043] 0 exiting: rc = 1 00000100:00100000:1.0:1789130009.494190:0:33047:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90b488b75800:33047] 1 exiting: rc = 0 00000100:00100000:1.0:1789130009.494462:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494477:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494483:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494488:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494493:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494498:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494502:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494507:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494512:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494516:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494521:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494527:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494532:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494537:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494542:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494547:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494552:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494558:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494564:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494570:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494576:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494581:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494586:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494592:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.494597:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495050:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495059:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495064:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495070:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495076:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495081:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495086:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495092:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495110:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495117:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495123:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495136:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495142:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495148:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495153:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495162:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495182:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495188:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495195:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495203:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495212:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495218:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495223:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495228:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495235:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495243:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495251:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495256:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495261:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495266:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495271:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495276:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495281:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495286:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495291:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495296:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495300:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495304:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130009.495309:0:35489:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789130009.539483:0:35489:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789130033.193075:0:36109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00100000:10000000:3.0:1789130043.752225:0:36569:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789130043.757004:0:36569:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3a:0x0] (8/32) 00100000:10000000:3.0:1789130043.757355:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 475: rc = 0 00100000:10000000:3.0:1789130043.757528:0:36569:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789130043.757587:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 475: rc = 0 00100000:10000000:3.0:1789130043.757732:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 475: rc = 0 00100000:10000000:3.0:1789130043.757831:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 475: rc = 0 00100000:10000000:3.0:1789130043.757932:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 475: rc = 0 00100000:10000000:3.0:1789130043.758033:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 475: rc = 0 00100000:10000000:3.0:1789130043.758296:0:36569:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 477: rc = 0 00000100:00100000:3.0:1789130043.818890:0:36569:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789130043.818903:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789130043.821869:0:36569:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789130043.821878:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789130043.823433:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130043.823436:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130043.823438:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130043.824237:0:36569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1789130043.841664:0:36569:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789130043.841683:0:36569:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789130043.841686:0:36569:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789130043.845552:0:36569:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789130043.845694:0:36569:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789130043.846358:0:36569:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789130043.846871:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130043.847055:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789130043.847062:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00080000:1.0:1789130043.859114:0:36583:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789130043.867198:0:36584:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789130043.874433:0:36569:0:(genops.c:1385:class_connect()) connect: client c7d5f341-5d27-45e7-8794-684d66c1a62a, cookie 0x5c74554e47ce8503 00000100:00080000:1.0:1789130043.874453:0:36569:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130043.874462:0:36569:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b4870be800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130043.874501:0:36569:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4876be580 x1876037626769920/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130043.874550:0:36569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c7d5f341-5d27-45e7-8794-684d66c1a62a->MGS 00000020:01000004:1.0:1789130043.874572:0:36569:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789130043.874598:0:36569:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789130043.874641:0:36569:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90b487cb1a48) 00000020:00000080:1.0:1789130043.874653:0:36569:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789130043.898121:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130043.899226:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130043.899236:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789130043.902066:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789130043.902072:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789130043.904053:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789130043.904063:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789130043.952061:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130043.952293:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789130043.952300:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789130043.954047:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789130043.954063:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789130043.954986:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130043.955182:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789130043.955189:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789130043.956242:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789130043.956252:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789130043.957074:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130043.957251:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789130043.957257:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789130043.958185:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789130043.958194:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789130043.958778:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130043.959095:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789130043.959100:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789130043.960155:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789130043.960163:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789130043.988310:0:36569:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130043.988535:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130043.988541:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789130043.990761:0:36569:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789130043.990777:0:36569:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 20000000:01000000:3.0:1789130043.996200:0:36581:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 20 00000100:00100000:3.0:1789130044.023490:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130044.023505:0:36569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.023514:0:36569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.023571:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.023621:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.023756:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.024219:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130044.024258:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789130044.024279:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024288:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.024296:0:36569:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b485290000 10000000:01000000:3.0:1789130044.024300:0:36569:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130044.024304:0:36569:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90b485290000 10000000:01000000:3.0:1789130044.024306:0:36569:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789130044.024309:0:36569:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90b485290000 from 1 10000000:01000000:3.0:1789130044.024312:0:36569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789130044.024332:0:36569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024340:0:36569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024348:0:36569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.024360:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130044.024399:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.024414:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.024809:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130044.024819:0:36569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024835:0:36569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.024846:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789130044.024860:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024867:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.024872:0:36569:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789130044.024875:0:36569:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130044.024879:0:36569:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90b485290000 10000000:01000000:3.0:1789130044.024881:0:36569:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789130044.024884:0:36569:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789130044.024886:0:36569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130044.024901:0:36569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024908:0:36569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.024916:0:36569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.024927:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130044.024951:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.024969:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.025341:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130044.025352:0:36569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.025359:0:36569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.025397:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.025421:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.025444:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.026037:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.026066:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130044.026103:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.026142:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.026782:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626770816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130044.027753:0:36605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36605:1876037626770944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130044.027809:0:36605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.027846:0:36605:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.027904:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626770944 00000100:00100000:1.0:1789130044.027910:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626770944 00000100:00100000:1.0:1789130044.027951:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130044.027959:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+9:36605:x1876037626770944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130044.028502:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+9:36605:x1876037626770944:12345-0@lo:502:llog_process_th.0 Request processed in 541us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.028512:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130044.028642:0:36605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36605:1876037626770944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130044.028672:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130044.028685:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.028687:0:36605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130044.028692:0:36605:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789130044.028696:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130044.028711:0:36605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90b4bb023490) 00000020:00000080:3.0:1789130044.028732:0:36605:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789130044.028747:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789130044.028836:0:36605:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789130044.028844:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce8549 00000020:00000080:3.0:1789130044.029066:0:36605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789130044.029071:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130044.029075:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.029076:0:36605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130044.029079:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130044.029083:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.029085:0:36605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789130044.029088:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130044.029095:0:36605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90b4bb024ed8) 00000020:00000080:3.0:1789130044.029105:0:36605:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789130044.029109:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789130044.029111:0:36605:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789130044.029365:0:36605:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789130044.029375:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130044.029426:0:36605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b485290000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789130044.029442:0:36605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90b4bb020000) 00000020:00000080:3.0:1789130044.029451:0:36605:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789130044.029514:0:36605:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789130044.029521:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce855e 00000020:00000080:3.0:1789130044.029980:0:36605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789130044.029988:0:36605:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789130044.029995:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5c74554e47ce8565 00080000:01000000:3.0:1789130044.030001:0:36605:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789130044.030005:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce856c 00000020:00000080:3.0:1789130044.135812:0:36605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789130044.140898:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5c74554e47ce8581 00000020:00000080:3.0:1789130044.141103:0:36605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789130044.141115:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130044.141122:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.141124:0:36605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789130044.141135:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789130044.141138:0:36605:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789130044.141140:0:36605:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130044.141141:0:36605:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130044.141142:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789130044.141145:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.141146:0:36605:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789130044.141149:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130044.141154:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.141155:0:36605:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789130044.141160:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789130044.142085:0:36605:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789130044.142289:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130044.142296:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.142298:0:36605:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789130044.142303:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130044.142308:0:36605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789130044.142311:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.142313:0:36605:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789130044.142315:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789130044.142320:0:36605:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:3.0:1789130044.142348:0:36605:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789130044.142350:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130044.142367:0:36605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90b4bb021a48) 00000020:00000080:3.0:1789130044.142385:0:36605:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789130044.142390:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789130044.142445:0:36605:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789130044.142450:0:36605:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789130044.142456:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce858f 00010000:00080000:3.0:1789130044.142487:0:36605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b3812fd000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1789130044.142742:0:36605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789130044.143984:0:36605:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789130044.144051:0:36605:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789130044.146371:0:36605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130044.146450:0:36605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:3.0:1789130044.146517:0:36605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].1, 64 off8256 00000020:00000080:3.0:1789130044.155012:0:36605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130044.155027:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789130044.155065:0:36605:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789130044.155083:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce8596 00000100:00080000:3.0:1789130044.155093:0:36605:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130044.155099:0:36605:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b3812fd000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130044.155508:0:36605:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd43c0 x1876037626771072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130044.155760:0:36605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789130044.155832:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130044.155837:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.155838:0:36605:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789130044.155842:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789130044.155845:0:36605:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789130044.155846:0:36605:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130044.155848:0:36605:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130044.155850:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789130044.155852:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.155853:0:36605:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789130044.155856:0:36605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130044.155860:0:36605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789130044.155864:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130044.155865:0:36605:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789130044.155868:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789130044.155872:0:36605:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:3.0:1789130044.155893:0:36605:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789130044.155895:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130044.155922:0:36605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90b4ba400000) 00000020:00000080:3.0:1789130044.155936:0:36605:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789130044.155942:0:36605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789130044.155997:0:36605:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789130044.156002:0:36605:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789130044.156007:0:36605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce85a4 00010000:00080000:3.0:1789130044.156042:0:36605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b492736000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1789130044.156815:0:36605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789130044.159322:0:36605:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789130044.159352:0:36605:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789130044.159881:0:36605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130044.159966:0:36605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:3.0:1789130044.160033:0:36605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].1, 64 off8256 00000100:00100000:1.0:1789130044.179593:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626771200:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789130044.179685:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626771200 offset 0 length 520: 4 00000020:01000000:3.0:1789130044.186435:0:36569:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789130044.186460:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789130044.186485:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.186496:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.186506:0:36569:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b485290000 from 1 10000000:01000000:3.0:1789130044.186508:0:36569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789130044.186543:0:36569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.186551:0:36569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.186560:0:36569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.186592:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130044.186664:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.186703:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.186772:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626771456 00000100:00100000:1.0:1789130044.186780:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626771456 00000100:00100000:1.0:1789130044.186822:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130044.186830:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+9:36569:x1876037626771456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130044.186843:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130044.186857:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce85b2 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.186880:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 10 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.186891:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 10 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.186900:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc600, rc 0) 00000100:00100000:1.0:1789130044.186940:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+10:36569:x1876037626771456:12345-0@lo:101:mount.lustre.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.186947:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130044.187409:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130044.187423:0:36569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.187433:0:36569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.188030:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771584:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789130044.188093:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.191708:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.191747:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771584:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789130044.192983:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789130044.193056:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.193069:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.193078:0:36569:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b485290000 from 1 10000000:01000000:3.0:1789130044.193081:0:36569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130044.193136:0:36569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.193160:0:36569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.193201:0:36569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.193235:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130044.193310:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.193352:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.194002:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626771712 00000100:00100000:1.0:1789130044.194011:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626771712 00000100:00100000:1.0:1789130044.194071:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130044.194081:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+10:36569:x1876037626771712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130044.194094:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130044.194120:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdda00/0x5c74554e47ce85c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce85c0 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.194145:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdda00/0x5c74554e47ce85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce85c0 expref: 11 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.194178:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdda00/0x5c74554e47ce85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce85c0 expref: 11 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.194188:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdda00, rc 0) 00000100:00100000:1.0:1789130044.194244:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36569:x1876037626771712:12345-0@lo:101:mount.lustre.0 Request processed in 164us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.194252:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130044.194455:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130044.194473:0:36569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.194483:0:36569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.194549:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.194580:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.194636:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.195313:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.195343:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626771968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130044.195384:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.195412:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.195468:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626771968 00000100:00100000:1.0:1789130044.195473:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626771968 00000100:00100000:1.0:1789130044.195504:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130044.195510:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36569:x1876037626771968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130044.195677:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36569:x1876037626771968:12345-0@lo:503:mount.lustre.0 Request processed in 166us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.195684:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130044.199132:0:36614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36614:1876037626772096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130044.199248:0:36614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130044.199296:0:36614:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.201248:0:36614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36614:1876037626772096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130044.201282:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130044.201293:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201295:0:36614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789130044.201301:0:36614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b485290000 00000020:00000080:1.0:1789130044.201304:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130044.201310:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130044.201312:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201313:0:36614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789130044.201325:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130044.201328:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201329:0:36614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789130044.201332:0:36614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b485290000 00000020:00000080:1.0:1789130044.201334:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130044.201392:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130044.201396:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201397:0:36614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789130044.201399:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130044.201402:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201403:0:36614:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130044.201407:0:36614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b485290000 00000020:00000080:1.0:1789130044.201409:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130044.201426:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130044.201430:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201431:0:36614:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130044.201433:0:36614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130044.201436:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130044.201437:0:36614:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130044.201440:0:36614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b485290000 00000020:00000080:1.0:1789130044.201442:0:36614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789130044.201490:0:36614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36614:1876037626772224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130044.201536:0:36614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130044.201574:0:36614:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130044.201656:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772224 00000100:00100000:3.0:1789130044.201662:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772224 00000100:00100000:3.0:1789130044.201702:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130044.201717:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36614:x1876037626772224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130044.201885:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36614:x1876037626772224:12345-0@lo:502:llog_process_th.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130044.201893:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:3.0:1789130044.202284:0:36569:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789130044.202305:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130044.202326:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.202336:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.202376:0:36569:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130044.202379:0:36569:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b485290000 10000000:01000000:3.0:1789130044.202382:0:36569:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b485290000 10000000:01000000:3.0:1789130044.202386:0:36569:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130044.202391:0:36569:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b485290000 from 1 10000000:01000000:3.0:1789130044.202393:0:36569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130044.202418:0:36569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.202427:0:36569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.202436:0:36569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.202448:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626772352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130044.202478:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.202507:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.202625:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772352 00000100:00100000:1.0:1789130044.202630:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772352 00000100:00100000:1.0:1789130044.202661:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789130044.202668:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+11:36569:x1876037626772352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130044.202678:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130044.202689:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdde00/0x5c74554e47ce85d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce85ce expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.202719:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdde00/0x5c74554e47ce85d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce85ce expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.202730:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdde00/0x5c74554e47ce85d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce85ce expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.202738:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdde00, rc 0) 00000100:00100000:1.0:1789130044.202773:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36569:x1876037626772352:12345-0@lo:101:mount.lustre.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.202780:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130044.203019:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772480 00000100:00100000:3.0:1789130044.203023:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772480 00000100:00100000:3.0:1789130044.203042:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130044.203047:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36569:x1876037626772480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130044.203279:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36569:x1876037626772480:12345-0@lo:501:mount.lustre.0 Request processed in 230us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130044.203286:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130044.203629:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772608 00000100:00100000:1.0:1789130044.203634:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772608 00000100:00100000:1.0:1789130044.203654:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130044.203660:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36569:x1876037626772608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130044.203802:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36569:x1876037626772608:12345-0@lo:503:mount.lustre.0 Request processed in 142us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.203809:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130044.207529:0:36617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36617:1876037626772736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130044.207639:0:36617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.207690:0:36617:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130044.207776:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772736 00000100:00100000:1.0:1789130044.207783:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772736 00000100:00100000:1.0:1789130044.207822:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130044.207831:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36617:x1876037626772736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130044.208074:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36617:x1876037626772736:12345-0@lo:502:llog_process_th.0 Request processed in 243us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.208083:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130044.209276:0:36617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36617:1876037626772736:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789130044.209356:0:36617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789130044.209371:0:36617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90b4ba401a48) 00000020:00000080:3.0:1789130044.209395:0:36617:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789130044.209484:0:36617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b485290000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789130044.209489:0:36617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b485290000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789130044.209492:0:36617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b485290000 4 00010000:00080000:3.0:1789130044.209523:0:36617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4bb011000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00000100:00100000:1.0:1789130044.218262:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626772864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130044.218351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130044.218560:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130044.218568:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4bb011000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130044.218572:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789130044.218575:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626772864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130044.224389:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626772992 00000100:00100000:1.0:1789130044.224404:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626772992 00000100:00100000:1.0:1789130044.224474:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130044.224485:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36617:x1876037626772992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130044.224794:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+12:36617:x1876037626772992:12345-0@lo:502:llog_process_th.0 Request processed in 310us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.224802:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130044.239302:0:36617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7d5f341-5d27-45e7-8794-684d66c1a62a:36617:1876037626772992:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789130044.239347:0:36617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789130044.239411:0:36569:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789130044.239431:0:36569:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130044.239448:0:36569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.239459:0:36569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789130044.239513:0:36569:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789130044.239515:0:36569:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130044.239516:0:36569:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130044.239518:0:36569:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130044.239519:0:36569:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130044.239521:0:36569:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130044.239522:0:36569:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130044.239524:0:36569:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130044.239526:0:36569:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130044.239528:0:36569:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130044.239531:0:36569:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789130044.239534:0:36569:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130044.239535:0:36569:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130044.239537:0:36569:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130044.239538:0:36569:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130044.239539:0:36569:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130044.239540:0:36569:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130044.239541:0:36569:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130044.239542:0:36569:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130044.239543:0:36569:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130044.239544:0:36569:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130044.239566:0:36569:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789130044.239582:0:36569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626773120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130044.239670:0:36569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.239706:0:36569:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44240 going to sleep for 11 seconds 20000000:01000000:3.0:1789130044.320355:0:36581:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130044.320378:0:36581:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789130044.321037:0:36570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626773248 00000100:00100000:3.0:1789130044.321046:0:36570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626773248 00000100:00100000:3.0:1789130044.321102:0:36570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130044.321117:0:36570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:36603:x1876037626773248:12345-0@lo:104: 00010000:00010000:3.0:1789130044.321132:0:36570:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321224:0:36570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130044.321231:0:36570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:36603:x1876037626773248:12345-0@lo:104: Request processed in 122us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130044.321239:0:36570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789130044.321260:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130044.321276:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321284:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130044.321288:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321296:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130044.321303:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130044.321309:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130044.321338:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321344:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130044.321360:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321365:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85b9 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.321389:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130044.321390:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130044.321392:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130044.322039:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626773376 00000100:00100000:1.0:1789130044.322045:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626773376 00010000:00010000:1.0:1789130044.322071:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 13 pid: 36579 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130044.322104:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130044.322117:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+13:3307:x1876037626773376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130044.322129:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130044.322134:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 13 pid: 36579 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322145:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 13 pid: 36579 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322172:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322257:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789130044.322281:0:36572:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001807577s 00010000:00010000:1.0:1789130044.322286:0:36572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322293:0:36572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322299:0:36572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322305:0:36572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322310:0:36572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130044.322314:0:36572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322321:0:36572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322330:0:36572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.322339:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130044.322375:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+13:3307:x1876037626773376:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130044.322382:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789130044.323949:0:36603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdc600/0x5c74554e47ce85b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce85b2 expref: 12 pid: 36579 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130044.323969:0:36603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:36603:1876037626773248:0@lo:104: 00010000:00010000:1.0:1789130044.323989:0:36603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.323999:0:36603:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.324006:0:36603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130044.324012:0:36603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa5400/0x5c74554e47ce85ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.330634:0:36569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:36569:1876037626773120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130044.330650:0:36569:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789130044.330654:0:36569:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130044.330656:0:36569:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130044.330657:0:36569:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130044.330659:0:36569:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130044.330660:0:36569:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130044.330661:0:36569:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130044.330662:0:36569:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130044.330664:0:36569:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130044.330666:0:36569:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130044.330667:0:36569:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130044.330683:0:36569:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1789130044.382080:0:36569:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 21474836520 00000040:01000000:3.0:1789130044.382551:0:36569:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789130044.382849:0:36628:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789130044.382917:0:36628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789130044.391233:0:36569:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789130044.391361:0:36569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789130044.391806:0:36569:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789130044.391813:0:36569:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789130044.391935:0:36569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130044.394369:0:36628:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789130044.394462:0:36628:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789130044.394466:0:36628:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1789130044.397898:0:36569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789130044.398450:0:36569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789130044.398490:0:36569:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789130044.399005:0:36569:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 5, last_idx 6 00080000:10000000:1.0:1789130044.401337:0:36569:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00000001:00000004:1.0:1789130044.407272:0:36569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:3.0:1789130044.446390:0:36569:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789130044.446445:0:36569:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb11201c47988 00100000:10000000:3.0:1789130044.446454:0:36569:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789130044.448685:0:36569:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789130044.448702:0:36569:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789130044.448717:0:36569:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789130044.448737:0:36569:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:3.0:1789130044.934492:0:36584:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789130044.934515:0:36584:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b485290000 from 21 10000000:01000000:3.0:1789130044.934521:0:36584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789130044.934573:0:36584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.934586:0:36584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130044.934598:0:36584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3400/0x5c74554e47ce85f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130044.934656:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626773504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130044.934740:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130044.934800:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d556c0 going to sleep for 11 seconds 00000040:00080000:3.0:1789130045.326316:0:36624:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789130045.326327:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130045.326723:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:3.0:1789130045.326730:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1789130045.893857:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130047.941799:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130048.966107:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130049.996544:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130051.014638:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130053.070123:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:00000400:3.0:1789130054.368356:0:37023:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789130054.392514:0:37023:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000100:00100000:1.0:1789130054.396383:0:36571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626774016 00000100:00100000:1.0:1789130054.396396:0:36571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626774016 00000100:00100000:1.0:1789130054.396463:0:36571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130054.396489:0:36571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:37023:x1876037626774016:12345-0@lo:104: 00010000:00010000:1.0:1789130054.396507:0:36571:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130054.396640:0:36571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130054.396646:0:36571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:37023:x1876037626774016:12345-0@lo:104: Request processed in 161us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130054.396654:0:36571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789130054.396969:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130054.396977:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130054.396994:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130054.397000:0:36575:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130054.397015:0:36575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130054.397022:0:36575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130054.397028:0:36575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789130054.397065:0:36575:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130054.397072:0:36575:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130054.397101:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130054.397109:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce85c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce85c7 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130054.397130:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130054.397132:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130054.397133:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130054.397917:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626774144 00000100:00100000:3.0:1789130054.397924:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626774144 00010000:00010000:1.0:1789130054.398511:0:37023:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4afaa4800/0x5c74554e47ce8606 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130054.398519:0:37023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4afaa4800/0x5c74554e47ce8606 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130054.398526:0:37023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa4800/0x5c74554e47ce8606 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130054.406825:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626774272:0@lo:8:kworker.0 00000400:00000100:3.0:1789130054.406853:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626774272 offset 0 length 520: 4 00000100:00100000:3.0:1789130054.406878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626774400:0@lo:8:kworker.0 00000400:00000100:3.0:1789130054.406894:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626774400 offset 0 length 520: 4 00010000:00010000:1.0:1789130055.120511:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130055.888166:0:37067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00010000:00010000:3.0:1789130056.138661:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130056.663452:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789130057.159015:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130058.181717:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130059.529099:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130059.529106:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130059.529110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130059.529113:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130059.529146:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130059.529165:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626775168:0@lo:400:kworker.0 00000100:00100000:1.0:1789130059.529237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130059.529322:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626775168 00000100:00100000:1.0:1789130059.529330:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626775168 00000100:00100000:1.0:1789130059.529378:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130059.529387:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130059.529443:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626775168:12345-0@lo:400:kworker.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130059.529450:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789130059.529492:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4876bf480 x1876037626775168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130059.529506:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626775168:0@lo:400:kworker.0 00010000:00010000:3.0:1789130060.229792:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789130060.622386:0:37272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789130060.623976:0:37272:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789130060.626597:0:37272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789130060.626924:0:37272:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789130060.627137:0:37272:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x10:0x0] (8/32) 00100000:10000000:1.0:1789130060.627564:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789130060.627908:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789130060.628052:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789130060.628556:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 174: rc = 0 00100000:10000000:1.0:1789130060.628905:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 174: rc = 0 00100000:10000000:1.0:1789130060.629336:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 174: rc = 0 00100000:10000000:1.0:1789130060.630134:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 174: rc = 0 00100000:10000000:1.0:1789130060.630492:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 174: rc = 0 00100000:10000000:1.0:1789130060.630775:0:37272:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 174: rc = 0 00000020:00000080:1.0:1789130060.632093:0:37272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789130060.632107:0:37272:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789130060.632125:0:37272:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce8622 00000020:01000004:1.0:1789130060.632133:0:37272:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789130060.632155:0:37272:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789130060.632159:0:37272:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789130060.632165:0:37272:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789130060.632169:0:37272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789130060.632180:0:37272:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90b487cb4ed8) 00000020:00000080:1.0:1789130060.632194:0:37272:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789130060.633455:0:37272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130060.634280:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130060.634287:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789130060.636533:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789130060.636543:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789130060.641086:0:37272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130060.641257:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789130060.641262:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789130060.659575:0:37272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130060.659939:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130060.659946:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789130060.661429:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789130060.661443:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789130060.662798:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789130060.662811:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789130060.666698:0:37272:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130060.666948:0:37272:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789130060.666955:0:37272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789130060.766942:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130060.766955:0:37272:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789130060.767107:0:37272:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789130060.767115:0:37272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.767125:0:37272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130060.767150:0:37272:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b4b77e8800 10000000:01000000:3.0:1789130060.767155:0:37272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130060.767160:0:37272:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90b3830bced8 10000000:01000000:3.0:1789130060.767162:0:37272:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789130060.767166:0:37272:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90b3830bced8 from 1 10000000:01000000:3.0:1789130060.767169:0:37272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789130060.767197:0:37272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.767212:0:37272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.767222:0:37272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130060.767243:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130060.767275:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.767304:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130060.767953:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130060.767969:0:37272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.767977:0:37272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130060.767995:0:37272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789130060.768003:0:37272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.768010:0:37272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130060.768016:0:37272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789130060.768020:0:37272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130060.768026:0:37272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789130060.768028:0:37272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130060.768054:0:37272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.768061:0:37272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.768068:0:37272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130060.768080:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130060.768107:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.769053:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.774824:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626775680 00000100:00100000:1.0:1789130060.774841:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626775680 00000100:00100000:1.0:1789130060.774927:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789130060.774938:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+13:37272:x1876037626775680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130060.774956:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130060.774975:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdc800/0x5c74554e47ce8645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce863e expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.775002:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdc800/0x5c74554e47ce8645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce863e expref: 14 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.775012:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdc800/0x5c74554e47ce8645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce863e expref: 14 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.775022:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc800, rc 0) 00000100:00100000:1.0:1789130060.775116:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626775680:12345-0@lo:101:mount.lustre.0 Request processed in 179us (7007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.775123:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130060.775331:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130060.775352:0:37272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.775364:0:37272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130060.776101:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:3.0:1789130060.776902:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130060.777143:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1789130060.777186:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1789130060.777216:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1789130060.777270:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1789130060.777308:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1789130060.777342:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1789130060.777386:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1789130060.777423:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1789130060.777458:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:3.0:1789130060.777516:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:3.0:1789130060.777549:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:3.0:1789130060.777590:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:3.0:1789130060.777671:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:3.0:1789130060.777679:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:3.0:1789130060.777753:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130060.777822:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.777877:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.780189:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626775808 00000100:00100000:1.0:1789130060.780207:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626775808 00000100:00100000:1.0:1789130060.780264:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130060.780275:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626775808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130060.780779:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626775808:12345-0@lo:501:mount.lustre.0 Request processed in 506us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.780789:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130060.786390:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130060.786468:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130060.786561:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.787624:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.789103:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626775936 00000100:00100000:1.0:1789130060.789118:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626775936 00000100:00100000:1.0:1789130060.789177:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130060.789187:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626775936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130060.790011:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626775936:12345-0@lo:503:mount.lustre.0 Request processed in 821us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.790022:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130060.790116:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626775936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130060.798677:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130060.798790:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130060.799125:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.799171:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49040bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130060.800007:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130060.800252:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1789130060.800300:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:3.0:1789130060.800329:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:3.0:1789130060.800367:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:3.0:1789130060.800401:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:3.0:1789130060.800430:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:3.0:1789130060.800472:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:3.0:1789130060.800503:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:3.0:1789130060.800532:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:3.0:1789130060.800590:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:3.0:1789130060.800675:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:3.0:1789130060.800727:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:3.0:1789130060.800764:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130060.802135:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.802242:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.805461:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626776192 00000100:00100000:1.0:1789130060.805477:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626776192 00000100:00100000:1.0:1789130060.805578:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130060.805589:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626776192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130060.806039:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626776192:12345-0@lo:502:mount.lustre.0 Request processed in 449us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.806048:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130060.806152:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130060.806262:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:3.0:1789130060.806277:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789130060.808507:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130060.808520:0:37286:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789130060.808531:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130060.808533:0:37286:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789130060.808542:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130060.808558:0:37286:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90b4ba403490) 00000020:00000080:3.0:1789130060.808587:0:37286:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789130060.808593:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130060.808730:0:37286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4b77e8800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789130060.808738:0:37286:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789130060.808746:0:37286:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce8653 00010000:00010000:3.0:1789130060.813202:0:37286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789130060.814147:0:37286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803784 00080000:10000000:3.0:1789130060.816106:0:37286:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00000020:00000080:1.0:1789130060.820501:0:37286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789130060.820513:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130060.820519:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820521:0:37286:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789130060.820524:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789130060.820527:0:37286:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789130060.820529:0:37286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130060.820535:0:37286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130060.820536:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789130060.820539:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820540:0:37286:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789130060.820543:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130060.820545:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820547:0:37286:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130060.820549:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130060.820551:0:37286:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789130060.820553:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130060.820555:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820556:0:37286:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789130060.820558:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130060.820560:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820561:0:37286:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789130060.820564:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789130060.820600:0:37286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130060.820623:0:37286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130060.820625:0:37286:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789130060.820628:0:37286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:3.0:1789130060.824197:0:37272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789130060.824235:0:37272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789130060.824291:0:37272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.824304:0:37272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130060.824324:0:37272:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4b77e8800 from 1 10000000:01000000:3.0:1789130060.824327:0:37272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130060.824359:0:37272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.824367:0:37272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.824377:0:37272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130060.824399:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130060.824462:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.824497:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.825707:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626776320 00000100:00100000:1.0:1789130060.825719:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626776320 00000100:00100000:1.0:1789130060.825767:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789130060.825777:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:37272:x1876037626776320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130060.825792:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130060.825822:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce865a expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.825850:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce865a expref: 15 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.825861:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce865a expref: 15 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130060.825891:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:1.0:1789130060.825970:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+15:37272:x1876037626776320:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.825978:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130060.826574:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130060.826593:0:37272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.826640:0:37272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130060.827472:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 13 count 13 00000040:00080000:3.0:1789130060.830160:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130060.831238:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1789130060.831292:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:3.0:1789130060.831329:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:3.0:1789130060.831357:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:3.0:1789130060.831382:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:3.0:1789130060.831434:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:3.0:1789130060.831464:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:3.0:1789130060.831493:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 144 off9680 00000040:00080000:3.0:1789130060.831533:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9904 00000040:00080000:3.0:1789130060.831579:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10128 00000040:00080000:3.0:1789130060.832515:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 128 off10256 00000040:00080000:3.0:1789130060.832561:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 224 off10480 00000040:00080000:3.0:1789130060.832566:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 12 count 13 00000100:00100000:3.0:1789130060.833121:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130060.833180:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.833219:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.833228:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626776448 00000100:00100000:1.0:1789130060.833235:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626776448 00000100:00100000:1.0:1789130060.833322:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789130060.833332:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+15:37272:x1876037626776448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130060.833574:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+15:37272:x1876037626776448:12345-0@lo:501:mount.lustre.0 Request processed in 243us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.833582:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130060.833702:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130060.833734:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130060.833777:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.833800:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130060.834322:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130060.834805:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130060.834890:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130060.834935:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.836855:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130060.838707:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130060.839274:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:3.0:1789130060.839330:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:3.0:1789130060.839381:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:3.0:1789130060.839419:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:3.0:1789130060.839452:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:3.0:1789130060.839500:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:3.0:1789130060.839548:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:3.0:1789130060.839582:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 144 off9680 00000020:01000000:3.0:1789130060.845652:0:37272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789130060.845694:0:37272:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130060.847074:0:37272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.847091:0:37272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130060.847143:0:37272:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130060.847145:0:37272:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b4b77e8800 10000000:01000000:3.0:1789130060.847149:0:37272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b4b77e8800 10000000:01000000:3.0:1789130060.847153:0:37272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130060.847158:0:37272:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4b77e8800 from 1 10000000:01000000:3.0:1789130060.847161:0:37272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130060.847197:0:37272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.847206:0:37272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.847217:0:37272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130060.847242:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130060.847316:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130060.847361:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789130060.849176:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626776960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130060.849200:0:37272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130060.849218:0:37272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130060.851072:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:1.0:1789130060.851557:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130060.852004:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1789130060.852049:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:1.0:1789130060.852083:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:1.0:1789130060.852128:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:1.0:1789130060.852163:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:1.0:1789130060.852207:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:1.0:1789130060.852242:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:1.0:1789130060.852274:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:1.0:1789130060.852322:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:1.0:1789130060.852357:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:1.0:1789130060.852392:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:1.0:1789130060.852438:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:1.0:1789130060.852473:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:1.0:1789130060.852505:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:1.0:1789130060.852551:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:1.0:1789130060.852599:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:1.0:1789130060.852669:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:1.0:1789130060.852719:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:1.0:1789130060.852758:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:1.0:1789130060.852794:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:1.0:1789130060.855057:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:1.0:1789130060.855112:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:1.0:1789130060.855146:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:1.0:1789130060.855195:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:1.0:1789130060.855231:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:1.0:1789130060.855262:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:1.0:1789130060.855311:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:1.0:1789130060.855349:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:1.0:1789130060.855383:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:1.0:1789130060.855432:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:1.0:1789130060.855467:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:1.0:1789130060.855499:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:1.0:1789130060.855552:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:1.0:1789130060.855599:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:1.0:1789130060.855657:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:1.0:1789130060.855709:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:1.0:1789130060.855747:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:1.0:1789130060.855783:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:1.0:1789130060.858118:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:1.0:1789130060.858214:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:1.0:1789130060.858565:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:1.0:1789130060.858575:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:1.0:1789130060.860128:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130060.860200:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130060.860258:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626777088 00000100:00100000:1.0:1789130060.860266:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626777088 00000100:00100000:1.0:1789130060.860316:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130060.860332:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130060.860573:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777088:12345-0@lo:501:mount.lustre.0 Request processed in 242us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.860582:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130060.860641:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49040bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.860663:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130060.860696:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130060.860734:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130060.860756:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626777216 00000100:00100000:1.0:1789130060.860761:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626777216 00000100:00100000:1.0:1789130060.860781:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130060.860788:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130060.861236:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777216:12345-0@lo:503:mount.lustre.0 Request processed in 447us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.861243:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130060.861275:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49040bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.861288:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777216:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789130060.864355:0:37272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789130060.864455:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130060.864536:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130060.864589:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626777344 00000100:00100000:1.0:1789130060.864596:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626777344 00000100:00100000:1.0:1789130060.864654:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130060.864663:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130060.866336:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777344:12345-0@lo:502:mount.lustre.0 Request processed in 1668us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130060.866357:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130060.866425:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49040bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.866451:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130060.866730:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:1.0:1789130060.866779:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:1.0:1789130060.867677:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:1.0:1789130060.867777:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:1.0:1789130060.868885:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:1.0:1789130060.868974:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:1.0:1789130060.869012:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:1.0:1789130060.869042:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:1.0:1789130060.869096:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:1.0:1789130060.869132:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:1.0:1789130060.869163:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:1.0:1789130060.869207:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:1.0:1789130060.869242:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:1.0:1789130060.869274:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:1.0:1789130060.869319:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:1.0:1789130060.869354:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:1.0:1789130060.869387:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:1.0:1789130060.869433:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:1.0:1789130060.869466:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:1.0:1789130060.869498:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:1.0:1789130060.869560:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:1.0:1789130060.869595:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:1.0:1789130060.869652:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:1.0:1789130060.869698:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:1.0:1789130060.869729:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:1.0:1789130060.869759:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:1.0:1789130060.869807:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:1.0:1789130060.869853:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:1.0:1789130060.869900:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:1.0:1789130060.869947:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:1.0:1789130060.869981:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:1.0:1789130060.870010:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:1.0:1789130060.870042:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:1.0:1789130060.870089:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:1.0:1789130060.870125:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:1.0:1789130060.870173:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:1.0:1789130060.870226:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:1.0:1789130060.870263:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:1.0:1789130060.870307:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:1.0:1789130060.870344:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:1.0:1789130060.870398:0:37272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130060.870478:0:37272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130060.870531:0:37272:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49040bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130060.876216:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130060.876341:0:37272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:1.0:1789130060.876356:0:37272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789130060.883048:0:37295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789130060.883068:0:37295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90b4ba404ed8) 00000020:00000080:3.0:1789130060.883089:0:37295:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789130060.883184:0:37295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4b77e8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789130060.883189:0:37295:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4b77e8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789130060.883191:0:37295:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4b77e8800 3 00010000:00080000:3.0:1789130060.883221:0:37295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4a7a4a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1789130060.891529:0:37295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789130060.892089:0:37295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789130060.892129:0:37295:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789130060.892142:0:37295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5c74554e47ce867d 00000100:00080000:3.0:1789130060.892151:0:37295:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130060.892158:0:37295:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b4a7a4a000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130060.892202:0:37295:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd7840 x1876037626777600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130060.892234:0:37295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789130060.892274:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130060.892279:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130060.892282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130060.892285:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789130060.892785:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626777600 00000100:00100000:3.0:1789130060.892792:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626777600 00000100:00100000:3.0:1789130060.892976:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130060.892984:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626777600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789130060.893024:0:36589:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 1223 last 0 00000020:00000080:3.0:1789130060.893065:0:36589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5c74554e47ce8684 00000004:00100000:3.0:1789130060.893082:0:36589:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789130060.893119:0:36589:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130060.893175:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876037626777600:12345-0@lo:38:llog_process_th.0 Request processed in 190us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130060.893183:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130060.893301:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626777728:0@lo:400:kworker.0 00000100:00100000:1.0:1789130060.893333:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789130060.894394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4876bf480 x1876037626777728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130060.894414:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626777728:0@lo:400:kworker.0 00000100:00100000:1.0:1789130060.897287:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626777856 00000100:00100000:1.0:1789130060.897297:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626777856 00000100:00100000:1.0:1789130060.897437:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130060.897447:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37272:x1876037626777856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789130060.897480:0:36581:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789130060.897493:0:36581:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789130060.969025:0:37272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37272:1876037626777856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789130060.969043:0:37272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789130060.969047:0:37272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789130060.969048:0:37272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789130060.969049:0:37272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130060.969051:0:37272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130060.969052:0:37272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130060.969053:0:37272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130060.969055:0:37272:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130060.969056:0:37272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130060.969058:0:37272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789130060.969072:0:37272:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789130060.969507:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130060.969720:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789130060.969898:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130060.970048:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789130060.970214:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130060.970362:0:37272:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00002000:00080000:3.0:1789130061.013924:0:37272:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789130061.013933:0:37272:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789130061.013968:0:37272:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789130061.014027:0:37272:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789130061.014043:0:37272:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789130061.014103:0:37272:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1789130062.216356:0:36584:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789130062.216365:0:36584:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b485290000 from 22 10000000:01000000:1.0:1789130062.216372:0:36584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789130062.216423:0:36584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130062.216443:0:36584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130062.216455:0:36584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130062.216483:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626778240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130062.216561:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130062.216639:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130062.217979:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626778240 00000100:00100000:3.0:1789130062.217993:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626778240 00000100:00100000:3.0:1789130062.218055:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130062.218066:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+15:36584:x1876037626778240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130062.218089:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130062.218111:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce8692 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130062.218140:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce8692 expref: 16 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130062.218150:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce8692 expref: 16 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130062.218159:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789130062.218239:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:36584:x1876037626778240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130062.218247:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130062.218301:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626778240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130062.218328:0:36584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130062.218337:0:36584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130062.218392:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626778368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789130062.218420:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130062.218442:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96540 going to sleep for 11 seconds 00000100:00100000:3.0:1789130062.218924:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626778368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789130062.218980:0:36584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789130062.218987:0:36584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130062.218995:0:36584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130065.355672:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130066.182053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130066.182061:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130066.182064:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130066.182067:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130066.182131:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626778496:0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130066.182266:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626778624:0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130066.182316:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130066.182322:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626778752:0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130066.182629:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626778496 00000100:00100000:1.0:1789130066.182638:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626778496 00000100:00100000:1.0:1789130066.182693:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789130066.182703:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3307:x1876037626778496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182765:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3307:x1876037626778496:12345-0@lo:400:kworker.0 Request processed in 63us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130066.182793:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789130066.182826:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626778624 00000100:00100000:1.0:1789130066.182829:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626778624 00000100:00100000:1.0:1789130066.182850:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626778752 00000100:00100000:1.0:1789130066.182853:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626778752 00000100:00100000:1.0:1789130066.182876:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130066.182883:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626778624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182921:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626778624:12345-0@lo:400:kworker.0 Request processed in 39us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130066.182928:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130066.182939:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130066.182944:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626778752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.182970:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626778752:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130066.182976:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789130066.183011:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789130066.183044:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4876bcf00 x1876037626778752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130066.183058:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626778752:0@lo:400:kworker.0 00010000:00080000:1.0:1789130066.183069:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4876bc3c0 x1876037626778624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130066.183077:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626778624:0@lo:400:kworker.0 00000100:00100000:1.0:1789130066.183105:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626778496:0@lo:400:kworker.0 00010000:00010000:3.0:1789130066.373784:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130067.401514:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130068.422930:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130068.730337:0:37640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789130069.062148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130069.062154:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789130069.062159:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b3812fd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130069.062167:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 1217 00000100:00080000:3.0:1789130069.062173:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130069.062182:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b3812fd000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130069.062216:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626778880:0@lo:400:kworker.0 00000100:00100000:3.0:1789130069.062221:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd70c0 x1876037626779008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130069.062241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130069.062245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130069.062247:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130069.062252:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 1217 00000100:00080000:3.0:1789130069.062254:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130069.062259:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b492736000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130069.062271:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd52c0 x1876037626779136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130069.062329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130069.062358:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626779264:0@lo:400:kworker.0 00000100:00100000:3.0:1789130069.062434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130069.062436:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626778880 00000100:00100000:1.0:1789130069.062446:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626778880 00000100:00100000:1.0:1789130069.062513:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130069.062525:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3306:x1876037626778880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130069.062824:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3306:x1876037626778880:12345-0@lo:400:kworker.0 Request processed in 300us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130069.062833:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130069.062873:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626779264 00000100:00100000:1.0:1789130069.062879:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626779264 00000100:00100000:1.0:1789130069.062913:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130069.062921:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626779264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130069.062961:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626779264:12345-0@lo:400:kworker.0 Request processed in 42us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130069.062968:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130069.063011:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626778880:0@lo:400:kworker.0 00000100:00100000:3.0:1789130069.063771:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626779392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130069.063838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130069.064599:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626779392 00000100:00100000:3.0:1789130069.064609:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626779392 00000100:00100000:3.0:1789130069.064854:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130069.064866:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626779392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130069.065182:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626779392:12345-0@lo:400:kworker.0 Request processed in 317us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130069.065190:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789130069.065212:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789130069.065236:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd61c0 x1876037626779392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130069.065250:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626779392:0@lo:400:kworker.0 00010000:00080000:3.0:1789130069.065292:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd4000 x1876037626779264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130069.065301:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626779264:0@lo:400:kworker.0 00010000:00080000:1.0:1789130069.066110:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd70c0 x1876037626779008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130069.066126:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130069.066138:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1789130069.066151:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789130069.066160:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789130069.066165:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b3812fd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789130069.066213:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789130069.066221:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626779008:0@lo:8:kworker.0 00000004:00080000:3.0:1789130069.066716:0:36610:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0xa4:0x0] 00000100:00100000:3.0:1789130069.066756:0:36610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:36610:1876037626779648:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789130069.066821:0:36610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130069.066846:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130069.066863:0:36610:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130069.066916:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130069.066919:0:37273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789130069.066928:0:37273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789130069.066975:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626779520 00000100:00100000:3.0:1789130069.066982:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626779520 00000100:00100000:3.0:1789130069.067047:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789130069.067050:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130069.067060:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626779520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130069.067096:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130069.067153:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626779520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130069.067160:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789130069.067893:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd4000 x1876037626779520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130069.067926:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130069.069171:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626779648 00000100:00100000:3.0:1789130069.069185:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626779648 00000004:00080000:3.0:1789130069.069339:0:36609:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789130069.069349:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130069.069368:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:36610:x1876037626779648:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789130069.072062:0:36609:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232169456766ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789130069.084913:0:37658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789130069.084927:0:37658:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -29 00002000:02000040:1.0:1789130069.084935:0:37658:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:165 to 0x240000400:193) 00002000:00010000:1.0:1789130069.104528:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130069.104540:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104557:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1789130069.104562:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130069.104568:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104585:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104595:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104623:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104640:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130069.104653:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.104658:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104665:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.104670:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104679:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104695:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104702:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce86a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.104716:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.104730:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.104732:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130069.105195:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130069.105209:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc64d1/0x5c74554e47ce86ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.105217:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1789130069.105220:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130069.105224:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc64d1/0x5c74554e47ce86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.105233:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019cc64d1/0x5c74554e47ce86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.105240:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc64d1/0x5c74554e47ce86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.105247:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc64d1/0x5c74554e47ce86ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.105268:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130069.114909:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626779136:12345-0@lo:8:kworker.0 Request processed in 50376us (51585us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130069.114923:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789130069.114982:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130069.114987:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130069.114991:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626779136:0@lo:8:kworker.0 00010000:00010000:1.0:1789130069.128771:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.128825:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47ce86c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.128852:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.128857:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47ce86c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.128869:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47ce86c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.128889:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47ce86c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.128897:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47ce86c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.129000:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.129002:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.129004:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.135689:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.135697:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47ce86d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.135728:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.135732:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47ce86d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.135743:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47ce86d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.135774:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47ce86d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.135782:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47ce86d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.135800:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.135802:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.135804:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.157388:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.157414:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3ba213b/0x5c74554e47ce86e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.157426:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.157431:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3ba213b/0x5c74554e47ce86e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.157442:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3ba213b/0x5c74554e47ce86e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.157460:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3ba213b/0x5c74554e47ce86e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.157468:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3ba213b/0x5c74554e47ce86e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.157523:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.157525:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.157527:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.166445:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.166451:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce8702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.166459:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.166464:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce8702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.166473:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce8702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.166487:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce8702 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.166495:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce8702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.166523:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.166526:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.166528:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.167639:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.167646:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.167664:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.167668:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.167676:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.167689:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8710 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.167696:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8710 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.167732:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.167735:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.167737:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130069.179261:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130069.179275:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce871e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.179292:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1789130069.179296:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130069.179508:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce871e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.179525:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce871e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.179543:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce871e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.179552:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3793fef/0x5c74554e47ce871e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.179586:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130069.182532:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130069.182546:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.182562:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1789130069.182567:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130069.182574:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.182588:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.182598:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.182773:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.182818:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130069.183395:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130069.183406:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130069.183416:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130069.183421:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130069.184232:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130069.184269:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130069.184278:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041b7caa6/0x5c74554e47ce8725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130069.184372:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130069.184374:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130069.184376:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130069.186294:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130069.187083:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bb6633/0x5c74554e47ce872c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.187101:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1789130069.187106:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130069.187113:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bb6633/0x5c74554e47ce872c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.187128:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bb6633/0x5c74554e47ce872c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.187140:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bb6633/0x5c74554e47ce872c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.187149:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bb6633/0x5c74554e47ce872c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.187175:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130069.199615:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130069.199641:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce873a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199655:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.199672:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce873a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199686:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce873a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199713:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce873a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199736:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce873a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199760:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.199765:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a611ad2/0x5c74554e47ce8741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199772:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.199775:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a611ad2/0x5c74554e47ce8741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199784:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a611ad2/0x5c74554e47ce8741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199799:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a611ad2/0x5c74554e47ce8741 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.199811:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.199823:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.199828:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.203142:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130069.203153:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce8748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203163:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.203169:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce8748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203180:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce8748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203206:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce8748 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203216:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce8748 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203243:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.203247:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcbe8360/0x5c74554e47ce874f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203253:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.203257:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbe8360/0x5c74554e47ce874f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203279:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbe8360/0x5c74554e47ce874f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203290:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcbe8360/0x5c74554e47ce874f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.203300:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.203303:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.203305:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.209373:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130069.209384:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209397:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.209403:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209417:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209448:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8756 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209455:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8756 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209506:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.209510:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce875d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209515:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.209517:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce875d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209523:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce875d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209529:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce875d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209534:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce875d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.209541:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.209542:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.209543:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.211090:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.211098:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.211106:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.211118:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.211125:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.211140:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8764 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.211146:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce8764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.211164:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.211166:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.211167:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.212278:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130069.212284:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce876b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.212291:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130069.212294:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce876b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.212301:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce876b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.212312:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce876b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.212324:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce876b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130069.212338:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.212340:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130069.212342:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130069.213146:0:36610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:36610:1876037626779648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789130069.213169:0:36610:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xc1:0x0] from OST, last_created [0x240000400:0xc1:0x0]last_used is [0x240000400:0xa4:0x0] 00000100:00100000:3.0:1789130069.213225:0:36610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:36610:1876037626779776:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789130069.213288:0:36610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130069.213358:0:36610:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130069.213909:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626779776 00000100:00100000:1.0:1789130069.213918:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626779776 00000100:00100000:1.0:1789130069.213977:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130069.213989:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:36610:x1876037626779776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789130069.214038:0:37273:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 194 00000100:00100000:3.0:1789130069.232522:0:36610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:36610:1876037626779776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789130069.232544:0:36610:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xc1:0x0]-[0x240000400:0xe1:0x0] 00000100:00100000:1.0:1789130069.232587:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:36610:x1876037626779776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18443us (19141us total) trans 30064771073 rc 0/0 00000100:00100000:1.0:1789130069.232598:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789130070.484212:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130072.519531:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130074.374997:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626780160:0@lo:8:kworker.0 00000100:00100000:1.0:1789130074.375029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130074.375059:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789130074.375096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130074.375114:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130074.375119:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626780288:0@lo:400:kworker.0 00000100:00100000:1.0:1789130074.375137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130074.375162:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780416 00000100:00100000:1.0:1789130074.375166:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780416 00000100:00100000:1.0:1789130074.375199:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780288 00000100:00100000:1.0:1789130074.375203:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780288 00000100:00100000:1.0:1789130074.375223:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130074.375229:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130074.375265:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626780416:12345-0@lo:400:kworker.0 Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130074.375272:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130074.375283:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130074.375290:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626780288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130074.375316:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626780288:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130074.375322:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789130074.375619:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b48904b840 x1876037626780288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130074.375640:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626780288:0@lo:400:kworker.0 00010000:00080000:1.0:1789130074.375652:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4890483c0 x1876037626780416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130074.375660:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626780416:0@lo:400:kworker.0 00000100:00100000:3.0:1789130074.376224:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626780544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130074.376266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130074.376315:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780160 00000100:00100000:3.0:1789130074.376319:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780160 00000100:00100000:3.0:1789130074.376356:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130074.376361:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626780160:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789130074.376380:0:37276:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789130074.376433:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626780160:12345-0@lo:8:kworker.0 Request processed in 70us (1402us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789130074.376439:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130074.376464:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780544 00000100:00100000:3.0:1789130074.376468:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780544 00000100:00100000:3.0:1789130074.376494:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130074.376501:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626780544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130074.376527:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130074.376561:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626780544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130074.376567:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789130074.376651:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130074.376656:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789130074.376660:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626780160:0@lo:8:kworker.0 00000100:00100000:3.0:1789130074.376682:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:3.0:1789130074.376695:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626780544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130074.577048:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130076.614047:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789130078.257690:0:37992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:3.0:1789130078.259103:0:37992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 566: rc = 0 00100000:10000000:1.0:1789130078.270336:0:37992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:1.0:1789130078.270641:0:37992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 566: rc = 0 00100000:10000000:1.0:1789130078.271164:0:37992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 566: rc = 0 00000020:00000080:1.0:1789130078.272424:0:37992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789130078.272437:0:37992:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789130078.272448:0:37992:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce8779 00000020:01000004:1.0:1789130078.272464:0:37992:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789130078.272486:0:37992:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789130078.272490:0:37992:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789130078.272497:0:37992:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789130078.272651:0:37992:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789130078.272657:0:37992:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:1.0:1789130078.320169:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780672 00000100:00100000:1.0:1789130078.320178:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780672 00000100:00100000:1.0:1789130078.320334:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789130078.320345:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37992:x1876037626780672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789130078.320384:0:36581:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789130078.320387:0:36581:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789130078.320391:0:36581:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789130078.329026:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:37992:x1876037626780672:12345-0@lo:253:mount.lustre.0 Request processed in 8673us (9062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.329042:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789130078.333058:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626780800 00000100:00100000:1.0:1789130078.333073:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626780800 00000100:00100000:3.0:1789130078.334152:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626780800:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130078.334199:0:37992:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789130078.334381:0:37992:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789130078.334391:0:37992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.334403:0:37992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130078.334431:0:37992:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b4856bb000 10000000:01000000:3.0:1789130078.334436:0:37992:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130078.334441:0:37992:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789130078.334445:0:37992:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130078.334449:0:37992:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789130078.334452:0:37992:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789130078.334484:0:37992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.334492:0:37992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.334501:0:37992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130078.334533:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626780928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130078.334583:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.334649:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.335454:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626780928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130078.335468:0:37992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.335483:0:37992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130078.340289:0:37992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000040:00080000:3.0:1789130078.342938:0:37992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130078.343216:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1789130078.343263:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1789130078.343297:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1789130078.343342:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1789130078.343378:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1789130078.343412:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1789130078.343478:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1789130078.343516:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1789130078.346153:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 120 off9752 00000040:00080000:3.0:1789130078.346294:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9976 00000040:00080000:3.0:1789130078.346303:0:37992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 11 00000100:00100000:3.0:1789130078.346549:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130078.346647:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.346686:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.347388:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130078.347547:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130078.347597:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.347668:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130078.347682:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626781184 00000100:00100000:1.0:1789130078.347687:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626781184 00000100:00100000:1.0:1789130078.347739:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130078.347748:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:37992:x1876037626781184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130078.350796:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130078.356387:0:37992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130078.356846:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.356969:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.357021:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.358219:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130078.358646:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1789130078.358704:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:3.0:1789130078.358742:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:3.0:1789130078.358812:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:3.0:1789130078.358853:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:3.0:1789130078.358888:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:3.0:1789130078.359109:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:3.0:1789130078.359152:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:3.0:1789130078.359207:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 120 off9752 00000100:00100000:3.0:1789130078.359245:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.359294:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.359320:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130078.360586:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626781440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130078.360737:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9976 00000040:00080000:1.0:1789130078.360750:0:37992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789130078.363906:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130078.363917:0:37993:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789130078.363925:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130078.363944:0:37993:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789130078.363952:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130078.363984:0:37993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90b383108000) 00000020:00000080:3.0:1789130078.364011:0:37993:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789130078.364019:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130078.364084:0:37993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4856bb000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789130078.364093:0:37993:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789130078.364100:0:37993:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce8795 00080000:10000000:1.0:1789130078.382356:0:37993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x11:0x0] (8/8/4) registered 00000020:00000080:1.0:1789130078.388829:0:37993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789130078.388842:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.388847:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.388850:0:37993:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789130078.388853:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.388857:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.388866:0:37993:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130078.388869:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130078.388871:0:37993:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789130078.388880:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.388882:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.388883:0:37993:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789130078.388886:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.388888:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.388889:0:37993:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789130078.388892:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789130078.388928:0:37993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.389642:0:37993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.389645:0:37993:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789130078.389650:0:37993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000100:00100000:3.0:1789130078.409133:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626781696 00000100:00100000:3.0:1789130078.409149:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626781696 00000100:00100000:3.0:1789130078.409210:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130078.409221:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130078.409760:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781696:12345-0@lo:501:mount.lustre.0 Request processed in 539us (8548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.409770:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130078.410990:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626781824 00000100:00100000:3.0:1789130078.410998:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626781824 00000100:00100000:3.0:1789130078.411037:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130078.411046:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130078.411256:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781824:12345-0@lo:503:mount.lustre.0 Request processed in 210us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.411264:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130078.413139:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626781952 00000100:00100000:3.0:1789130078.413147:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626781952 00000100:00100000:3.0:1789130078.413194:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130078.413203:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.415048:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626781952:12345-0@lo:502:mount.lustre.0 Request processed in 1845us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.415059:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130078.417911:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626782080 00000100:00100000:3.0:1789130078.417924:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626782080 00000100:00100000:3.0:1789130078.417983:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130078.417993:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626782080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.418242:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:37992:x1876037626782080:12345-0@lo:502:mount.lustre.0 Request processed in 250us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.418252:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130078.420884:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484c51d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.420929:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130078.421107:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 224 off10480 00000040:00080000:3.0:1789130078.421123:0:37992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789130078.426070:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.426083:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426085:0:37997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789130078.426093:0:37997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4856bb000 00000020:00000080:1.0:1789130078.426095:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130078.426102:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.426105:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426106:0:37997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789130078.426109:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.426111:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426112:0:37997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789130078.426116:0:37997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4856bb000 00000020:00000080:1.0:1789130078.426118:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130078.426178:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.426183:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426184:0:37997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789130078.426187:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.426189:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426190:0:37997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130078.426193:0:37997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4856bb000 00000020:00000080:1.0:1789130078.426209:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130078.426231:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.426234:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426236:0:37997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130078.426238:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130078.426241:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426242:0:37997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130078.426246:0:37997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4856bb000 00000020:00000080:1.0:1789130078.426248:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130078.426284:0:37997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130078.426287:0:37997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130078.426288:0:37997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789130078.426291:0:37997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 13 count 13 00000040:00080000:3.0:1789130078.486274:0:37992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130078.486376:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.486627:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.486675:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130078.493116:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:37992:x1876037626782592:12345-0@lo:502:mount.lustre.0 Request processed in 5784us (6510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130078.493133:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000040:00080000:1.0:1789130078.501340:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:1.0:1789130078.501730:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:1.0:1789130078.501794:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:1.0:1789130078.501835:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:1.0:1789130078.501884:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:1.0:1789130078.501949:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:1.0:1789130078.501990:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:1.0:1789130078.502037:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:1.0:1789130078.502089:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:1.0:1789130078.502127:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:1.0:1789130078.502166:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:1.0:1789130078.502238:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:1.0:1789130078.502279:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:1.0:1789130078.502329:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:1.0:1789130078.502383:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:1.0:1789130078.503134:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:1.0:1789130078.503186:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:1.0:1789130078.503241:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:1.0:1789130078.503281:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:1.0:1789130078.503316:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:1.0:1789130078.503365:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:1.0:1789130078.503540:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:1.0:1789130078.503590:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:1.0:1789130078.503674:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:1.0:1789130078.503713:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:1.0:1789130078.503752:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:1.0:1789130078.503816:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:1.0:1789130078.503871:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:1.0:1789130078.503909:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:1.0:1789130078.504183:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:1.0:1789130078.504241:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:1.0:1789130078.504281:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:1.0:1789130078.504326:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:1.0:1789130078.504359:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:1.0:1789130078.504580:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:1.0:1789130078.504708:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:1.0:1789130078.504748:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:1.0:1789130078.504801:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130078.504891:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130078.505064:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.513974:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626782720 00000100:00100000:3.0:1789130078.513990:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626782720 00000100:00100000:3.0:1789130078.514054:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130078.514065:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:37992:x1876037626782720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130078.514366:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:37992:x1876037626782720:12345-0@lo:502:mount.lustre.0 Request processed in 302us (9474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.514374:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789130078.515132:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130078.515261:0:37992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:1.0:1789130078.515279:0:37992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789130078.517734:0:38003:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789130078.517751:0:38003:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90b487cb3490) 00000020:00000080:1.0:1789130078.517776:0:38003:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789130078.517868:0:38003:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4856bb000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789130078.517873:0:38003:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4856bb000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789130078.517885:0:38003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4856bb000 3 00010000:00080000:1.0:1789130078.517926:0:38003:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4ba7f4800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789130078.520741:0:38003:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789130078.532878:0:38003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789130078.532943:0:38003:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789130078.532956:0:38003:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5c74554e47ce87bf 00000100:00080000:1.0:1789130078.532966:0:38003:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130078.532973:0:38003:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4ba7f4800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130078.533011:0:38003:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4876bcb40 x1876037626782848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130078.533041:0:38003:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789130078.533629:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626782848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789130078.533708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130078.534645:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626782848 00000100:00100000:1.0:1789130078.534656:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626782848 00000100:00100000:1.0:1789130078.534699:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130078.534707:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626782848:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789130078.534736:0:36588:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 1241 last 0 00000020:00000080:1.0:1789130078.534778:0:36588:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5c74554e47ce87c6 00000004:00100000:1.0:1789130078.534797:0:36588:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789130078.534829:0:36588:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130078.534897:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876037626782848:12345-0@lo:38:llog_process_th.0 Request processed in 189us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130078.534906:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789130078.534966:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4876bcb40 x1876037626782848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130078.534977:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130078.534992:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:1.0:1789130078.534999:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789130078.535005:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789130078.535008:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789130078.535014:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626782848:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789130078.535176:0:38003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:1.0:1789130078.537726:0:37992:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789130078.537768:0:37992:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789130078.537785:0:37992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130078.537797:0:37992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789130078.537857:0:37992:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789130078.537860:0:37992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789130078.537861:0:37992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130078.537863:0:37992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130078.537864:0:37992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130078.537866:0:37992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130078.537867:0:37992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130078.537869:0:37992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130078.537870:0:37992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789130078.537874:0:37992:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789130078.537876:0:37992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789130078.537878:0:37992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789130078.537879:0:37992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130078.537880:0:37992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130078.537882:0:37992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130078.537883:0:37992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130078.537884:0:37992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130078.537885:0:37992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130078.537886:0:37992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789130078.537914:0:37992:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789130078.538087:0:37992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782976:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789130078.538156:0:37992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130078.538231:0:37992:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d07480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130078.542861:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626783104:0@lo:400:kworker.0 00000100:00100000:1.0:1789130078.542895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130078.544924:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130078.547081:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626782976 00000100:00100000:3.0:1789130078.547095:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626782976 20000000:01000000:3.0:1789130078.594094:0:36579:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130078.594110:0:36579:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789130078.594133:0:36603:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789130078.594137:0:36603:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789130078.594161:0:36603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce87cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594180:0:36603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce8692 expref: 19 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594189:0:36603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce87cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594250:0:36603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce8692 expref: 19 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594264:0:36603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce8699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce8692 expref: 19 pid: 36579 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130078.594279:0:36603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:36603:1876037626783616:0@lo:104: 00000100:00100000:3.0:1789130078.594346:0:36603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130078.594386:0:36603:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130078.594730:0:36571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626783616 00000100:00100000:3.0:1789130078.594739:0:36571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626783616 00000100:00100000:3.0:1789130078.594784:0:36571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130078.594793:0:36571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:36603:x1876037626783616:12345-0@lo:104: 00010000:00010000:3.0:1789130078.594808:0:36571:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594864:0:36571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130078.594871:0:36571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:36603:x1876037626783616:12345-0@lo:104: Request processed in 79us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130078.594878:0:36571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789130078.594898:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130078.594905:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.594912:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdcc00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130078.594917:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.595044:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130078.595051:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130078.595057:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130078.595245:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.595253:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130078.595280:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.595288:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdcc00/0x5c74554e47ce8692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8699 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130078.595307:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130078.595309:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130078.595311:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130078.595335:0:36603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:36603:1876037626783616:0@lo:104: 00010000:00010000:3.0:1789130078.595353:0:36603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce87cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130078.603831:0:37992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7d5f341-5d27-45e7-8794-684d66c1a62a:37992:1876037626782976:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789130078.603848:0:37992:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789130078.603851:0:37992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789130078.603853:0:37992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789130078.603854:0:37992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130078.603856:0:37992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130078.603857:0:37992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130078.603858:0:37992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130078.603860:0:37992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130078.603862:0:37992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130078.603863:0:37992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789130078.603877:0:37992:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789130078.604366:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130078.605135:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789130078.605313:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130078.605739:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789130078.605970:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789130078.606126:0:37992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00002000:00080000:3.0:1789130078.717691:0:37992:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789130078.717701:0:37992:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789130078.717743:0:37992:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789130078.717810:0:37992:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789130078.717823:0:37992:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789130078.718084:0:37992:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1789130079.495300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130079.495327:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626783872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130079.495405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130079.495485:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626783872 00000100:00100000:3.0:1789130079.495495:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626783872 00000100:00100000:3.0:1789130079.495560:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130079.495571:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626783872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130079.495634:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130079.495688:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626783872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130079.495696:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130079.495748:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626783872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130079.685825:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130080.220630:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784000 00000100:00100000:1.0:1789130080.220655:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784000 00000100:00100000:1.0:1789130080.220757:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789130080.220770:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626784000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130080.220795:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130080.222469:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdc000/0x5c74554e47ce87db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce87d4 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130080.222549:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdc000/0x5c74554e47ce87db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce87d4 expref: 19 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130080.222565:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdc000/0x5c74554e47ce87db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce87d4 expref: 19 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130080.222578:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc000, rc 0) 00000100:00100000:1.0:1789130080.224021:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626784000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3242us (25920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130080.224036:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789130080.224148:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626784000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130080.224179:0:36584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130080.224194:0:36584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130080.224289:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626784128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789130080.225077:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130080.225135:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130080.225167:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784128 00000100:00100000:1.0:1789130080.225177:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784128 00000100:00100000:1.0:1789130080.225230:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789130080.225242:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626784128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789130080.225275:0:36579:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789130080.225312:0:36579:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789130080.225321:0:36579:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:1.0:1789130080.225426:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626784128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130080.225434:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789130080.225484:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626784128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789130080.225570:0:36584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130080.225582:0:36584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130080.225593:0:36584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130081.733860:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130082.758051:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130083.589971:0:31907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130083.589982:0:31907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130083.589987:0:31907:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130083.590002:0:31907:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b492736000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130083.590032:0:31907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd52c0 x1876037626784512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130083.590124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626784640:0@lo:400:kworker.0 00000100:00100000:3.0:1789130083.590236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130083.590319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130083.590325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626784768:0@lo:400:kworker.0 00000100:00100000:3.0:1789130083.590348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130083.590743:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784512 00000100:00100000:3.0:1789130083.590774:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784512 00000100:00100000:3.0:1789130083.590876:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130083.590889:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626784512:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789130083.590933:0:37275:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1246 last 0 00000020:00000080:3.0:1789130083.590980:0:37275:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce87e2 00002000:00100000:3.0:1789130083.590999:0:37275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90b4921dd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789130083.591005:0:37275:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789130083.591013:0:37275:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789130083.591361:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784256 00000100:00100000:1.0:1789130083.591368:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784256 00000100:00100000:1.0:1789130083.591414:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130083.591422:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626784256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.591497:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626784256:12345-0@lo:400:kworker.0 Request processed in 75us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.591506:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130083.591581:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784640 00000100:00100000:1.0:1789130083.591585:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784640 00000100:00100000:1.0:1789130083.591623:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784768 00000100:00100000:1.0:1789130083.591626:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784768 00000100:00100000:1.0:1789130083.591649:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784896 00000100:00100000:1.0:1789130083.591653:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784896 00000100:00100000:1.0:1789130083.591668:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130083.591675:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626784640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.591728:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626784640:12345-0@lo:400:kworker.0 Request processed in 53us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.591736:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130083.591748:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130083.591755:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626784768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.591781:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626784768:12345-0@lo:400:kworker.0 Request processed in 28us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.591788:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130083.591798:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789130083.591804:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626784896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.591830:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626784896:12345-0@lo:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.591837:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789130083.591862:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789130083.591902:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd70c0 x1876037626784768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130083.591921:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626784768:0@lo:400:kworker.0 00010000:00080000:1.0:1789130083.591934:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd4000 x1876037626784640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130083.591943:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626784640:0@lo:400:kworker.0 00002000:00080000:3.0:1789130083.595946:0:37275:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789130083.596015:0:37275:0:(import.c:65:import_set_state_nolock()) ffff90b4921de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130083.596167:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626784512:12345-0@lo:8:kworker.0 Request processed in 5275us (5679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130083.596181:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789130083.596351:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd52c0 x1876037626784512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130083.596373:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1789130083.596385:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789130083.596412:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789130083.596415:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789130083.596442:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789130083.596450:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626784512:0@lo:8:kworker.0 00000004:00080000:1.0:1789130083.596570:0:36612:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0xa3:0x0] 00000100:00100000:1.0:1789130083.596596:0:36612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:36612:1876037626785152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789130083.596663:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626785024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130083.596693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789130083.596774:0:36611:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789130083.602036:0:36611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1246699428405ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789130083.603535:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626785024 00000100:00100000:1.0:1789130083.603552:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626785024 00000100:00100000:1.0:1789130083.603661:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130083.603675:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626785024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130083.604564:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1789130083.605838:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130083.606005:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626785024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2329us (9306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.606020:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789130083.606103:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4876bcb40 x1876037626785024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130083.606133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626785024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130083.606754:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626784256:0@lo:400:kworker.0 00010000:00080000:1.0:1789130083.606772:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd4780 x1876037626784896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130083.606803:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626784896:0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.606969:0:36612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130083.612356:0:36612:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130083.612448:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626784384 00000100:00100000:1.0:1789130083.612466:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626784384 00000100:00100000:1.0:1789130083.612531:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626785152 00000100:00100000:1.0:1789130083.612535:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626785152 00000100:00100000:1.0:1789130083.612558:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130083.612568:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626784384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130083.612687:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626784384:12345-0@lo:400:kworker.0 Request processed in 119us (21636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130083.612847:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130083.612869:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130083.612876:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:36612:x1876037626785152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789130083.626181:0:37658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789130083.626197:0:37658:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -30 00002000:02000040:1.0:1789130083.626206:0:37658:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:164 to 0x280000400:193) 00002000:00010000:1.0:1789130083.644538:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130083.644558:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bb6633/0x5c74554e47ce87e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.644582:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:1.0:1789130083.644589:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130083.644598:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056bb6633/0x5c74554e47ce87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.644876:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056bb6633/0x5c74554e47ce87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.644891:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bb6633/0x5c74554e47ce87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.644900:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056bb6633/0x5c74554e47ce87e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.645079:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130083.645738:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130083.645746:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.645758:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:1.0:1789130083.645762:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130083.645766:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.645778:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.645786:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.645806:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.659180:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789130083.659197:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a25b6be8/0x5c74554e47ce87f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130083.660276:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130083.660288:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce87f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.660306:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:1.0:1789130083.660311:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130083.660318:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.660335:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.660346:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.660353:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008de3a25/0x5c74554e47ce87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.660384:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130083.718439:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.721690:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.721699:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce8836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.721709:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.721714:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce8836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.721722:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce8836 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.721742:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce8836 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.721764:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce8836 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.721789:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.721791:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.721793:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130083.727010:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.727024:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.727027:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.727032:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.727043:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.727051:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.727058:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.727068:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1789130083.727842:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789130083.727851:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce883d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727861:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.727866:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce883d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727893:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce883d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727914:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce883d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727922:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce883d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727946:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789130083.727950:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47ce8844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.727967:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.728043:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47ce8844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728051:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47ce8844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728063:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47ce8844 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728070:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47ce8844 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728241:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789130083.728246:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47ce884b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728254:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.728257:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47ce884b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728266:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47ce884b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728277:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47ce884b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728290:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47ce884b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728305:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789130083.728308:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728315:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.728318:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728325:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8852 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728336:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8852 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728343:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8852 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728354:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130083.728358:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728364:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.728373:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728380:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728390:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728397:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728410:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.728413:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728419:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.728422:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728430:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728439:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728446:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd30fa7e/0x5c74554e47ce8860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.728479:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.728481:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.728483:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.730972:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.730984:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.731000:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.731005:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.731012:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.731026:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.731050:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130083.731468:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789130083.732561:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.732668:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130083.732705:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.732718:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.732734:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.732742:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.732757:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.732789:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.732798:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e31b246d/0x5c74554e47ce8867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.732837:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.732842:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.732846:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.733584:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.733595:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.737405:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.737419:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.737430:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.737453:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.737477:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.737485:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.737572:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789130083.738948:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.738960:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.738976:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.738980:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.738986:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.738999:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.739009:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.739017:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.739043:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130083.739554:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130083.739571:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739586:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.739592:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739625:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739651:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739660:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e90eef8/0x5c74554e47ce886e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739704:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130083.739708:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739715:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.739719:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739748:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739759:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739765:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc4c0f7/0x5c74554e47ce8875 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.739781:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.739782:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.739784:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.739942:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.745752:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.745768:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.745786:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.745797:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.745807:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.745825:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.745837:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.745846:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.746546:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130083.747335:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130083.747346:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.747366:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:3.0:1789130083.747372:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130083.747379:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.747395:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.747419:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.747430:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.747464:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789130083.747991:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130083.747999:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.748008:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:3.0:1789130083.748012:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130083.748017:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.748041:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.748050:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.748057:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.748066:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789130083.748578:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789130083.748590:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748621:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.748628:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748642:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748668:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748703:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc5879e/0x5c74554e47ce887c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748731:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130083.748735:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748743:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.748747:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748756:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748767:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748776:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074453966/0x5c74554e47ce8883 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748789:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130083.748793:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748801:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.748811:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748820:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748831:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748838:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce888a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.748852:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.748853:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.748855:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130083.749218:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.752480:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.752495:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.752513:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.752517:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.752523:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.752537:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.752547:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.752563:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.752592:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130083.752805:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130083.752820:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.752835:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.752841:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.752854:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.752881:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.752908:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae935bc2/0x5c74554e47ce8891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.752944:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.752947:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.752953:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.753163:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.753171:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753180:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.753183:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.753188:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753197:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753204:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753210:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753232:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130083.753258:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.753267:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.753275:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.753279:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.753289:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.753305:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.753313:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005616297d/0x5c74554e47ce8898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.753362:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.753365:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.753370:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.753731:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.753739:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753757:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.753760:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.753765:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753776:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753785:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753792:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.753809:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130083.753844:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130083.753853:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.753863:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.753867:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.753878:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.753894:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.753903:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001816a929/0x5c74554e47ce889f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.753931:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.753933:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.753938:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.754256:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.754264:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754272:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.754276:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.754279:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754289:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754310:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754317:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754336:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130083.754391:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.754399:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.754418:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.754422:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.754431:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.754446:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.754454:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce88a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.754487:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.754491:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.754493:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.754804:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.754811:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754820:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.754824:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.754828:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754837:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754846:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754853:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.754882:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130083.754914:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130083.754923:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.754933:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130083.754939:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.754949:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.754966:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.754975:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b179c3d6/0x5c74554e47ce88ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130083.754999:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.755002:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130083.755004:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130083.755311:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130083.755319:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.755328:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=1246s v=(0 0) 00010000:00010000:2.0:1789130083.755331:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130083.755336:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.755347:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.755355:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.755363:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130083.755385:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130083.755482:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130083.755489:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.755513:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130083.755516:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.755525:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.755536:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.755544:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033396b54/0x5c74554e47ce88b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130083.755561:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.755562:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130083.755564:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789130083.761860:0:37658:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:163 00000100:00100000:2.0:1789130083.762042:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:36612:x1876037626785152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 149163us (155068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130083.762055:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130083.769258:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626785280 00000100:00100000:2.0:1789130083.769294:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626785280 00000100:00100000:2.0:1789130083.769371:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130083.769382:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:36612:x1876037626785280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789130083.769435:0:37276:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 194 00000100:00100000:3.0:1789130083.786652:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:36612:x1876037626785280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17255us (22008us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1789130083.786673:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789130083.788141:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130084.633069:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626785408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130084.633160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130084.633262:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626785408 00000100:00100000:2.0:1789130084.633272:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626785408 00000100:00100000:2.0:1789130084.633321:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130084.633343:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626785408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130084.633387:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130084.633450:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626785408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130084.633459:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130084.633513:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626785408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130084.805716:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130085.835886:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130086.855418:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130088.103211:0:38350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789130088.721680:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626786048 00000100:00100000:3.0:1789130088.721690:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626786048 00000100:00100000:3.0:1789130088.721737:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626785920 00000100:00100000:3.0:1789130088.721739:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626785920 00000100:00100000:3.0:1789130088.721750:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626786176 00000100:00100000:3.0:1789130088.721752:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626786176 00000100:00100000:3.0:1789130088.721778:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130088.721785:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130088.721860:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626786048:12345-0@lo:400:kworker.0 Request processed in 76us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130088.721868:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130088.721880:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130088.721886:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130088.721908:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626785920:12345-0@lo:400:kworker.0 Request processed in 23us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130088.721913:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130088.721922:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130088.721928:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626786176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130088.721952:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626786176:12345-0@lo:400:kworker.0 Request processed in 25us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130088.721958:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789130088.734229:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130088.734299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130088.735144:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626786304 00000100:00100000:2.0:1789130088.735153:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626786304 00000100:00100000:2.0:1789130088.735200:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130088.735208:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626786304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130088.735242:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130088.735295:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626786304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130088.735303:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130088.735961:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626786304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789130088.904123:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130089.736046:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130089.736078:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626786432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130089.736171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130089.736331:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626786432 00000100:00100000:2.0:1789130089.736342:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626786432 00000100:00100000:2.0:1789130089.736427:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130089.736441:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626786432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130089.736491:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130089.736550:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626786432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130089.736557:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130089.736638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626786432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130089.925934:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130090.912311:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604811648 00000100:00100000:1.0:1789130090.912337:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604811648 00000100:00100000:1.0:1789130090.912411:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130090.912423:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2366:x1876037604811648:12345-192.168.201.39@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789130090.912463:0:36581:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from cde14bcb-cae6-4486-a3dc-1826046b76c4@192.168.201.39@tcp t0 exp 0000000000000000 cur 1254 last 0 00000020:00000080:1.0:1789130090.912508:0:36581:0:(genops.c:1385:class_connect()) connect: client cde14bcb-cae6-4486-a3dc-1826046b76c4, cookie 0x5c74554e47ce88bb 00000100:00080000:1.0:1789130090.912744:0:36581:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130090.912845:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+5:2366:x1876037604811648:12345-192.168.201.39@tcp:250:mount.lustre.0 Request processed in 422us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130090.912856:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130090.926464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130090.926587:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604811776 00000100:00100000:2.0:1789130090.926638:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604811776 00000100:00100000:2.0:1789130090.926729:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789130090.926742:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+5:31321:x1876037604811776:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789130090.926766:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130090.926791:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce88c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab88f expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130090.926834:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce88c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab88f expref: 6 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130090.926848:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce88c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab88f expref: 6 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130090.926859:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5800, rc 0) 00000100:00100000:2.0:1789130090.926950:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+6:31321:x1876037604811776:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 210us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130090.927112:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789130090.936976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130090.949075:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812032 00000100:00100000:1.0:1789130090.949095:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812032 00000100:00100000:1.0:1789130090.949169:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130090.949179:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+6:31321:x1876037604812032:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130090.949198:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130090.949222:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdcc00/0x5c74554e47ce88c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab896 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130090.949254:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdcc00/0x5c74554e47ce88c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab896 expref: 7 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130090.949393:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdcc00/0x5c74554e47ce88c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab896 expref: 7 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130090.949405:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdcc00, rc 0) 00000100:00100000:1.0:1789130090.949539:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+7:31321:x1876037604812032:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 361us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130090.949564:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00010000:00010000:1.0:1789130090.951994:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130090.966927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130090.967025:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812160 00000100:00100000:2.0:1789130090.967036:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812160 00000100:00100000:2.0:1789130090.967096:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130090.967107:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+7:31321:x1876037604812160:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789130090.967465:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31321:x1876037604812160:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 358us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130090.967476:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130090.971518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130090.971668:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812288 00000100:00100000:1.0:1789130090.971678:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812288 00000100:00100000:1.0:1789130090.971746:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:1.0:1789130090.971756:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31321:x1876037604812288:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789130090.972190:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31321:x1876037604812288:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 434us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130090.972200:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130090.991061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130091.022927:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812544 00000100:00100000:2.0:1789130091.022939:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812544 00000100:00100000:2.0:1789130091.023014:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130091.023025:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31340:x1876037604812544:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130091.023361:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31340:x1876037604812544:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 337us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130091.023370:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130091.039091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130091.039304:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812672 00000100:00100000:1.0:1789130091.039314:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812672 00000100:00100000:1.0:1789130091.039383:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130091.039393:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:31321:x1876037604812672:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130091.039411:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130091.039441:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdd200/0x5c74554e47ce88d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab8c0 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.039477:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdd200/0x5c74554e47ce88d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c0 expref: 9 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.039491:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdd200/0x5c74554e47ce88d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c0 expref: 9 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.039502:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd200, rc 0) 00000100:00100000:1.0:1789130091.039580:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+9:31321:x1876037604812672:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 188us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.039638:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130091.045126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.045217:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812800 00000100:00100000:3.0:1789130091.045227:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812800 00000100:00100000:3.0:1789130091.045290:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130091.045301:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+9:31321:x1876037604812800:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789130091.045325:0:36580:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789130091.045358:0:36580:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789130091.045363:0:36580:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789130091.045367:0:36580:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789130091.045369:0:36580:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:3.0:1789130091.048084:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+9:31321:x1876037604812800:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 2774us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130091.048111:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789130091.062014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130091.062161:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604812928 00000100:00100000:1.0:1789130091.062171:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604812928 00000100:00100000:1.0:1789130091.062226:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130091.062236:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+9:31321:x1876037604812928:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130091.062252:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130091.062284:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab8c7 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.062313:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 10 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.062324:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 10 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130091.062341:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd800, rc 0) 00000100:00100000:1.0:1789130091.062389:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31321:x1876037604812928:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.062395:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130091.072691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.072774:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813056 00000100:00100000:3.0:1789130091.072793:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813056 00000100:00100000:3.0:1789130091.072853:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789130091.072865:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31321:x1876037604813056:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130091.073157:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31321:x1876037604813056:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 293us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130091.073165:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789130091.076895:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813184 00000100:00100000:2.0:1789130091.076905:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813184 00000100:00100000:2.0:1789130091.076965:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130091.076975:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31321:x1876037604813184:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130091.077298:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31321:x1876037604813184:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 323us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130091.077306:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130091.082340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130091.091935:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813312 00000100:00100000:1.0:1789130091.091962:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813312 00000100:00100000:1.0:1789130091.092028:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130091.092039:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31343:x1876037604813312:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130091.092646:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31343:x1876037604813312:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 606us (11218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.092663:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130091.100464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.100631:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813440 00000100:00100000:3.0:1789130091.100640:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813440 00000100:00100000:3.0:1789130091.100701:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130091.100711:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31343:x1876037604813440:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130091.101003:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31343:x1876037604813440:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 291us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130091.101012:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130091.106746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.106959:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813568 00000100:00100000:3.0:1789130091.106970:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813568 00000100:00100000:3.0:1789130091.107021:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130091.107040:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2366:x1876037604813568:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789130091.107071:0:36589:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp t0 exp 0000000000000000 cur 1254 last 0 00000020:00000080:3.0:1789130091.107121:0:36589:0:(genops.c:1385:class_connect()) connect: client 587d445f-41ce-47d3-97fe-edc16e866648, cookie 0x5c74554e47ce88de 00000004:00100000:3.0:1789130091.107149:0:36589:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1789130091.107156:0:36589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00100000:2.0:1789130091.205585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130091.206038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:2.0:1789130091.217071:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130091.220887:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130091.220928:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:0:x1876037604813696:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130091.221019:0:36588:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130091.221172:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:0:x1876037604813696:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 267us (15604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.221181:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130091.221217:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130091.221227:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604813824:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130091.221240:0:36588:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130091.223462:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604813824:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 2041us (17229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.223477:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130091.228745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130091.228868:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604813952 00000100:00100000:1.0:1789130091.228881:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604813952 00000100:00100000:1.0:1789130091.228953:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1789130091.228968:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604813952:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789130091.229181:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604813952:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 214us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.229199:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130091.242489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.242656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130091.242699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130091.244706:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814080 00000100:00100000:1.0:1789130091.244728:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814080 00000100:00100000:1.0:1789130091.244793:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814208 00000100:00100000:1.0:1789130091.244811:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814208 00000100:00100000:1.0:1789130091.244843:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789130091.244853:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604814080:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789130091.244895:0:37273:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp t0 exp 0000000000000000 cur 1254 last 0 00000020:00000080:1.0:1789130091.244957:0:37273:0:(genops.c:1385:class_connect()) connect: client 587d445f-41ce-47d3-97fe-edc16e866648, cookie 0x5c74554e47ce88e5 00002000:00100000:1.0:1789130091.244975:0:37273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 587d445f-41ce-47d3-97fe-edc16e866648/ffff90b4ba7f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130091.245010:0:37273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789130091.245756:0:37273:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789130091.245808:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130091.245915:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2366:x1876037604814080:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 1061us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.245926:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789130091.245964:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1789130091.245971:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604814208:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789130091.245998:0:37273:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp t0 exp 0000000000000000 cur 1254 last 0 00000020:00000080:1.0:1789130091.246047:0:37273:0:(genops.c:1385:class_connect()) connect: client 587d445f-41ce-47d3-97fe-edc16e866648, cookie 0x5c74554e47ce88ec 00002000:00100000:1.0:1789130091.246058:0:37273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 587d445f-41ce-47d3-97fe-edc16e866648/ffff90b4ba7f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130091.246080:0:37273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789130091.248544:0:37273:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130091.248643:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130091.248733:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2366:x1876037604814208:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 2759us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130091.248746:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130091.255217:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814336 00000100:00100000:2.0:1789130091.255246:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814336 00000100:00100000:2.0:1789130091.255356:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130091.255368:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604814336:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789130091.333680:0:36590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1789130091.333930:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:31321:x1876037604814336:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 78555us (91446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130091.333949:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789130091.754861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000001:00100000:1.0:1789130091.884007:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00010000:00010000:1.0:1789130091.991206:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130092.999267:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130093.829916:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626786688:0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.829988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130093.830061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626787200:0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.830085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130093.830111:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130093.830116:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.830145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130093.830968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626786944:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.831000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130093.831044:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789130093.831050:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626786560:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.831080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130093.831103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626787072:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.831125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130093.831354:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130093.831360:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130093.831363:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130093.831382:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626786560 00000100:00100000:1.0:1789130093.831387:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626786560 00000100:00100000:1.0:1789130093.831427:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130093.831434:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626786560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.831472:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626786560:12345-0@lo:400:kworker.0 Request processed in 39us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130093.831479:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130093.831524:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.831537:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626786688:0@lo:400:kworker.0 00000100:00100000:1.0:1789130093.831548:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626787200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.832541:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626786560:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.832555:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626787072:0@lo:400:kworker.0 00000100:00100000:3.0:1789130093.832564:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626786944:0@lo:400:kworker.0 00000100:00100000:2.0:1789130093.833415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626787328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130093.833468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130093.833937:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626787328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789130094.022518:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130094.383591:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814592 00000100:00100000:3.0:1789130094.383631:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814592 00000100:00100000:3.0:1789130094.383699:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130094.383709:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:31417:x1876037604814592:12345-192.168.201.39@tcp:41:lfs.0 00000004:00000024:3.0:1789130094.383751:0:36589:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789130094.383853:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:31417:x1876037604814592:12345-192.168.201.39@tcp:41:lfs.0 Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.383879:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789130094.389707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:2.0:1789130094.394526:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130094.411481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130094.411826:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814848 00000100:00100000:1.0:1789130094.411839:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814848 00000100:00100000:1.0:1789130094.411902:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789130094.411924:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:587d445f-41ce-47d3-97fe-edc16e866648+6:31417:x1876037604814848:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:1.0:1789130094.411951:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130094.412030:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:587d445f-41ce-47d3-97fe-edc16e866648+6:31417:x1876037604814848:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 108us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.412038:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:3.0:1789130094.412161:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130094.754271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130094.754511:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604814976 00000100:00100000:1.0:1789130094.754527:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604814976 00000100:00100000:1.0:1789130094.754657:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130094.754671:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:31449:x1876037604814976:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130094.754699:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130094.754724:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdce00/0x5c74554e47ce8901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab8f8 expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130094.754766:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdce00/0x5c74554e47ce8901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8f8 expref: 11 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130094.754779:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdce00/0x5c74554e47ce8901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8f8 expref: 11 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130094.754791:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdce00, rc 0) 00000100:00100000:1.0:1789130094.754872:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604814976:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 204us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.754880:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130094.786804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130094.786928:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604815104 00000100:00100000:3.0:1789130094.786943:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604815104 00000100:00100000:3.0:1789130094.787024:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130094.787037:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604815104:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130094.787517:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604815104:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 480us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.787528:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130094.807528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.811409:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604815232 00000100:00100000:2.0:1789130094.811436:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604815232 00000100:00100000:2.0:1789130094.811549:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130094.811566:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604815232:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130094.812004:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604815232:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 440us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130094.812015:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130094.815053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130094.815203:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604815360 00000100:00100000:1.0:1789130094.815216:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604815360 00000100:00100000:1.0:1789130094.815300:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:1.0:1789130094.815312:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31456:x1876037604815360:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130094.815748:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31456:x1876037604815360:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 436us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.815758:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789130094.858477:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626787456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130094.858591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130094.858816:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604815488 00000100:00100000:3.0:1789130094.858828:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604815488 00000100:00100000:3.0:1789130094.858905:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789130094.858916:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31456:x1876037604815488:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130094.859302:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31456:x1876037604815488:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 385us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.859311:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:1.0:1789130094.861561:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626787456 00000100:00100000:1.0:1789130094.861586:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626787456 00000100:00100000:1.0:1789130094.861732:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130094.861748:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626787456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130094.861798:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130094.861943:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626787456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.861952:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130094.862130:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626787456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130094.864253:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604815616 00000100:00100000:3.0:1789130094.864277:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604815616 00000100:00100000:3.0:1789130094.864351:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789130094.864363:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31449:x1876037604815616:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789130094.864404:0:36580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130094.864430:0:36580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce8908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab922 expref: -99 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130094.864462:0:36580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce8908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab922 expref: 12 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130094.864474:0:36580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce8908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab922 expref: 12 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130094.864484:0:36580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789130094.864550:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31449:x1876037604815616:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 190us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.864557:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789130094.868417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130094.873193:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31449:x1876037604815744:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 4384us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.873223:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789130094.877852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.882951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130094.883373:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604816000 00000100:00100000:1.0:1789130094.883387:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604816000 00000100:00100000:1.0:1789130094.883460:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789130094.883472:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31449:x1876037604816000:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789130094.884287:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31449:x1876037604816000:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 729us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.884301:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130094.887313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130094.892552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130094.896814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.913763:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604816384 00000100:00100000:2.0:1789130094.919875:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604816384 00000100:00100000:2.0:1789130094.920007:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789130094.920021:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31459:x1876037604816384:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130094.920700:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31459:x1876037604816384:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 678us (23910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130094.920711:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130094.945574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.953702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.953754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.953811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130094.954019:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817024 00000100:00100000:3.0:1789130094.954034:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817024 00000100:00100000:3.0:1789130094.954116:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604816896 00000100:00100000:3.0:1789130094.954120:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604816896 00000100:00100000:3.0:1789130094.954144:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130094.954156:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604817024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130094.954282:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604817024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 128us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.954292:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130094.954326:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789130094.954335:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604816896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130094.954367:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604816896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.954373:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789130094.962761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.965168:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130094.966739:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604816640 00000100:00100000:3.0:1789130094.966763:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604816640 00000100:00100000:1.0:1789130094.967435:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817152 00000100:00100000:1.0:1789130094.967444:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817152 00000100:00100000:1.0:1789130094.967480:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789130094.967494:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2368:x1876037604816640:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130094.967628:0:36589:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130094.967750:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2368:x1876037604816640:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 258us (5013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.967759:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789130094.967782:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130094.967808:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31449:x1876037604817152:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130094.967845:0:36589:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130094.967874:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31449:x1876037604817152:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 84us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130094.967882:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130094.970785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:2.0:1789130094.971106:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130094.971178:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817280 00000100:00100000:3.0:1789130094.971193:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817280 00000100:00100000:3.0:1789130094.971345:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789130094.971359:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31449:x1876037604817280:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789130094.971494:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31449:x1876037604817280:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 137us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130094.971503:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130094.979508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.979554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.979643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130094.979681:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817408 00000100:00100000:2.0:1789130094.979696:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817408 00000100:00100000:2.0:1789130094.979743:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817536 00000100:00100000:2.0:1789130094.979746:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817536 00000100:00100000:2.0:1789130094.979769:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130094.979779:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604817408:12345-192.168.201.39@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789130094.980433:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817664 00000100:00100000:3.0:1789130094.980442:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817664 00000100:00100000:3.0:1789130094.980500:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789130094.980509:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:31449:x1876037604817664:12345-192.168.201.39@tcp:33:mount.lustre.0 00010000:00080000:2.0:1789130094.981234:0:37273:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp t0 exp 0000000000000000 cur 1258 last 0 00000020:00000080:2.0:1789130094.981293:0:37273:0:(genops.c:1385:class_connect()) connect: client ec5d7172-884c-4596-96b1-f5256d22e019, cookie 0x5c74554e47ce891d 00002000:00100000:2.0:1789130094.981311:0:37273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec5d7172-884c-4596-96b1-f5256d22e019/ffff90b4c18e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789130094.981328:0:37273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789130094.981524:0:37273:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789130094.981571:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4c18e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130094.981676:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2366:x1876037604817408:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 1897us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130094.981689:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130094.981730:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130094.981737:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604817536:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789130094.981758:0:37273:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp t0 exp 0000000000000000 cur 1258 last 0 00000020:00000080:2.0:1789130094.981778:0:37273:0:(genops.c:1385:class_connect()) connect: client ec5d7172-884c-4596-96b1-f5256d22e019, cookie 0x5c74554e47ce8924 00002000:00100000:2.0:1789130094.981784:0:37273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec5d7172-884c-4596-96b1-f5256d22e019/ffff90b4c18e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000004:00200000:3.0:1789130094.982732:0:36591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00100000:2.0:1789130094.983286:0:37273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789130094.983468:0:37273:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789130094.983525:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4c18e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130094.983660:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2366:x1876037604817536:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 1917us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130094.983675:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00010000:00010000:1.0:1789130095.046561:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130095.161462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130095.161584:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817792 00000100:00100000:3.0:1789130095.161646:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817792 00000100:00100000:3.0:1789130095.161731:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789130095.161743:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31481:x1876037604817792:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:3.0:1789130095.161773:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130095.161827:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce892b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab953 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162245:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162273:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162287:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130095.162563:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789130095.162568:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130095.162714:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162755:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce892b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 8 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162779:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130095.162802:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130095.162805:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130095.162811:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789130095.163227:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:31481:x1876037604817792:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 1483us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130095.163237:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000040:00080000:3.0:1789130096.582284:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789130096.975043:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec5d7172-884c-4596-96b1-f5256d22e019 00010000:00010000:1.0:1789130097.094164:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130098.556953:0:38559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789130098.949914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626787584:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.949989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130098.950067:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130098.950096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130098.950120:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130098.950126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626787840:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.950148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130098.950177:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626787584 00000100:00100000:3.0:1789130098.950184:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626787584 00000100:00100000:3.0:1789130098.950253:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130098.950264:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626787584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.950317:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626787584:12345-0@lo:400:kworker.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130098.950325:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130098.950359:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626787712 00000100:00100000:3.0:1789130098.950363:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626787712 00000100:00100000:3.0:1789130098.950398:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130098.950405:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626787712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130098.950435:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130098.950486:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626787712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130098.950493:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130098.950513:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626787840 00000100:00100000:3.0:1789130098.950517:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626787840 00000100:00100000:3.0:1789130098.950547:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130098.950554:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626787840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.950587:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626787840:12345-0@lo:400:kworker.0 Request processed in 34us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130098.950623:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789130098.950641:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130098.950645:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130098.950676:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626787584:0@lo:400:kworker.0 00000100:00100000:2.0:1789130098.960166:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130098.961931:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626788096:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.962017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130098.962055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626787968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.962074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130098.962217:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626788096 00000100:00100000:1.0:1789130098.962225:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626788096 00000100:00100000:1.0:1789130098.962296:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626787968 00000100:00100000:1.0:1789130098.962299:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626787968 00000100:00100000:1.0:1789130098.962319:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130098.962330:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626788096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130098.962400:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626788096:12345-0@lo:400:kworker.0 Request processed in 72us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130098.962408:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130098.962425:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130098.962431:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626787968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130098.962476:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626787968:12345-0@lo:400:kworker.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130098.962484:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789130098.962549:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130098.962581:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626788096:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.962590:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626787968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.963408:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626788224:0@lo:400:kworker.0 00000100:00100000:3.0:1789130098.963452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130098.963516:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626788224 00000100:00100000:1.0:1789130098.963521:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626788224 00000100:00100000:1.0:1789130098.963571:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130098.963579:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626788224:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789130098.963666:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130098.968438:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626788224:12345-0@lo:400:kworker.0 Request processed in 4848us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130098.968456:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130098.974087:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626788224:0@lo:400:kworker.0 00000100:00100000:1.0:1789130099.973949:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130099.973992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626788352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130099.974100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130099.974221:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626788352 00000100:00100000:1.0:1789130099.974231:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626788352 00000100:00100000:1.0:1789130099.974307:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130099.974319:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626788352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130099.974382:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130099.974442:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626788352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130099.974451:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130099.974512:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626788352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130100.167119:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130100.250648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.250914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130100.251142:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604817920 00000100:00100000:1.0:1789130100.251151:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604817920 00000100:00100000:1.0:1789130100.251218:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1789130100.251228:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604817920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130100.251293:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604817920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 58us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130100.251342:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1789130100.251400:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130100.251424:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604818176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130100.251472:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604818176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 60us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130100.251481:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130100.251516:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604818048 00000100:00100000:1.0:1789130100.251522:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604818048 00000100:00100000:1.0:1789130100.251563:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604818432 00000100:00100000:1.0:1789130100.251569:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604818432 00000100:00100000:1.0:1789130100.251594:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130100.251653:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604818048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130100.251698:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604818048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 96us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130100.251823:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130100.251838:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789130100.251845:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604818432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130100.251881:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604818432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130100.251888:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00010000:00010000:1.0:1789130102.214915:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789130102.872762:0:38709:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc57aeca0 20000000:00000080:2.0:1789130102.872792:0:38709:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b49fdf9000 uarg=0000000000000000 20000000:01000000:2.0:1789130102.872848:0:38709:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789130102.872856:0:38709:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789130102.872862:0:38709:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789130102.876028:0:38710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789130102.876287:0:38709:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789130102.876302:0:38709:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789130102.876335:0:38709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876361:0:38709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce860d expref: 18 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876370:0:38709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce865a expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876401:0:38709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce879c expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876412:0:38709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876420:0:38709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 12 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876428:0:38709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876483:0:38709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 12 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876503:0:38709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 12 pid: 36580 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.876540:0:38709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3827492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788480:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130102.876780:0:38709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876791:0:38709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 12 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.876800:0:38709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382748780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788608:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130102.876837:0:38709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876858:0:38709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 18 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.876868:0:38709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788736:0@lo:104: 00000100:00100000:3.0:1789130102.876929:0:38709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130102.876981:0:38709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.876989:0:38709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 18 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.876998:0:38709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788864:0@lo:104: 00000100:00100000:3.0:1789130102.877021:0:38709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130102.877056:0:38709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 18 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130102.877064:0:38709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 18 pid: 36581 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.877073:0:38709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788992:0@lo:104: 00000100:00100000:3.0:1789130102.877098:0:38709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130102.877110:0:38709:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130102.877560:0:36571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130102.877575:0:36571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+4:38709:x1876037626788864:12345-0@lo:104: 00010000:00010000:0.0:1789130102.877584:0:36571:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877645:0:36571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130102.877649:0:36571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+4:38709:x1876037626788864:12345-0@lo:104: Request processed in 76us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130102.877655:0:36571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130102.877670:0:36571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130102.877676:0:36571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be716850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:38709:x1876037626788992:12345-0@lo:104: 00010000:00010000:0.0:1789130102.877684:0:36571:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877713:0:36571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789130102.877717:0:36571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be716850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7d5f341-5d27-45e7-8794-684d66c1a62a+3:38709:x1876037626788992:12345-0@lo:104: Request processed in 42us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130102.877723:0:36571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789130102.877772:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130102.877780:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877787:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789130102.877792:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877801:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130102.877809:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130102.877822:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130102.877862:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877868:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130102.877894:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877902:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4200/0x5c74554e47ce879c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce87a3 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877916:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130102.877919:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877925:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789130102.877928:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877934:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130102.877941:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130102.877947:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130102.877960:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877967:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130102.877979:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877986:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3600/0x5c74554e47ce865a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8661 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.877995:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130102.877998:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878004:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789130102.878006:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878013:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130102.878019:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130102.878024:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130102.878037:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878043:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130102.878060:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878067:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce860d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce8614 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878091:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130102.878093:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130102.878094:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130102.878110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626789248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130102.878158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130102.878187:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130102.878193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626789120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130102.878215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130102.878240:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130102.878249:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626789376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130102.878277:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130102.878306:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789248 00000100:00100000:0.0:1789130102.878311:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789248 00010000:00010000:0.0:1789130102.878334:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 19 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130102.878351:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789120 00000100:00100000:0.0:1789130102.878354:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789120 00010000:00010000:0.0:1789130102.878366:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 20 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130102.878376:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789376 00000100:00100000:0.0:1789130102.878378:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789376 00010000:00010000:0.0:1789130102.878390:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 21 pid: 36581 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130102.878402:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130102.878408:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+21:3307:x1876037626789248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130102.878425:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130102.878431:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 21 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878441:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 21 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878460:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130102.878491:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+21:3307:x1876037626789248:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130102.878499:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130102.878514:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130102.878520:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+20:3307:x1876037626789120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130102.878527:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130102.878531:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 20 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878538:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 20 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878549:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130102.878570:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+20:3307:x1876037626789120:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130102.878576:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130102.878587:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130102.878593:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49fd04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626789376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130102.878623:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130102.878629:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 19 pid: 36581 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878644:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 19 pid: 36581 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130102.878654:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130102.878683:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49fd04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626789376:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130102.878689:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130102.878757:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626789376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130102.878784:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626789120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130102.878792:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626789248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130102.878842:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130102.879259:0:38709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa4000/0x5c74554e47ce87a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce879c expref: 18 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.879273:0:38709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788736:0@lo:104: 00010000:00010000:3.0:1789130102.879283:0:38709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbddc00/0x5c74554e47ce8661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce865a expref: 17 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.879306:0:38709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788864:0@lo:104: 00010000:00010000:3.0:1789130102.879319:0:38709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa4400/0x5c74554e47ce8614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce860d expref: 16 pid: 36581 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130102.879327:0:38709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788992:0@lo:104: 00000100:00100000:1.0:1789130102.887136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130102.887251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130102.887460:0:38709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3827492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788480:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130102.887475:0:38709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382748780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38709:1876037626788608:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130102.887546:0:38709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130102.889894:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604818816 00000100:00100000:2.0:1789130102.889917:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604818816 00010000:00010000:2.0:1789130102.889995:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 13 pid: 36580 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130102.890043:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604818944 00000100:00100000:2.0:1789130102.890047:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604818944 00010000:00010000:2.0:1789130102.890060:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 14 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130102.890077:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789130102.890088:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+14:2370:x1876037604818816:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130102.890105:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130102.890112:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 14 pid: 36580 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130102.890137:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 14 pid: 36580 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130102.890160:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eb400/0x5c74554e47ce890f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab929 expref: 14 pid: 36580 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130102.890179:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130102.890380:0:36574:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789130102.890392:0:36574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789130102.890564:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130102.890575:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604818944:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130102.890585:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130102.890591:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 13 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890626:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 13 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890638:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdd800/0x5c74554e47ce88d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c7 expref: 13 pid: 36579 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890652:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890661:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890679:0:36574:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890701:0:36574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890708:0:36574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890717:0:36574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890724:0:36574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130102.890728:0:36574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.890737:0:36574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130102.890852:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:2370:x1876037604818816:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 764us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130102.890862:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00010000:00010000:1.0:1789130102.891302:0:36574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130102.891318:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130102.891362:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:2369:x1876037604818944:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 789us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130102.891370:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:2.0:1789130102.902014:0:38709:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130102.902039:0:38709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130102.902076:0:38709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf3e00/0x5c74554e47ce8939 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130103.237922:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130104.071083:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626789504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.071157:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626789632:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.071203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.071241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.071286:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626790144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.071292:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626790016:0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.071324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130104.071359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.071361:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130104.071372:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626789760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.071391:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130104.071403:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626789888:0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.071412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130104.071453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.071478:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789632 00000100:00100000:0.0:1789130104.071488:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789632 00000100:00100000:2.0:1789130104.071529:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790144 00000100:00100000:2.0:1789130104.071538:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790144 00000100:00100000:0.0:1789130104.071571:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789760 00000100:00100000:0.0:1789130104.071577:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789760 00000100:00100000:2.0:1789130104.071629:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790016 00000100:00100000:2.0:1789130104.071635:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790016 00000100:00100000:0.0:1789130104.071650:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789130104.071664:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789888 00000100:00100000:0.0:1789130104.071665:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626789632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.071669:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789888 00000100:00100000:2.0:1789130104.071692:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130104.071704:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626790144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130104.071893:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626789504 00000100:00100000:3.0:1789130104.071901:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626789504 00000100:00100000:3.0:1789130104.071940:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130104.071949:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3309:x1876037626789504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130104.072011:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3309:x1876037626789504:12345-0@lo:400:kworker.0 Request processed in 63us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130104.072019:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130104.072062:0:36588:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789130104.072072:0:36588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789130104.072092:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130104.072113:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626789760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.072256:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626789632:12345-0@lo:400:kworker.0 Request processed in 595us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.072265:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789130104.072290:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130104.072296:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130104.072299:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130104.073877:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626790144:12345-0@lo:400:kworker.0 Request processed in 2167us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.073892:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130104.073928:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130104.073942:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626790016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.074006:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626790016:12345-0@lo:400:kworker.0 Request processed in 71us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.074013:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130104.074040:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130104.074046:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626789888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.074078:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626789888:12345-0@lo:400:kworker.0 Request processed in 33us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.074084:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130104.074167:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626789888:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.074180:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626790016:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.074192:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626789504:0@lo:400:kworker.0 00000100:00100000:2.0:1789130104.074274:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626790272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130104.074391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130104.077659:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790272 00000100:00100000:2.0:1789130104.077675:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790272 00000100:00100000:2.0:1789130104.077728:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130104.077738:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626790272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130104.077783:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130104.077864:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626790272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.077872:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130104.077924:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626790272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130104.079552:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626789760:12345-0@lo:400:kworker.0 Request processed in 7425us (8127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130104.079572:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130104.096987:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626789760:0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.097020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626789632:0@lo:400:kworker.0 00000100:00100000:0.0:1789130104.097036:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626790144:0@lo:400:kworker.0 00010000:00010000:0.0:1789130104.263663:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130104.348972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130104.349153:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819072 00000100:00100000:0.0:1789130104.349169:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819072 00000100:00100000:0.0:1789130104.349249:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789130104.349262:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:31336:x1876037604819072:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130104.349287:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130104.349315:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce8940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab95a expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.349352:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce8940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab95a expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.349365:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce8940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab95a expref: 12 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.349376:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb600, rc 0) 00000100:00100000:0.0:1789130104.349460:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819072:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 200us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.349480:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130104.361566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.361733:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819200 00000100:00100000:2.0:1789130104.361746:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819200 00000100:00100000:2.0:1789130104.361822:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789130104.361835:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819200:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.362251:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819200:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 418us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.362268:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789130104.372761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130104.372870:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819328 00000100:00100000:3.0:1789130104.372883:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819328 00000100:00100000:3.0:1789130104.372958:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130104.372971:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819328:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130104.373317:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819328:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 346us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130104.373327:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 10000000:01000000:0.0:1789130104.391479:0:36584:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130104.391492:0:36584:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4856bb000 from 13 10000000:01000000:0.0:1789130104.391501:0:36584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130104.391578:0:36584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.391595:0:36584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.391648:0:36584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130104.391686:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.391794:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.391873:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130104.393394:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790400 00000100:00100000:1.0:1789130104.393413:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790400 00000100:00100000:1.0:1789130104.393506:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789130104.393520:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:36584:x1876037626790400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130104.393542:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130104.393587:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdc400/0x5c74554e47ce894e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce8947 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.393663:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdc400/0x5c74554e47ce894e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce8947 expref: 17 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.393678:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdc400/0x5c74554e47ce894e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce8947 expref: 17 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.393689:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc400, rc 0) 00000100:00100000:1.0:1789130104.393796:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.393804:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130104.393946:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130104.393968:0:36584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.393979:0:36584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130104.394077:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.394128:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.394174:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130104.394294:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790528 00000100:00100000:2.0:1789130104.394301:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790528 00000100:00100000:2.0:1789130104.394341:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789130104.394350:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.394714:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.394723:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130104.402406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.403483:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819456 00000100:00100000:1.0:1789130104.403499:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819456 00000100:00100000:1.0:1789130104.403596:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789130104.403646:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:31336:x1876037604819456:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130104.403671:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130104.403696:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bfbdca00/0x5c74554e47ce8955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ab961 expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.403736:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bfbdca00/0x5c74554e47ce8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab961 expref: 13 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.403750:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bfbdca00/0x5c74554e47ce8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab961 expref: 13 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.403762:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdca00, rc 0) 00000100:00100000:1.0:1789130104.403845:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31336:x1876037604819456:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 203us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.403872:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789130104.406300:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.406428:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.406531:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130104.406597:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130104.406713:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790656 00000100:00100000:1.0:1789130104.406722:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790656 00000100:00100000:1.0:1789130104.406776:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789130104.406788:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.407065:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.407074:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789130104.407194:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130104.408180:0:38724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789130104.408402:0:36584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789130104.408426:0:36584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130104.408443:0:36584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.408456:0:36584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130104.408469:0:36584:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130104.408473:0:36584:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4b77e8800 from 13 10000000:01000000:1.0:1789130104.408476:0:36584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130104.408523:0:36584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.408532:0:36584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.408544:0:36584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.408569:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.408691:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130104.408737:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130104.412628:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790784 00000100:00100000:0.0:1789130104.412654:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790784 00000100:00100000:0.0:1789130104.412746:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789130104.412760:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:36584:x1876037626790784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130104.412785:0:36579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130104.412813:0:36579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926eae00/0x5c74554e47ce8963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce895c expref: -99 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.412851:0:36579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926eae00/0x5c74554e47ce8963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce895c expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.412865:0:36579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926eae00/0x5c74554e47ce8963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce895c expref: 18 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.412877:0:36579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eae00, rc 0) 00000100:00100000:0.0:1789130104.412999:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626790784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.413008:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130104.413170:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130104.413194:0:36584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.413206:0:36584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130104.413315:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.413360:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130104.413408:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489fbb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130104.413747:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626790912 00000100:00100000:0.0:1789130104.413753:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626790912 00000100:00100000:0.0:1789130104.413787:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789130104.413796:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626790912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.414308:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626790912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.414317:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789130104.418289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130104.418452:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819584 00000100:00100000:0.0:1789130104.418468:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819584 00000100:00100000:0.0:1789130104.418539:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:0.0:1789130104.418551:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31336:x1876037604819584:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130104.418985:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31336:x1876037604819584:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 435us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.418995:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130104.421664:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626790912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.421771:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.421883:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130104.426782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.426919:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489fbb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130104.446722:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626791040 00000100:00100000:1.0:1789130104.446745:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626791040 00000100:00100000:1.0:1789130104.446855:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819712 00000100:00100000:1.0:1789130104.446860:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819712 00000100:00100000:1.0:1789130104.446886:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130104.446899:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626791040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.447294:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626791040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 395us (25409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.447305:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130104.447356:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:1.0:1789130104.447364:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31336:x1876037604819712:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.447486:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:31336:x1876037604819712:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 122us (20734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.447493:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130104.448179:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789130104.458286:0:38725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789130104.458534:0:36584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789130104.458564:0:36584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130104.458581:0:36584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.458595:0:36584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130104.458654:0:36584:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130104.458658:0:36584:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b485290000 from 13 10000000:01000000:1.0:1789130104.458678:0:36584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130104.458730:0:36584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.458739:0:36584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.458752:0:36584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.458786:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.458891:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130104.458951:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130104.459105:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626791168 00000100:00100000:3.0:1789130104.459115:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626791168 00000100:00100000:3.0:1789130104.459172:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789130104.459184:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:36584:x1876037626791168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130104.459202:0:36581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130104.459219:0:36581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce8971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce896a expref: -99 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.459252:0:36581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce8971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce896a expref: 19 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.459264:0:36581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce8971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce896a expref: 19 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.459275:0:36581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2800, rc 0) 00000100:00100000:3.0:1789130104.459335:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626791168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130104.459354:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789130104.460018:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130104.460040:0:36584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.460051:0:36584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.460146:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.460187:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130104.460223:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130104.460279:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626791296 00000100:00100000:3.0:1789130104.460284:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626791296 00000100:00100000:3.0:1789130104.460323:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789130104.460331:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626791296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130104.460793:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626791296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 460us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130104.460803:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789130104.465418:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.465521:0:36584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130104.465688:0:36584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130104.465742:0:36584:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130104.465828:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626791424 00000100:00100000:2.0:1789130104.465844:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626791424 00000100:00100000:2.0:1789130104.465910:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789130104.465922:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626791424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130104.466223:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:36584:x1876037626791424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.466232:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789130104.467117:0:36584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7d5f341-5d27-45e7-8794-684d66c1a62a:36584:1876037626791424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789130104.469260:0:38726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789130104.469629:0:36584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789130104.469664:0:36584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130104.469681:0:36584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.469695:0:36584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.589567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.589911:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604819840 00000100:00100000:2.0:1789130104.589925:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604819840 00000100:00100000:2.0:1789130104.590043:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130104.590057:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:31939:x1876037604819840:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130104.590082:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.590125:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab968 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590218:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590237:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590252:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590271:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590278:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590284:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590968:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590980:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.590988:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.591080:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789130104.591094:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130104.591198:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591211:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591219:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591227:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591233:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.591238:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591247:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591261:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130104.591269:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.591275:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591282:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce897f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591297:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591303:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591308:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591313:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.591316:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591322:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591329:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b4976b8900) 00010000:00010000:2.0:1789130104.591332:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.591335:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591340:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8986 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591384:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab968 expref: 8 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591410:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab968 expref: 7 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.591417:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:2.0:1789130104.591420:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130104.591422:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5e00, rc 0) 00000100:00100000:2.0:1789130104.591537:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:31939:x1876037604819840:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.591546:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00080000:0.0:1789130104.591652:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130104.595723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.596225:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820096 00000100:00100000:2.0:1789130104.596240:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820096 00000100:00100000:2.0:1789130104.596320:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130104.596332:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:31939:x1876037604820096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130104.596358:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.596384:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8994 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab96f expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596477:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596495:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596508:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596524:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596551:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.596558:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597185:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47ce89a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597198:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47ce89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597206:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47ce89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.597218:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789130104.597481:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597490:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597497:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597503:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.597507:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597515:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597538:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:2.0:1789130104.597541:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.597547:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597554:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce899b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597569:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597575:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597580:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597586:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.597589:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597595:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597640:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.597642:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.597645:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.597651:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.598207:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8994 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab96f expref: 10 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.598226:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47ce89a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab96f expref: 9 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.598234:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789130104.598236:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.598238:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4a00, rc 0) 00000100:00100000:2.0:1789130104.598338:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:31939:x1876037604820096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2007us (2640us total) trans 30064771073 rc 0/0 00000100:00100000:2.0:1789130104.598349:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130104.605345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.606820:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820224 00000100:00100000:2.0:1789130104.606839:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820224 00000100:00100000:2.0:1789130104.606933:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130104.606947:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:31939:x1876037604820224:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130104.607116:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:31939:x1876037604820224:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 171us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.607125:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789130104.692901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130104.693237:0:36596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820352 00000100:00100000:0.0:1789130104.693249:0:36596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820352 00000100:00100000:0.0:1789130104.693310:0:36596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1789130104.693319:0:36596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:587d445f-41ce-47d3-97fe-edc16e866648+9:31948:x1876037604820352:12345-192.168.201.39@tcp:700:mkdir.0 00000100:00100000:0.0:1789130104.693418:0:36596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:587d445f-41ce-47d3-97fe-edc16e866648+9:31948:x1876037604820352:12345-192.168.201.39@tcp:700:mkdir.0 Request processed in 101us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.693424:0:36596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789130104.703954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130104.704067:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820608 00000100:00100000:3.0:1789130104.704092:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820608 00000100:00100000:3.0:1789130104.704180:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130104.704192:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:31948:x1876037604820608:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:3.0:1789130104.704286:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130104.704324:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce88fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8f1 expref: 9 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.704348:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130104.704376:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130104.705032:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.705054:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.705065:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.705128:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.705545:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 5 pid: 36589 timeout: 1367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.705565:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626791552:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130104.705751:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491761300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130104.709743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130104.709835:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820736 00000100:00100000:0.0:1789130104.709847:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820736 00010000:00010000:0.0:1789130104.709928:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 6 pid: 36589 timeout: 1367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130104.709978:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130104.709990:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604820736:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130104.710036:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130104.710044:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 6 pid: 36589 timeout: 1367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.710061:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 6 pid: 36589 timeout: 1367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.710100:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130104.710107:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.710118:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.710128:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.710159:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130104.710219:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604820736:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 231us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130104.710227:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1789130104.710317:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130104.713487:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab953 expref: 5 pid: 36589 timeout: 1367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130104.713525:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626791552:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130104.713560:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.713805:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.713814:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.713853:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.713869:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.713883:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130104.715479:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789130104.715505:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715515:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715524:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715530:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.715544:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715553:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715575:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130104.715578:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.715585:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.715592:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce89b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130104.715645:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000026ebb65f reply state 000000009e4b7b71 transno 30064771074 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.715656:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130104.715810:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:31948:x1876037604820608:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 11614us (11867us total) trans 30064771074 rc 0/0 00000100:00100000:1.0:1789130104.715823:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:0.0:1789130104.726056:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726091:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726101:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726319:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbddc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130104.726328:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726337:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726360:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4909bd600) 00010000:00010000:0.0:1789130104.726363:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130104.726369:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.726377:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce89be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.733011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.733159:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820864 00000100:00100000:2.0:1789130104.733174:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820864 00000100:00100000:2.0:1789130104.733267:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130104.733279:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:31949:x1876037604820864:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130104.733311:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.733344:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce89c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab976 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733448:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733465:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733480:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.733558:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789130104.733562:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130104.733595:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733672:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce89c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab976 expref: 11 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733694:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab976 expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.733722:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.733743:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130104.733748:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5c00, rc 0) 00000100:00100000:2.0:1789130104.733832:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:31949:x1876037604820864:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 555us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.733840:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130104.742187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.742491:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604820992 00000100:00100000:2.0:1789130104.742506:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604820992 00000100:00100000:2.0:1789130104.742585:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130104.742597:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:31949:x1876037604820992:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130104.742650:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.742679:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce89d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab97d expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742782:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742798:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742813:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742831:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742839:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742845:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.742996:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743005:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743013:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.743071:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789130104.743075:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130104.743113:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743129:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743146:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743153:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743160:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.743165:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743174:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743189:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.743200:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.743207:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743213:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce89da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743229:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743235:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743241:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743245:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.743248:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743254:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743262:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4976b8900) 00010000:00010000:2.0:1789130104.743264:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.743266:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743271:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce89e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743310:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce89d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab97d expref: 12 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743337:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab97d expref: 11 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.743345:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789130104.743347:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130104.743349:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5400, rc 0) 00000100:00100000:2.0:1789130104.743441:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:31949:x1876037604820992:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 847us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.743451:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130104.750466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.750833:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604821248 00000100:00100000:2.0:1789130104.750846:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604821248 00000100:00100000:2.0:1789130104.750909:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789130104.750920:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:31949:x1876037604821248:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130104.750947:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.750975:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab984 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.751148:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789130104.751785:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab984 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.751803:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.751807:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130104.751813:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab984 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.751852:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4e00, rc 0) 00000100:00100000:2.0:1789130104.751928:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:31949:x1876037604821248:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1010us (1480us total) trans 30064771075 rc 301/301 00000100:00100000:2.0:1789130104.751937:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789130104.759431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.759548:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604821504 00000100:00100000:2.0:1789130104.759564:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604821504 00000100:00100000:2.0:1789130104.759679:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130104.759692:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:31949:x1876037604821504:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789130104.759907:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130104.759947:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce89e8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab97d expref: 12 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.759975:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789130104.759991:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130104.760027:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.760125:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.760138:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130104.763318:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000070a6828a reply state 00000000148b7fbf transno 30064771076 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.763345:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789130104.763400:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1789130104.763637:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:31949:x1876037604821504:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 3940us (4215us total) trans 30064771076 rc 0/0 00000100:00100000:3.0:1789130104.763649:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00010000:00010000:3.0:1789130104.772167:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772191:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772199:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772206:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130104.772212:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772221:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772256:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:3.0:1789130104.772259:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789130104.772264:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.772272:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce89fd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.773780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.773886:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604821760 00000100:00100000:1.0:1789130104.773900:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604821760 00000100:00100000:1.0:1789130104.773976:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789130104.773988:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:31949:x1876037604821760:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130104.774387:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:31949:x1876037604821760:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 399us (615us total) trans 30064771077 rc 0/0 00000100:00100000:1.0:1789130104.774396:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000040:00080000:0.0:1789130104.775295:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789130104.779724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.779805:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822016 00000100:00100000:2.0:1789130104.779819:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822016 00000100:00100000:2.0:1789130104.779887:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130104.779901:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:31949:x1876037604822016:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130104.779967:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.779999:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab98b expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780108:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780127:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780149:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780168:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780175:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780183:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.780766:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789130104.780897:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780906:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780913:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780933:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.780938:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.780947:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781094:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.781098:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.781104:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781112:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781191:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781200:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781206:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781212:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.781215:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781222:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781552:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4976b8600) 00010000:00010000:2.0:1789130104.781555:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.781559:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781565:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781674:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab98b expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781687:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.781690:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130104.781694:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab98b expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.781705:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5400, rc 0) 00000100:00100000:2.0:1789130104.781795:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:31949:x1876037604822016:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1896us (2096us total) trans 30064771078 rc 301/301 00000100:00100000:2.0:1789130104.781806:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789130104.784568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.789030:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822144 00000100:00100000:1.0:1789130104.789132:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822144 00000100:00100000:1.0:1789130104.789293:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130104.789307:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:31949:x1876037604822144:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130104.789340:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130104.789375:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a20 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab992 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789499:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789517:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789531:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130104.789592:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789130104.789596:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130104.789643:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789675:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a20 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab992 expref: 16 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789699:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab992 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.789721:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4909bdd00) 00010000:00010000:1.0:1789130104.789751:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130104.789758:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd000, rc 0) 00000100:00100000:1.0:1789130104.789875:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:31949:x1876037604822144:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 570us (5322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.789884:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789130104.798229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.798354:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822272 00000100:00100000:1.0:1789130104.798369:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822272 00000100:00100000:1.0:1789130104.798436:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1789130104.798449:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31949:x1876037604822272:12345-192.168.201.39@tcp:37:lfs.0 00000100:00100000:1.0:1789130104.811699:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31949:x1876037604822272:12345-192.168.201.39@tcp:37:lfs.0 Request processed in 13234us (13467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130104.811716:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789130104.818154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.825563:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822528 00000100:00100000:2.0:1789130104.825589:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822528 00000100:00100000:0.0:1789130104.826038:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789130104.826053:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7828450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:31949:x1876037604822528:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130104.826438:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7828450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:31949:x1876037604822528:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 386us (8296us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1789130104.826448:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789130104.878237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.878369:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822656 00000100:00100000:2.0:1789130104.878382:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822656 00000100:00100000:2.0:1789130104.878476:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789130104.878489:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:31950:x1876037604822656:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130104.878522:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.878568:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab999 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878701:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878719:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878735:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878752:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878759:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878765:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878926:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878936:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.878943:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.878983:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789130104.878987:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130104.879045:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879068:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879075:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879093:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879099:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.879105:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879114:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879128:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.879132:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.879138:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879145:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879163:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879171:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879176:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879189:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.879192:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879199:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879209:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4976b8600) 00010000:00010000:2.0:1789130104.879211:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.879214:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879221:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879263:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab999 expref: 18 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879280:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab999 expref: 17 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.879289:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4909bdd00) 00010000:00010000:2.0:1789130104.879291:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130104.879294:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4c00, rc 0) 00000100:00100000:2.0:1789130104.879388:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:31950:x1876037604822656:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 900us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.879397:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130104.885556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130104.885661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.885835:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604822784 00000100:00100000:1.0:1789130104.885850:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604822784 00000100:00100000:1.0:1789130104.885939:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789130104.885952:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604822784:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130104.885976:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130104.886012:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a43 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab999 expref: 17 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130104.886045:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604823040 00010000:00010000:1.0:1789130104.886049:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4909bdd00) 00000100:00100000:0.0:1789130104.886052:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604823040 00010000:00010000:1.0:1789130104.886058:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130104.886101:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130104.886110:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:31950:x1876037604823040:12345-192.168.201.39@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1789130104.886154:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604822784:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 204us (612us total) trans 0 rc 0/0 00010000:00010000:0.0:1789130104.886156:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130104.886160:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1789130104.886168:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00010000:00010000:0.0:1789130104.886179:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8a27 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab992 expref: 17 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886194:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4909bdd00) 00010000:00010000:0.0:1789130104.886204:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130104.886224:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8a4a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9a0 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886376:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886391:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886403:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886419:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886426:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.886434:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887727:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a5f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887757:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a5f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887769:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a5f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130104.887784:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789130104.887820:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887829:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887837:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887845:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.887850:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887858:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887870:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130104.887874:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.887879:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887885:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8a51 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130104.887897:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c67a6a4d reply state 00000000a222339b transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.887914:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130104.887956:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8a4a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a0 expref: 18 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887979:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a5f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a0 expref: 17 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.887987:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789130104.887990:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789130104.887992:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:1.0:1789130104.888075:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604823040:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1966us (2412us total) trans 30064771080 rc 0/0 00000100:00100000:1.0:1789130104.888096:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00010000:00010000:0.0:1789130104.891582:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891776:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891784:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891790:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130104.891796:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891805:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891827:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130104.891830:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130104.891836:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.891844:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8a58 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.921904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130104.925912:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604823296 00000100:00100000:0.0:1789130104.925938:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604823296 00000100:00100000:0.0:1789130104.926063:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1789130104.926077:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:31950:x1876037604823296:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789130104.927778:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604823296:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 1689us (5880us total) trans 30064771081 rc 0/0 00000100:00100000:0.0:1789130104.927794:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789130104.933148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.933422:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604823424 00000100:00100000:2.0:1789130104.933459:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604823424 00000100:00100000:2.0:1789130104.933543:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789130104.933555:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604823424:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130104.933591:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.933658:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9a7 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933748:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933767:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933785:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933803:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933811:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933819:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933971:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933980:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.933988:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.934055:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789130104.934060:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130104.934100:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934115:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934123:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934140:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934146:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.934151:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934159:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934174:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130104.934178:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.934185:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934191:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934209:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934225:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934231:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934236:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.934249:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934257:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934265:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4976b8600) 00010000:00010000:2.0:1789130104.934268:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.934271:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934277:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934319:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a7 expref: 20 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934334:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a7 expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.934342:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130104.934345:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130104.934354:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4c00, rc 0) 00000100:00100000:2.0:1789130104.934444:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604823424:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 891us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130104.934454:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789130104.943693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.943894:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604823552 00000100:00100000:1.0:1789130104.943909:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604823552 00000100:00100000:1.0:1789130104.943995:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1789130104.944009:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604823552:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130104.944047:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130104.944086:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8a89 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9ae expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944195:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944214:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944240:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944259:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944267:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944274:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944366:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944375:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944382:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944389:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.944394:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944402:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944429:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130104.944432:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.944438:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944451:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8a90 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944469:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944475:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944482:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944487:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.944490:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944496:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944504:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130104.944506:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.944509:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944514:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8a97 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944553:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8a89 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ae expref: 20 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944576:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130104.944578:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.944582:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8a89 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ae expref: 20 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.944591:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:1.0:1789130104.944705:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604823552:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 698us (1027us total) trans 0 rc 301/301 00000100:00100000:1.0:1789130104.944714:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130104.949381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.949794:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604823808 00000100:00100000:2.0:1789130104.949807:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604823808 00000100:00100000:2.0:1789130104.949885:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1789130104.949897:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604823808:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130104.949926:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130104.949957:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a9e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9b5 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950153:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950171:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950186:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950204:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950210:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.950216:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953788:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8ab3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953839:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8ab3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953854:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8ab3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130104.953872:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3:0x0]: returning size 0 00010000:00010000:2.0:1789130104.953914:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953921:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953929:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953936:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130104.953941:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953950:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953966:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130104.953970:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130104.953976:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.953983:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8aa5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130104.954002:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d3645318 reply state 00000000b416cbba transno 30064771082 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130104.954019:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130104.954068:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8a9e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9b5 expref: 22 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.954098:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8ab3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9b5 expref: 21 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130104.954106:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130104.954108:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130104.954111:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4600, rc 0) 00000100:00100000:2.0:1789130104.956076:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:31950:x1876037604823808:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 6160us (6692us total) trans 30064771082 rc 0/0 00000100:00100000:2.0:1789130104.956104:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:3.0:1789130104.959665:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959691:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959701:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959709:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130104.959715:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959724:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959744:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff90b4976b8600) 00010000:00010000:3.0:1789130104.959747:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130104.959753:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130104.959759:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8aac lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.965057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.965458:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604824064 00000100:00100000:1.0:1789130104.965472:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604824064 00000100:00100000:1.0:1789130104.965544:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130104.965556:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604824064:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789130104.966012:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.966045:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.966060:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130104.966145:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771083 00000004:00010000:1.0:1789130104.966174:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e9b2449c reply state 000000000d956c2e transno 30064771084 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.966185:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130104.966914:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604824064:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1353us (1866us total) trans 30064771084 rc 0/0 00000100:00100000:1.0:1789130104.966926:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000020:00080000:1.0:1789130104.966933:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130104.972840:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972864:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972873:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972881:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbddc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130104.972887:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972896:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972919:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:0.0:1789130104.972922:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130104.972929:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.972936:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ac1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130104.973595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130104.973788:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604824320 00000100:00100000:2.0:1789130104.973802:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604824320 00000100:00100000:2.0:1789130104.973870:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130104.973882:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:31950:x1876037604824320:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1789130104.974219:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604824320:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 339us (630us total) trans 30064771085 rc 0/0 00000100:00100000:2.0:1789130104.974230:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:0.0:1789130104.992321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130104.992463:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604824576 00000100:00100000:1.0:1789130104.992476:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604824576 00000100:00100000:1.0:1789130104.992563:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789130104.992576:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604824576:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789130104.992698:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130104.992735:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8ab3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9b5 expref: 24 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992758:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:1.0:1789130104.992772:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130104.992803:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992819:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992830:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992846:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992853:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.992860:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993026:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993036:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993043:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993791:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993805:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993816:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993825:0:36589:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993832:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993839:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993863:0:36589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130104.993888:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993896:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993910:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993917:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbddc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.993921:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993930:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993942:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130104.993945:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130104.993950:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993957:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce8ad6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993977:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993984:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993990:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.993995:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130104.993998:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.994015:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.994024:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130104.994027:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130104.994030:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130104.994037:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce8ac8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130104.994047:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ef8a2036 reply state 000000003f88774b transno 30064771086 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130104.994057:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130104.994172:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604824576:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1596us (1866us total) trans 30064771086 rc 0/0 00000100:00100000:1.0:1789130104.994183:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00010000:00010000:0.0:1789130104.994839:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130104.994849:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.994859:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130104.994863:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.994887:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.994900:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:0.0:1789130104.994902:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130104.994906:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.994912:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce8add lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130104.994935:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130104.994936:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130104.994938:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130105.000728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130105.000843:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.000861:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130105.000871:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604824704 00000100:00100000:1.0:1789130105.000887:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604824704 00010000:00010000:3.0:1789130105.000899:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.000907:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.000913:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.000923:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.000946:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff90b4909bdb00) 00010000:00010000:3.0:1789130105.000950:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.000957:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.000965:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce8acf lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130105.000977:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789130105.000992:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604824704:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130105.001027:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.001053:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8ae4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9bc expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001173:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001201:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001214:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001233:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001240:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001247:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001337:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001344:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001351:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001356:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.001359:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001367:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001376:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130105.001384:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.001389:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001395:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8aeb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001548:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001557:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001562:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001568:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.001571:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001579:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001587:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff90b4909bdd00) 00010000:00010000:1.0:1789130105.001590:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.001593:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001637:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001683:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8ae4 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9bc expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001703:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130105.001706:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.001712:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce8ae4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9bc expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.001723:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd000, rc 0) 00000100:00100000:1.0:1789130105.001815:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604824704:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 826us (1102us total) trans 0 rc 301/301 00000100:00100000:1.0:1789130105.001825:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1789130105.013017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.013131:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604824960 00000100:00100000:1.0:1789130105.013145:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604824960 00000100:00100000:1.0:1789130105.013234:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789130105.013258:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604824960:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130105.013288:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.013316:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9c3 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013510:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013528:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013542:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013561:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013583:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.013590:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014468:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8b0e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014481:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8b0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014490:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8b0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130105.014502:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789130105.014537:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014545:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014553:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014560:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.014565:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014574:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014638:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130105.014641:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.014649:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014656:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b00 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130105.014673:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002d09b73e reply state 000000000e8433f0 transno 30064771087 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130105.014683:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130105.014729:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8af9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9c3 expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014747:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8b0e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9c3 expref: 26 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.014755:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130105.014758:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789130105.014760:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:1.0:1789130105.014856:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:31950:x1876037604824960:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1601us (1855us total) trans 30064771087 rc 0/0 00000100:00100000:1.0:1789130105.014868:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00010000:00010000:3.0:1789130105.019855:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019881:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019891:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019898:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.019905:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019934:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019957:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff90b4909bdd00) 00010000:00010000:3.0:1789130105.019961:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.019967:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.019975:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8b07 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.033832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.034432:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604825216 00000100:00100000:2.0:1789130105.034445:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604825216 00000100:00100000:2.0:1789130105.034512:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789130105.034521:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604825216:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130105.034895:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.034928:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.034943:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130105.035005:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771088 00000004:00010000:2.0:1789130105.035034:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006242cb74 reply state 00000000edbaa67b transno 30064771089 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.035056:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130105.035665:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:31950:x1876037604825216:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1141us (1847us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1789130105.035673:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000020:00080000:2.0:1789130105.035679:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130105.046409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130105.046474:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046491:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046499:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046506:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.046512:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046521:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046545:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:3.0:1789130105.046549:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.046580:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.046587:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b1c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130105.046917:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604825472 00000100:00100000:1.0:1789130105.046940:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604825472 00000100:00100000:1.0:1789130105.047015:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1789130105.047028:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:31950:x1876037604825472:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789130105.047391:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31950:x1876037604825472:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 365us (996us total) trans 30064771090 rc 0/0 00000100:00100000:1.0:1789130105.047401:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789130105.053012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.054906:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604825728 00000100:00100000:1.0:1789130105.054927:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604825728 00000100:00100000:1.0:1789130105.055042:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130105.055056:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:31950:x1876037604825728:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130105.055118:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.055159:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b23 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9ca expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.055307:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b2a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.055325:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b2a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.055339:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b2a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130105.055353:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1789130105.055531:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b23 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ca expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.055557:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b2a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ca expref: 31 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.055567:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130105.055589:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130105.055594:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362600, rc 0) 00000100:00100000:1.0:1789130105.061470:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604825728:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 6399us (8454us total) trans 30064771091 rc 0/0 00000100:00100000:1.0:1789130105.061488:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789130105.081815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.081902:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604825984 00000100:00100000:1.0:1789130105.081916:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604825984 00000100:00100000:1.0:1789130105.083137:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130105.083162:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604825984:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789130105.083530:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31950:x1876037604825984:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 377us (1930us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1789130105.083539:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789130105.087488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.087678:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604826240 00000100:00100000:1.0:1789130105.087692:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604826240 00000100:00100000:1.0:1789130105.087776:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789130105.087962:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31950:x1876037604826240:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789130105.088254:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130105.088300:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8b2a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ca expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088328:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8b0e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9c3 expref: 31 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088341:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130105.088357:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130105.088388:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088480:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088495:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088513:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088522:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.088529:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.092516:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.092543:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.092558:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.096499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130105.096637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130105.096947:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626791680 00000100:00100000:3.0:1789130105.096958:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626791680 00000100:00100000:3.0:1789130105.097039:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130105.097052:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626791680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130105.097112:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00010000:00010000:0.0:1789130105.097282:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097303:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097339:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097349:0:36588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097356:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097362:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097381:0:36588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130105.097406:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130105.097412:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097420:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130105.097425:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097434:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097448:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130105.097452:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130105.097458:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097464:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b4d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097492:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130105.097493:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130105.097495:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130105.097528:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097535:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097541:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097546:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130105.097550:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097557:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097566:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130105.097568:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130105.097571:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097578:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b46 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097618:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097624:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097635:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097640:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130105.097643:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097650:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097657:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130105.097660:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130105.097663:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.097669:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8b38 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130105.097681:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000052d1f06e reply state 000000004e9b261d transno 30064771093 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130105.097690:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130105.097779:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31950:x1876037604826240:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 9991us (10304us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1789130105.097788:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130105.104497:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626791680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7432us (7846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130105.104517:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789130105.106981:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107005:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107015:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107022:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.107036:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107046:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107068:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff90b4909bd800) 00010000:00010000:3.0:1789130105.107102:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.107110:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.107118:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8b3f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.107478:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130105.119708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.121279:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604826368 00000100:00100000:0.0:1789130105.121299:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604826368 00000100:00100000:0.0:1789130105.121395:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130105.121408:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604826368:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789130105.121469:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130105.121500:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b54 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9d1 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121589:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121661:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121675:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121694:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121701:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121707:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121796:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121805:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121812:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121819:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130105.121832:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121842:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121858:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130105.121862:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130105.121868:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121874:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8b5b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121890:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121897:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121903:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121908:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130105.121911:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121917:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121926:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130105.121928:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130105.121938:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121945:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce8b62 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.121988:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b54 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d1 expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.122000:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130105.122003:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130105.122007:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce8b54 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d1 expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.122016:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:0.0:1789130105.122123:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604826368:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 717us (2431us total) trans 0 rc 301/301 00000100:00100000:0.0:1789130105.122132:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130105.126357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.126459:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604826624 00000100:00100000:2.0:1789130105.126472:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604826624 00000100:00100000:2.0:1789130105.126549:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1789130105.126561:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604826624:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130105.126591:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130105.126676:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b69 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9d8 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126859:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126876:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126891:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126908:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126916:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.126923:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127735:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127749:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127757:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130105.127769:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 0 00010000:00010000:2.0:1789130105.127804:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127822:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127830:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127838:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130105.127843:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127852:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127865:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130105.127868:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130105.127874:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127881:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8b70 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130105.127900:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000087284755 reply state 00000000253961cf transno 30064771094 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.127910:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130105.127950:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b69 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 34 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127967:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 33 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.127986:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130105.127989:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130105.127992:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5000, rc 0) 00000100:00100000:2.0:1789130105.128109:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+34:31950:x1876037604826624:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1549us (1767us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1789130105.128123:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:3.0:1789130105.138039:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138065:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138073:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138089:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.138095:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138105:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138128:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff90b4976b8b00) 00010000:00010000:3.0:1789130105.138132:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.138138:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.138144:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8b77 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130105.145181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.147913:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604826880 00000100:00100000:2.0:1789130105.147938:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604826880 00000100:00100000:2.0:1789130105.148183:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789130105.148199:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31950:x1876037604826880:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130105.149147:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.149174:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.149189:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130105.150121:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771095 00000004:00010000:3.0:1789130105.150189:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000aa48627a reply state 000000003df93f84 transno 30064771096 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.150203:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130105.150765:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:31950:x1876037604826880:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 2562us (5594us total) trans 30064771096 rc 0/0 00000100:00100000:3.0:1789130105.150775:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000020:00080000:3.0:1789130105.150784:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130105.159185:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159338:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159347:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159354:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.159360:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159370:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159392:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130105.159395:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.159402:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.159409:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8b8c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130105.169254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.169807:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827008 00000100:00100000:2.0:1789130105.169821:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827008 00000100:00100000:2.0:1789130105.169907:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130105.169920:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:31952:x1876037604827008:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130105.169950:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130105.169989:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9df expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170127:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170147:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170161:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130105.170246:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789130105.170251:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130105.170284:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170314:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9df expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170337:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9df expref: 6 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.170347:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130105.170350:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130105.170355:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4200, rc 0) 00000100:00100000:2.0:1789130105.170438:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:31952:x1876037604827008:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 520us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.170447:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130105.180887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.181778:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827136 00000100:00100000:1.0:1789130105.181796:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827136 00000100:00100000:1.0:1789130105.181945:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1789130105.181958:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31952:x1876037604827136:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130105.181988:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.182018:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9e6 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182133:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182152:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182167:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182209:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182218:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182226:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182369:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182377:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182384:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130105.182420:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789130105.182424:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130105.182454:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182470:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182477:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182484:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182500:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.182506:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182514:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182531:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130105.182534:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.182541:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182548:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182565:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182571:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182577:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182582:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.182585:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.182591:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.184051:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4909bd600) 00010000:00010000:1.0:1789130105.184055:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130105.184063:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.184070:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8baf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.184154:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9e6 expref: 8 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.184171:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9e6 expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.184179:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130105.184181:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130105.184184:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362400, rc 0) 00000100:00100000:1.0:1789130105.188494:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:31952:x1876037604827136:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 6519us (7603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.188513:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789130105.200042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.200462:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827392 00000100:00100000:2.0:1789130105.200485:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827392 00000100:00100000:2.0:1789130105.200574:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130105.200586:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+7:31952:x1876037604827392:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130105.200645:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130105.200678:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8bbd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9ed expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200807:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200825:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200841:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200860:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200866:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.200872:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201043:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8bd2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201053:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8bd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201060:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8bd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130105.201093:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:2.0:1789130105.201432:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201441:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201449:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201456:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130105.201461:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201470:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201485:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130105.201488:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130105.201494:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201501:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8bc4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201520:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201526:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201543:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201549:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130105.201552:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201558:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201566:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff90b4976b8500) 00010000:00010000:2.0:1789130105.201569:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130105.201571:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201577:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8bcb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201667:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8bbd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ed expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201685:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8bd2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ed expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.201693:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130105.201695:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130105.201710:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4600, rc 0) 00000100:00100000:2.0:1789130105.201804:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+9:31952:x1876037604827392:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1219us (1784us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1789130105.201824:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130105.212590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.213095:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827648 00000100:00100000:0.0:1789130105.213109:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827648 00000100:00100000:0.0:1789130105.213254:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1789130105.213267:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+9:31952:x1876037604827648:12345-192.168.201.39@tcp:103:mmap_sanity.0 00010000:00010000:0.0:1789130105.213291:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130105.213324:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8bd2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9ed expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130105.213378:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130105.213385:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130105.213467:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604827648:12345-192.168.201.39@tcp:103:mmap_sanity.0 Request processed in 202us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130105.213475:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789130105.223751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.224174:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827776 00000100:00100000:3.0:1789130105.224189:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827776 00000100:00100000:3.0:1789130105.224267:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130105.224280:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604827776:12345-192.168.201.39@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1789130105.224430:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.224452:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 34 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.224463:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.224511:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 34 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.224528:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 34 pid: 38723 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.224546:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626791808:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130105.226355:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491761300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130105.232848:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626791808:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130105.232888:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.249200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.254632:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604827904 00000100:00100000:0.0:1789130105.254655:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604827904 00010000:00010000:2.0:1789130105.256373:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 35 pid: 38723 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.256444:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130105.256458:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:2367:x1876037604827904:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130105.256481:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130105.256490:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 35 pid: 38723 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256507:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 35 pid: 38723 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256534:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8b7e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9d8 expref: 35 pid: 38723 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256558:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130105.256565:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256577:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256586:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.256704:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130105.256788:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:2367:x1876037604827904:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 333us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.256796:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00010000:00010000:3.0:1789130105.258037:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.258057:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130105.259864:0:36587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130105.260907:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:2.0:1789130105.261409:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].1, 136 off8328 00000100:00100000:2.0:1789130105.261583:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604827776:12345-192.168.201.39@tcp:58:mmap_sanity.0 Request processed in 37300us (37843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.261594:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130105.264696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.264793:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828032 00000100:00100000:1.0:1789130105.264804:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828032 00000100:00100000:1.0:1789130105.264870:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130105.264882:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604828032:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130105.264909:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.264938:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9f4 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265059:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265082:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265108:0:38723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265123:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265139:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130105.265141:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130105.265144:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.265152:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:1.0:1789130105.265256:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+9:31952:x1876037604828032:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 376us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.265263:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:0.0:1789130105.286023:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130105.369485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.369548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.369582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.369649:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828416 00000100:00100000:3.0:1789130105.369655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.369662:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828416 00000100:00100000:3.0:1789130105.369679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.369706:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828672 00000100:00100000:3.0:1789130105.369709:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828672 00000100:00100000:3.0:1789130105.369732:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828288 00000100:00100000:0.0:1789130105.369732:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828544 00000100:00100000:3.0:1789130105.369735:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828288 00000100:00100000:0.0:1789130105.369735:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828544 00000100:00100000:3.0:1789130105.369753:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130105.369806:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828160 00000100:00100000:1.0:1789130105.369811:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828160 00000100:00100000:1.0:1789130105.369847:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130105.369856:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604828160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130105.369955:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604828160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.369981:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00080000:1.0:1789130105.370171:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130105.370177:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130105.370692:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604828416:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130105.370756:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604828416:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 76us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130105.370756:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789130105.370763:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:3.0:1789130105.370785:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130105.370791:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604828544:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130105.370799:0:37273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789130105.370808:0:37273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789130105.370817:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604828544:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130105.370823:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130105.370835:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789130105.370841:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604828288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130105.370868:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604828288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130105.370887:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130105.371196:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604828672:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130105.371236:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604828672:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 472us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.371244:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000040:00080000:3.0:1789130105.799406:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130105.799418:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130105.799463:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:3.0:1789130105.799471:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130105.799834:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626791936:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130105.800458:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b496413840 going to sleep for 11 seconds 00000100:00100000:3.0:1789130105.805399:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626791936:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130105.806933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.807534:0:36598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828800 00000100:00100000:2.0:1789130105.807551:0:36598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828800 00000100:00100000:2.0:1789130105.807669:0:36598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130105.807682:0:36598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604828800:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789130105.807809:0:36598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604828800:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 129us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.807818:0:36598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789130105.830978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.832697:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604828928 00000100:00100000:2.0:1789130105.832716:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604828928 00000100:00100000:2.0:1789130105.832828:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1789130105.832840:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604828928:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130105.832887:0:36589:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130105.833056:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604828928:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 217us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.833075:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789130105.841305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.841483:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604829056 00000100:00100000:3.0:1789130105.841506:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604829056 00000100:00100000:3.0:1789130105.841773:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130105.841789:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604829056:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789130105.841912:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.841938:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.841954:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.841977:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.841984:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.841990:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842055:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842075:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842083:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130105.842150:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:3.0:1789130105.842156:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130105.842178:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842193:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842200:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842207:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842213:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.842219:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842228:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842242:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789130105.842252:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.842259:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842266:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8bee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842284:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842290:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842296:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842301:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.842304:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842310:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842318:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9ebbb977 (ffff90b496419c00) 00010000:00010000:3.0:1789130105.842320:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.842323:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842330:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8bf5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842352:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842364:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842370:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842375:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.842378:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842384:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842392:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130105.842394:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.842398:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.842404:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8bfc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.842524:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604829056:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 737us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130105.842533:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130105.848540:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130105.851203:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604829312 00000100:00100000:2.0:1789130105.851226:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604829312 00000100:00100000:2.0:1789130105.851403:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789130105.851418:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:31953:x1876037604829312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130105.851449:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130105.851483:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8c03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ab9fb expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.851672:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.851694:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.851710:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130105.861049:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:2.0:1789130105.861281:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861295:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861304:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861310:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130105.861316:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861348:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861370:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130105.861373:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130105.861380:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861387:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8c0a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861469:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8c03 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9fb expref: 36 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861481:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789130105.861483:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130105.861487:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8c03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9fb expref: 36 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130105.861499:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5000, rc 0) 00000100:00100000:2.0:1789130105.861649:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+35:31953:x1876037604829312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 10224us (13111us total) trans 30064771098 rc 301/301 00000100:00100000:2.0:1789130105.861661:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789130105.878135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.880758:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604829440 00000100:00100000:1.0:1789130105.880783:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604829440 00000100:00100000:1.0:1789130105.880899:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130105.880913:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+35:31953:x1876037604829440:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130105.880967:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130105.881157:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+35:31953:x1876037604829440:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 246us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.881166:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789130105.894558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.894918:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604829696 00000100:00100000:0.0:1789130105.894933:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604829696 00000100:00100000:0.0:1789130105.895143:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1789130105.895163:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:31953:x1876037604829696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130105.895196:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130105.895228:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8c18 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba02 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130105.903872:0:36587:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xa4:0x0], count =30 00000004:00080000:1.0:1789130105.903904:0:36587:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xa4:0x0]+30 in llog 00000004:00080000:1.0:1789130105.904927:0:36587:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc2:0x0], index 1: 0 00010000:00010000:1.0:1789130105.908947:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8c1f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.908981:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8c1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.909024:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8c1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.909873:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8c18 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba02 expref: 38 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.909903:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8c1f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba02 expref: 37 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.909915:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130105.909918:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130105.909923:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363800, rc 0) 00000100:00100000:1.0:1789130105.910040:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:31953:x1876037604829696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 14874us (15489us total) trans 30064771099 rc 0/0 00000100:00100000:1.0:1789130105.910051:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789130105.919171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130105.923081:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604829952 00000100:00100000:3.0:1789130105.923109:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604829952 00000100:00100000:3.0:1789130105.923267:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130105.923282:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:31953:x1876037604829952:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130105.923387:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130105.923424:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8c1f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba02 expref: 37 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923450:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:3.0:1789130105.923465:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130105.923497:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923515:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923527:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923544:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923551:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923558:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923729:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923737:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923745:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923758:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.923763:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923772:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923782:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130105.923785:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.923789:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923796:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8c2d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923806:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923812:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923818:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923823:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130105.923826:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923832:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923850:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb03e558f (ffff90b496419c00) 00010000:00010000:3.0:1789130105.923853:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130105.923856:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130105.923862:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8c34 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb03e558f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.926014:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:31953:x1876037604829952:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2721us (6844us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130105.926031:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789130105.943256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.947384:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604830080 00000100:00100000:1.0:1789130105.947407:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604830080 00000100:00100000:1.0:1789130105.947551:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789130105.947564:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+36:31953:x1876037604830080:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130105.947595:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.947664:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8c3b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba09 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.947728:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.947746:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.947782:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.949871:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8c3b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 38 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.949995:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 37 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.950008:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130105.950090:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130105.950095:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362200, rc 0) 00000100:00100000:1.0:1789130105.950210:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:31953:x1876037604830080:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2646us (6971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.950221:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1789130105.958461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.960528:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604830336 00000100:00100000:1.0:1789130105.960554:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604830336 00000100:00100000:1.0:1789130105.960689:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130105.960702:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:31953:x1876037604830336:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130105.960826:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.960852:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.960867:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130105.962360:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].2, 88 off8344 00000004:00080000:2.0:1789130105.962382:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1269059778569ns, next at 1270059774479ns, rc = 0 00000004:00010000:2.0:1789130105.962526:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004818a5b2 reply state 0000000088998699 transno 30064771100 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130105.962540:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130105.963237:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:31953:x1876037604830336:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2531us (4788us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1789130105.963247:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:1.0:1789130105.965767:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965791:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965801:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965809:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130105.965816:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965826:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965851:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130105.965855:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130105.965862:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.965868:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce8c49 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130105.968240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.968361:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604830464 00000100:00100000:1.0:1789130105.968374:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604830464 00000100:00100000:1.0:1789130105.968454:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789130105.968466:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:31953:x1876037604830464:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130105.968499:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130105.968525:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba10 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.968876:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.971251:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130105.971318:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130105.971322:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130105.971328:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:1.0:1789130105.971449:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:31953:x1876037604830464:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2979us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130105.971460:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130105.980689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.980849:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604830592 00000100:00100000:0.0:1789130105.980864:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604830592 00000100:00100000:0.0:1789130105.980964:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789130105.980978:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604830592:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789130105.981492:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604830592:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 514us (817us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1789130105.981501:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130105.985666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130105.985829:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604830848 00000100:00100000:1.0:1789130105.985843:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604830848 00000100:00100000:1.0:1789130105.985929:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789130105.985942:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:31953:x1876037604830848:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130105.986295:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:31953:x1876037604830848:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 354us (707us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1789130105.986304:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130105.988864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130105.989544:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831104 00000100:00100000:0.0:1789130105.989558:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831104 00000100:00100000:2.0:1789130105.990186:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789130105.990205:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:31953:x1876037604831104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130105.990400:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:31953:x1876037604831104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 201us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130105.990408:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:3.0:1789130106.006681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130106.010569:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831232 00000100:00100000:2.0:1789130106.010593:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831232 00000100:00080000:1.0:1789130106.010690:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130106.010738:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:2.0:1789130106.010756:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:31953:x1876037604831232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130106.010787:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130106.010817:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8c57 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba17 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.010938:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.010960:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.010974:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130106.012347:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130106.012469:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.013271:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8c57 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba17 expref: 42 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.013306:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba17 expref: 41 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.013318:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130106.013321:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789130106.013326:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4600, rc 0) 00000100:00100000:2.0:1789130106.014166:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:31953:x1876037604831232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3411us (7496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130106.014177:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789130106.021905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.021998:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831360 00000100:00100000:0.0:1789130106.022013:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831360 00000100:00100000:0.0:1789130106.022100:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1789130106.022113:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604831360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130106.022140:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130106.022172:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba1e expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130106.022208:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f579, blocks: 0x1 00010000:00010000:0.0:1789130106.022234:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=1269s v=(0 0) 00010000:00010000:0.0:1789130106.022240:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130106.022251:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.022274:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.022289:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:0.0:1789130106.022366:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604831360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 256us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.022374:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789130106.029431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130106.039453:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831616 00000100:00100000:2.0:1789130106.039474:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831616 00000100:00100000:2.0:1789130106.039575:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789130106.039588:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:31953:x1876037604831616:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130106.043549:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:31953:x1876037604831616:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 3946us (14117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130106.043568:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789130106.064079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130106.069086:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831744 00000100:00100000:2.0:1789130106.069109:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831744 00000100:00100000:2.0:1789130106.069217:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130106.069258:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:31953:x1876037604831744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130106.069284:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130106.069310:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba25 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.069352:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.069362:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130106.069367:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130106.069373:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.069416:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.069433:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.069450:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626792064:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130106.069597:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491761300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130106.076708:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626792064:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130106.076761:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.076821:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4e00, rc 0) 00000100:00100000:2.0:1789130106.076908:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:31953:x1876037604831744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 7652us (12854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130106.076918:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130106.091079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.091252:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604831872 00000100:00100000:1.0:1789130106.091268:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604831872 00010000:00010000:1.0:1789130106.091329:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.091413:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789130106.091426:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604831872:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130106.091446:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130106.091476:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.091492:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.091533:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba1e expref: 8 pid: 37273 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.091556:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130106.091562:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130106.091572:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.091584:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.091878:0:36574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.091897:0:36574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d48780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:36574:1876037626792192:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130106.092171:0:36574:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaef540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130106.103294:0:36574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d48780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:36574:1876037626792192:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130106.103336:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130106.103425:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604831872:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 12000us (12368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130106.103440:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130106.119333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.119465:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832000 00000100:00100000:1.0:1789130106.119476:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832000 00002000:00100000:1.0:1789130106.119539:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff90b497af2940 x1876037604832000/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789130106.119550:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b497af2940 with x1876037604832000 ext(0->409599) 00002000:00010000:1.0:1789130106.119557:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b497af2940 00000100:00100000:1.0:1789130106.119591:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789130106.119638:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604832000:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130106.154089:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604832000:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 34471us (34753us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1789130106.154119:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:0.0:1789130106.154140:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff90b497af2940 x1876037604832000/t30064771075(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:577/0 lens 488/448 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789130106.154155:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b497af2940 with x1876037604832000 ext(0->409599) 00002000:00010000:0.0:1789130106.154164:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b497af2940 00000100:00100000:1.0:1789130106.159171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130106.159328:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832128 00000100:00100000:3.0:1789130106.159339:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832128 00000100:00100000:3.0:1789130106.159463:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1789130106.159474:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:31953:x1876037604832128:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130106.238739:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771093 is committed 00000001:00080000:2.0:1789130106.238771:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00000004:00080000:2.0:1789130106.238808:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789130106.238823:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771097 is committed 00000100:00100000:2.0:1789130106.238958:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626792320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789130106.239240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130106.239360:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626792320 00000100:00100000:1.0:1789130106.239369:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626792320 00000100:00100000:1.0:1789130106.239432:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789130106.239442:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626792320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789130106.239633:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:1.0:1789130106.239636:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1789130105 00002000:00010000:1.0:1789130106.239639:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130106.239641:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789130105 -> 1789130105 00002000:00010000:1.0:1789130106.239643:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130106.239685:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626792320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 244us (445us total) trans 30064771076 rc 0/0 00000100:00100000:1.0:1789130106.239707:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789130106.239801:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b497af1a40/2, rc 0, transno 30064771076 00000100:00100000:2.0:1789130106.239808:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626792320:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789130106.240143:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130106.240292:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:31953:x1876037604832128:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 80818us (81128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130106.240303:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130106.242761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.243356:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832256 00000100:00100000:0.0:1789130106.243375:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832256 00000100:00100000:0.0:1789130106.243493:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130106.243504:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604832256:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789130106.282829:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604832256:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 39316us (40065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.282842:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000001:00080000:3.0:1789130106.283266:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771075 is committed 00000001:00080000:3.0:1789130106.283282:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771076 is committed 00000100:00100000:2.0:1789130106.285087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.285177:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832512 00000100:00100000:0.0:1789130106.285187:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832512 00000100:00100000:0.0:1789130106.285239:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:0.0:1789130106.285248:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:31953:x1876037604832512:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130106.285310:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130106.285341:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8c5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba17 expref: 13 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.285364:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789130106.285369:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130106.285399:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.285434:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.285445:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130106.285764:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000032f26211 reply state 00000000cb538da9 transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.285775:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130106.285875:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:31953:x1876037604832512:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 627us (826us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1789130106.285883:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:3.0:1789130106.293211:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293230:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293237:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293243:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130106.293248:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293256:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293283:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:3.0:1789130106.293290:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130106.293295:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130106.293302:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c73 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.299150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.299364:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832640 00000100:00100000:0.0:1789130106.299375:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832640 00000100:00100000:0.0:1789130106.299497:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789130106.299509:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604832640:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789130106.299815:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:0.0:1789130106.299820:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1789130105 -> 1789130104 00002000:00010000:0.0:1789130106.299823:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1789130104 00002000:00010000:0.0:1789130106.299825:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789130105 -> 1789130104 00002000:00010000:0.0:1789130106.299828:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:0.0:1789130106.299908:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604832640:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 401us (768us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1789130106.299918:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:0.0:1789130106.310158:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130106.311668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.311761:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604832896 00000100:00100000:1.0:1789130106.311772:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604832896 00000100:00100000:1.0:1789130106.311841:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130106.311851:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:31953:x1876037604832896:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789130106.311921:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.311939:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.311947:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.311981:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.311995:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 13 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.312010:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626792448:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130106.312112:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130106.318168:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626792448:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130106.318203:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.323458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.324190:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833024 00000100:00100000:0.0:1789130106.324214:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833024 00010000:00010000:0.0:1789130106.324262:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.324309:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789130106.324326:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604833024:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130106.324346:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130106.324357:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324375:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324399:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8c42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba09 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324421:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789130106.324427:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324441:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324449:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.324487:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130106.324562:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604833024:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 244us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.324583:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00010000:00010000:2.0:1789130106.324652:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324661:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324688:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324706:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324712:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324718:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130106.324723:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324730:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324738:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130106.324741:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130106.324744:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.324750:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8c7a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.325404:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:31953:x1876037604832896:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 13550us (13742us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130106.325415:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:2.0:1789130106.333188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.333282:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833152 00000100:00100000:1.0:1789130106.333306:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833152 00000100:00100000:1.0:1789130106.333370:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130106.333382:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604833152:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789130106.333430:0:38727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.333451:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.333461:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130106.333466:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130106.333470:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.333506:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.333520:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.333535:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626792576:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130106.333643:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130106.342644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.342736:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833280 00000100:00100000:0.0:1789130106.342746:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833280 00010000:00010000:0.0:1789130106.342790:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 8 pid: 37275 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.342857:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789130106.342869:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604833280:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130106.342890:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130106.342918:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 8 pid: 37275 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.342934:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 8 pid: 37275 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.342961:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130106.342966:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130106.342971:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.342983:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.343004:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130106.343075:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604833280:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.343101:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00010000:00010000:1.0:1789130106.348271:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17253a8/0x5c74554e47ce8c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba25 expref: 7 pid: 37275 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.348300:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626792576:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130106.348342:0:38727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348353:0:38727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348360:0:38727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348396:0:38727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348405:0:38727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348415:0:38727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348422:0:38727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130106.348427:0:38727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348436:0:38727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348454:0:38727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130106.348467:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993b0871/0x5c74554e47ce8c81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130106.348568:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604833152:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 15187us (15390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130106.348578:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130106.365903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.366030:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833536 00000100:00100000:0.0:1789130106.366040:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833536 00000100:00100000:0.0:1789130106.366115:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:0.0:1789130106.366125:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:31953:x1876037604833536:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130106.366217:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366235:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366248:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366497:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366508:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366517:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366550:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.366564:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 13 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.366592:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626792704:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130106.366867:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130106.370929:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626792704:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130106.370958:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.381797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.384155:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833664 00000100:00100000:0.0:1789130106.384171:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833664 00010000:00010000:0.0:1789130106.384226:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.384279:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1789130106.384292:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037604833664:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130106.384309:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130106.384317:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384331:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384355:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8c50 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba10 expref: 14 pid: 36589 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384371:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789130106.384377:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384403:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384411:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.384452:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130106.384518:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604833664:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 228us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.384527:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:2.0:1789130106.385085:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.385104:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130106.385330:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771103 00000001:00080000:2.0:1789130106.385488:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771104 00000001:00080000:2.0:1789130106.385533:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771105 00000100:00100000:2.0:1789130106.385676:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626792832:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130106.385748:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130106.385790:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130106.385858:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626792832 00000100:00100000:3.0:1789130106.385875:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626792832 00000100:00100000:3.0:1789130106.385998:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130106.386020:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626792832:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789130106.386180:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626792832:12345-0@lo:1000:mdt00_003.0 Request processed in 171us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130106.386207:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130106.386305:0:38723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:2.0:1789130106.386314:0:38723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b497af1a40, transno 30064771076 00000100:00100000:2.0:1789130106.386346:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626792832:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789130106.387206:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771106 00000100:00100000:2.0:1789130106.387300:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626792960:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130106.387362:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130106.394919:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130106.395754:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626792960 00000100:00100000:0.0:1789130106.395770:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626792960 00000100:00100000:0.0:1789130106.395861:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130106.395875:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626792960:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789130106.396452:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38723:x1876037626792960:12345-0@lo:1000:mdt00_003.0 Request processed in 579us (9088us total) trans 30064771078 rc 0/0 00000100:00100000:0.0:1789130106.396463:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130106.401310:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626792960:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789130106.401396:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401409:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401418:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401425:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130106.401431:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401470:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401492:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130106.401496:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130106.401501:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401508:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8c8f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401567:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401574:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401580:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401586:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130106.401589:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401595:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401625:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130106.401628:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130106.401638:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401666:0:38723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401675:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.401770:0:38723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130106.401790:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626793088:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130106.401926:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130106.406425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.406552:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626793088:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130106.406594:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406634:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8be0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406680:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406697:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406739:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406753:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406759:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406767:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406773:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130106.406778:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406787:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406801:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130106.406804:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130106.406808:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406813:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8c96 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406824:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406830:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406842:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406848:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130106.406851:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406857:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406865:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130106.406868:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130106.406871:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.406877:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce8c88 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130106.407206:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+16:31953:x1876037604833536:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 41079us (41312us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1789130106.407218:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000020:00080000:0.0:1789130106.407226:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789130106.407635:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130106.407641:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130106.407677:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:2.0:1789130106.407684:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130106.407876:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833792 00000100:00100000:3.0:1789130106.407887:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833792 00000100:00100000:3.0:1789130106.407965:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789130106.407977:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7828850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604833792:12345-192.168.201.39@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1789130106.408141:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7828850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604833792:12345-192.168.201.39@tcp:49:mmap_sanity.0 Request processed in 166us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130106.408149:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00080000:2.0:1789130106.410293:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130106.416093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130106.416183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.416301:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604833920 00000100:00100000:0.0:1789130106.416317:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604833920 00000100:00100000:0.0:1789130106.416404:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789130106.416416:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:31952:x1876037604833920:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789130106.416442:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130106.416478:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba2c expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130106.416535:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa3f578, atime: 0x6aa3f578, ctime: 0x6aa3f578, blocks: 0x403 00010000:00010000:0.0:1789130106.416573:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=1269s v=(0 0) 00010000:00010000:0.0:1789130106.416579:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130106.416591:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 6 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.416636:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 6 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130106.416654:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:0.0:1789130106.416731:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:31952:x1876037604833920:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 317us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130106.416740:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130106.416836:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834176 00000100:00100000:2.0:1789130106.416842:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834176 00000100:00100000:2.0:1789130106.416885:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130106.416894:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:31953:x1876037604834176:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789130106.417755:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130106.417883:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00010000:00010000:2.0:1789130106.417939:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.417971:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.417985:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.417995:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418002:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418009:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418037:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130106.418143:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+18:31953:x1876037604834176:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1247us (1958us total) trans 30064771109 rc 0/0 00000100:00100000:2.0:1789130106.418153:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000020:00080000:2.0:1789130106.418159:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789130106.418192:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130106.418199:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418208:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130106.418212:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418221:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418249:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:2.0:1789130106.418252:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130106.418258:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418265:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8ca4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130106.418286:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130106.418288:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130106.418290:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130106.421144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.421293:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834304 00000100:00100000:0.0:1789130106.421308:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834304 00002000:00100000:0.0:1789130106.421368:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff90b486f43480 x1876037604834304/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130106.421383:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f43480 with x1876037604834304 ext(0->4095) 00002000:00010000:0.0:1789130106.421390:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f43480 00000100:00100000:0.0:1789130106.421424:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1789130106.421435:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604834304:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:0.0:1789130106.421766:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604834304:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 331us (637us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789130106.421800:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:0.0:1789130106.421808:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff90b486f43480 x1876037604834304/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/4536 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130106.421816:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f43480 with x1876037604834304 ext(0->4095) 00002000:00010000:0.0:1789130106.421820:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f43480 00000100:00100000:2.0:1789130106.441178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130106.441303:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834432 00000100:00100000:0.0:1789130106.441324:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834432 00002000:00100000:0.0:1789130106.441397:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff90b382f8de00 x1876037604834432/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130106.441412:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8de00 with x1876037604834432 ext(4096->8191) 00002000:00010000:0.0:1789130106.441419:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8de00 00000100:00100000:0.0:1789130106.441465:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789130106.441475:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604834432:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130106.443264:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604834432:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 1782us (2096us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130106.443282:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:3.0:1789130106.443294:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff90b382f8de00 x1876037604834432/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/4536 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130106.443303:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8de00 with x1876037604834432 ext(4096->8191) 00002000:00010000:3.0:1789130106.443309:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8de00 00000100:00100000:0.0:1789130106.464724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.464893:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834560 00000100:00100000:1.0:1789130106.464904:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834560 00002000:00100000:1.0:1789130106.464950:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff90b48904ad00 x1876037604834560/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.464962:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904ad00 with x1876037604834560 ext(8192->12287) 00002000:00010000:1.0:1789130106.464968:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904ad00 00000100:00100000:1.0:1789130106.464998:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1789130106.465008:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834560:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.465242:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834560:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 233us (526us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789130106.465249:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:1.0:1789130106.465256:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff90b48904ad00 x1876037604834560/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/4536 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.465265:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904ad00 with x1876037604834560 ext(8192->12287) 00002000:00010000:1.0:1789130106.465268:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904ad00 00000100:00100000:3.0:1789130106.469200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.469421:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834688 00000100:00100000:1.0:1789130106.469437:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834688 00002000:00100000:1.0:1789130106.469532:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff90b486f41a40 x1876037604834688/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.469545:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f41a40 with x1876037604834688 ext(12288->69631) 00002000:00010000:1.0:1789130106.469553:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f41a40 00000100:00100000:1.0:1789130106.469597:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789130106.469659:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834688:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.484069:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834688:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 14395us (14869us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1789130106.484083:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:1.0:1789130106.484097:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff90b486f41a40 x1876037604834688/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.484109:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f41a40 with x1876037604834688 ext(12288->69631) 00002000:00010000:1.0:1789130106.484125:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f41a40 00000100:00100000:0.0:1789130106.502317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130106.502544:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834816 00000100:00100000:3.0:1789130106.502558:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834816 00002000:00100000:3.0:1789130106.502650:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff90b48904bc00 x1876037604834816/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130106.502665:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904bc00 with x1876037604834816 ext(69632->106495) 00002000:00010000:3.0:1789130106.502693:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904bc00 00000100:00100000:3.0:1789130106.502778:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789130106.502790:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604834816:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.509283:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604834816:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 6470us (6959us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.509302:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00100000:1.0:1789130106.509320:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff90b48904bc00 x1876037604834816/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.509334:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904bc00 with x1876037604834816 ext(69632->106495) 00002000:00010000:1.0:1789130106.509342:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904bc00 00000100:00100000:0.0:1789130106.522469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.522665:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604834944 00000100:00100000:1.0:1789130106.522676:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604834944 00002000:00100000:1.0:1789130106.522734:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff90b48904b480 x1876037604834944/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.522768:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904b480 with x1876037604834944 ext(106496->143359) 00002000:00010000:1.0:1789130106.522774:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904b480 00000100:00100000:1.0:1789130106.522851:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130106.522861:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834944:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.531139:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604834944:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8180us (8583us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.531155:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:1.0:1789130106.531170:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff90b48904b480 x1876037604834944/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.531182:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904b480 with x1876037604834944 ext(106496->143359) 00002000:00010000:1.0:1789130106.531188:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904b480 00000100:00100000:3.0:1789130106.546313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.546973:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835072 00000100:00100000:1.0:1789130106.546989:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835072 00002000:00100000:1.0:1789130106.547413:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff90b486f41e00 x1876037604835072/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.547791:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f41e00 with x1876037604835072 ext(143360->180223) 00002000:00010000:1.0:1789130106.547799:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f41e00 00000100:00100000:1.0:1789130106.547959:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1789130106.547973:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835072:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.561383:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835072:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 13393us (15067us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.561397:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00002000:00100000:1.0:1789130106.562064:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff90b486f41e00 x1876037604835072/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.562078:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f41e00 with x1876037604835072 ext(143360->180223) 00002000:00010000:1.0:1789130106.562085:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f41e00 00000100:00100000:0.0:1789130106.585934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.586230:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835200 00000100:00100000:1.0:1789130106.586243:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835200 00002000:00100000:1.0:1789130106.586312:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff90b489049e00 x1876037604835200/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.586326:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049e00 with x1876037604835200 ext(180224->217087) 00002000:00010000:1.0:1789130106.586347:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b489049e00 00000100:00100000:1.0:1789130106.586385:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130106.586396:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604835200:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.594757:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604835200:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8343us (8817us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.594777:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00002000:00100000:1.0:1789130106.594795:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff90b489049e00 x1876037604835200/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.594808:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049e00 with x1876037604835200 ext(180224->217087) 00002000:00010000:1.0:1789130106.594817:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b489049e00 00000100:00100000:3.0:1789130106.605746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.605960:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835328 00000100:00100000:1.0:1789130106.605975:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835328 00002000:00100000:1.0:1789130106.606064:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (217088->253951) req@ffff90b486f42d00 x1876037604835328/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.606079:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f42d00 with x1876037604835328 ext(217088->253951) 00002000:00010000:1.0:1789130106.606105:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f42d00 00000100:00100000:1.0:1789130106.606143:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789130106.606154:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835328:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.610508:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835328:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 4337us (4759us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.610529:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00002000:00100000:1.0:1789130106.610547:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (217088->253951) req@ffff90b486f42d00 x1876037604835328/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.610560:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f42d00 with x1876037604835328 ext(217088->253951) 00002000:00010000:1.0:1789130106.610570:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f42d00 00000100:00100000:3.0:1789130106.619555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.619739:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835456 00000100:00100000:1.0:1789130106.619752:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835456 00002000:00100000:1.0:1789130106.619824:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (253952->290815) req@ffff90b486f40f00 x1876037604835456/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.619838:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40f00 with x1876037604835456 ext(253952->290815) 00002000:00010000:1.0:1789130106.619847:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f40f00 00000100:00100000:1.0:1789130106.619889:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1789130106.619901:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835456:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.625982:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835456:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 6065us (6425us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.626011:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00002000:00100000:1.0:1789130106.626028:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (253952->290815) req@ffff90b486f40f00 x1876037604835456/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.626076:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40f00 with x1876037604835456 ext(253952->290815) 00002000:00010000:1.0:1789130106.626084:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f40f00 00000100:00100000:0.0:1789130106.631263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.631386:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835584 00000100:00100000:1.0:1789130106.631402:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835584 00002000:00100000:1.0:1789130106.631472:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (290816->327679) req@ffff90b4bfcd6580 x1876037604835584/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.631486:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd6580 with x1876037604835584 ext(290816->327679) 00002000:00010000:1.0:1789130106.631494:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd6580 00000100:00100000:1.0:1789130106.631534:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789130106.631545:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835584:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.638352:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835584:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 6788us (7085us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.638372:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00002000:00100000:1.0:1789130106.638391:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (290816->327679) req@ffff90b4bfcd6580 x1876037604835584/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.638403:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd6580 with x1876037604835584 ext(290816->327679) 00002000:00010000:1.0:1789130106.638413:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd6580 00000100:00100000:0.0:1789130106.647773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.647913:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835712 00000100:00100000:1.0:1789130106.647926:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835712 00002000:00100000:1.0:1789130106.648013:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (327680->364543) req@ffff90b4bfcd7c00 x1876037604835712/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.648027:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd7c00 with x1876037604835712 ext(327680->364543) 00002000:00010000:1.0:1789130106.648064:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd7c00 00000100:00100000:1.0:1789130106.648106:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130106.648118:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835712:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130106.662414:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604835712:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 14278us (14635us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130106.662434:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00002000:00100000:1.0:1789130106.662451:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (327680->364543) req@ffff90b4bfcd7c00 x1876037604835712/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.662465:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd7c00 with x1876037604835712 ext(327680->364543) 00002000:00010000:1.0:1789130106.662474:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd7c00 00000100:00100000:2.0:1789130106.671808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130106.672189:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835840 00000100:00100000:1.0:1789130106.672204:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835840 00002000:00100000:1.0:1789130106.672283:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (364544->401407) req@ffff90b382f8ed00 x1876037604835840/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130106.672297:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8ed00 with x1876037604835840 ext(364544->401407) 00002000:00010000:1.0:1789130106.672305:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8ed00 00000100:00100000:1.0:1789130106.672342:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789130106.672354:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604835840:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130106.711352:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604835840:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 38982us (39544us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789130106.711371:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00002000:00100000:3.0:1789130106.711388:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (364544->401407) req@ffff90b382f8ed00 x1876037604835840/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/440 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130106.711399:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8ed00 with x1876037604835840 ext(364544->401407) 00002000:00010000:3.0:1789130106.711408:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8ed00 00000100:00100000:3.0:1789130106.716411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130106.716665:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604835968 00000100:00100000:2.0:1789130106.716687:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604835968 00002000:00100000:2.0:1789130106.716762:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (401408->409599) req@ffff90b486f40780 x1876037604835968/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/0 e 0 to 0 dl 1789130117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130106.716774:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40780 with x1876037604835968 ext(401408->409599) 00002000:00010000:2.0:1789130106.716781:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f40780 00000100:00100000:2.0:1789130106.716810:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130106.716820:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835968:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130106.717157:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604835968:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 336us (761us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1789130106.717166:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00002000:00100000:2.0:1789130106.717174:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (401408->409599) req@ffff90b486f40780 x1876037604835968/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:577/0 lens 488/8632 e 0 to 0 dl 1789130117 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130106.717200:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40780 with x1876037604835968 ext(401408->409599) 00002000:00010000:2.0:1789130106.717204:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486f40780 00000100:00100000:3.0:1789130106.720368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130106.720712:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604836224 00000100:00100000:2.0:1789130106.720725:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604836224 00000100:00100000:2.0:1789130106.720789:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130106.720798:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:31952:x1876037604836224:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000001:00080000:2.0:1789130106.721365:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:2.0:1789130106.721568:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:31952:x1876037604836224:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 768us (1209us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1789130106.721578:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000020:00080000:2.0:1789130106.721585:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789130107.182892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.183144:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604836480 00000100:00100000:0.0:1789130107.183158:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604836480 00000100:00100000:0.0:1789130107.183241:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789130107.183254:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604836480:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789130107.183597:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604836480:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 344us (719us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1789130107.183650:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789130107.196487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.200851:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604836608 00000100:00100000:3.0:1789130107.200873:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604836608 00000100:00100000:2.0:1789130107.201928:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789130107.201946:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604836608:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130107.201981:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.202023:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8cab lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba33 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202128:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202148:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202164:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202182:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202229:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202237:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202675:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202686:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202694:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130107.202738:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:2.0:1789130107.202744:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130107.202768:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202783:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202792:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202799:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202806:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202824:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.202829:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202838:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202852:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.202855:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.202862:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202870:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce8cb2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202885:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202891:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202897:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202901:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.202904:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202910:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202929:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff90b4976b8500) 00010000:00010000:2.0:1789130107.202931:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.202935:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202941:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5000/0x5c74554e47ce8cb9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202983:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5a00/0x5c74554e47ce8cab lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba33 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.202998:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba33 expref: 20 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.203005:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130107.203008:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130107.203010:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5400, rc 0) 00000100:00100000:2.0:1789130107.203125:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604836608:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1183us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.203135:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130107.209303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.209855:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604836864 00000100:00100000:2.0:1789130107.209871:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604836864 00000100:00100000:2.0:1789130107.209946:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1789130107.209958:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604836864:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130107.210089:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130107.210126:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47ce8cc0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba33 expref: 20 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210171:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130107.210178:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130107.210230:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210248:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210260:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210280:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210287:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.210295:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.211435:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.211561:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.211574:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130107.214707:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].3, 64 off8408 00000004:00080000:2.0:1789130107.214729:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1270312126502ns, next at 1271312120847ns, rc = 0 00010000:00010000:2.0:1789130107.214861:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214883:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214898:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214907:0:36588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214913:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214920:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214942:0:36588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130107.214971:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214979:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.214985:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215005:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.215010:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215019:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215051:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130107.215054:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130107.215061:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215068:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8cd5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215095:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215101:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215106:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215112:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.215115:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215121:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215128:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.215131:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.215134:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.215139:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47ce8cc7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130107.215165:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000722bff33 reply state 00000000ff83726b transno 30064771113 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.215176:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130107.216387:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130107.216403:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.216415:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130107.216420:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.216430:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.216446:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130107.216449:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130107.216454:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.216459:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8cdc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.216478:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130107.216480:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130107.216482:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130107.216952:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604836864:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 6976us (7645us total) trans 30064771113 rc 0/0 00000100:00100000:2.0:1789130107.216964:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00010000:00010000:1.0:1789130107.221405:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221430:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221470:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221479:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.221485:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221495:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221521:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff90b4976b8b00) 00010000:00010000:1.0:1789130107.221525:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.221532:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.221539:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce8cce lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.242330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.243409:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604836992 00000100:00100000:2.0:1789130107.243427:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604836992 00000100:00100000:2.0:1789130107.243521:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:2.0:1789130107.243535:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604836992:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130107.243569:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.243598:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ce3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba3a expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243739:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243757:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243771:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243803:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243812:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243846:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243939:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243946:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243954:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243960:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.243966:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243974:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.243988:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.243992:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.243997:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244003:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8cea lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244018:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244024:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244047:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244053:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.244057:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244063:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244072:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff90b4976b8500) 00010000:00010000:2.0:1789130107.244074:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.244077:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244082:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8cf1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244126:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ce3 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba3a expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244138:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.244140:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.244143:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ce3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba3a expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.244152:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130107.244672:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604836992:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1136us (2354us total) trans 0 rc 301/301 00000100:00100000:2.0:1789130107.244694:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1789130107.259256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.259343:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604837120 00000100:00100000:0.0:1789130107.259357:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604837120 00000100:00100000:0.0:1789130107.259445:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130107.259458:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604837120:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789130107.259488:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130107.259518:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8cf8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba41 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.259678:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.259697:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.259715:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260002:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260028:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260052:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260142:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260150:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260176:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260184:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.260188:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260328:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260342:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130107.260345:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.260351:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260358:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8cff lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260373:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260380:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260386:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260391:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.260394:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260409:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260417:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff90b4909bd500) 00010000:00010000:1.0:1789130107.260420:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.260423:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260428:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d06 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260478:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8cf8 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba41 expref: 21 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260488:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130107.260491:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.260494:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8cf8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba41 expref: 21 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.260503:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:1.0:1789130107.260592:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604837120:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1136us (1351us total) trans 0 rc 301/301 00000100:00100000:1.0:1789130107.260668:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:3.0:1789130107.271470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.271655:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604837376 00000100:00100000:2.0:1789130107.271672:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604837376 00000100:00100000:2.0:1789130107.271771:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789130107.271784:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604837376:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130107.271832:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.271862:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d0d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba48 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272060:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272080:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272095:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272115:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272122:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272128:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272958:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272985:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.272994:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130107.273008:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789130107.273057:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273066:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273074:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273080:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.273086:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273095:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273110:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.273113:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.273119:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273126:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d14 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130107.273142:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000edbd666e reply state 00000000fabc0cd2 transno 30064771114 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.273159:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130107.273205:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d0d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273221:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.273228:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130107.273230:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130107.273232:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:2.0:1789130107.273343:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:31950:x1876037604837376:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1561us (1881us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1789130107.273353:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130107.276595:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.276684:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604837632 00000100:00100000:2.0:1789130107.276703:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604837632 00010000:00010000:1.0:1789130107.276715:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276729:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276760:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276777:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.276784:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276793:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276809:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff90b4976b8500) 00010000:00010000:1.0:1789130107.276812:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.276817:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.276822:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce8d1b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.277109:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130107.277128:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:31950:x1876037604837632:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130107.279702:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.279736:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.279753:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130107.281099:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771115 00000004:00010000:2.0:1789130107.281191:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000871698c5 reply state 000000009efe732d transno 30064771116 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.281206:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130107.281389:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604837632:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 4259us (4797us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1789130107.281401:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000020:00080000:2.0:1789130107.281409:0:36588:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130107.286486:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286505:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286512:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286518:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.286523:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286556:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286574:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:1.0:1789130107.286577:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.286583:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.286590:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8d30 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.292229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.292314:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604837888 00000100:00100000:2.0:1789130107.292323:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604837888 00000100:00100000:2.0:1789130107.292389:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789130107.292401:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604837888:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130107.292437:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.292458:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d37 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba4f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292587:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292626:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292639:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292656:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292663:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.292690:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293753:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293766:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293850:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130107.293863:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 0 00010000:00010000:2.0:1789130107.293957:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293965:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293971:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.293977:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.293981:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.294243:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.294258:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.294262:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.294278:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.294284:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d3e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130107.294298:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f360021a reply state 0000000055ec157b transno 30064771117 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.294306:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130107.294342:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d37 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.294357:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 26 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.294364:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:2.0:1789130107.294366:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130107.294368:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:2.0:1789130107.294513:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:31950:x1876037604837888:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 2113us (2295us total) trans 30064771117 rc 0/0 00000100:00100000:2.0:1789130107.294522:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:1.0:1789130107.296921:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.296948:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.296955:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.296961:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.296965:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.296973:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.296989:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff90b4976b8600) 00010000:00010000:1.0:1789130107.297002:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.297007:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.297046:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce8d45 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.307538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.307671:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604838144 00000100:00100000:1.0:1789130107.307681:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604838144 00000100:00100000:1.0:1789130107.307744:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:1.0:1789130107.307755:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604838144:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789130107.308092:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.308110:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.308121:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130107.308174:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771118 00000004:00010000:1.0:1789130107.308199:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000089f6aee2 reply state 00000000373fac91 transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.308207:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130107.308301:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:31950:x1876037604838144:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 548us (774us total) trans 30064771119 rc 0/0 00000100:00100000:1.0:1789130107.308311:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000020:00080000:1.0:1789130107.308315:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789130107.315167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.315283:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604838400 00000100:00100000:2.0:1789130107.315293:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604838400 00000100:00100000:2.0:1789130107.315359:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1789130107.315370:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604838400:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130107.315396:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.315418:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d61 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba56 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315509:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315524:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315537:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315552:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315559:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315566:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315746:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8d76 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315756:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8d76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315764:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8d76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130107.315776:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:2.0:1789130107.315884:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315902:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315908:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315914:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.315918:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315926:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315939:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.315942:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.315948:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315954:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce8d68 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315968:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315973:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315979:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315984:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.315993:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.315999:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.316008:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff90b4976b8100) 00010000:00010000:2.0:1789130107.316010:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.316013:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.316019:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8d6f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.316076:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8d61 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba56 expref: 13 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.316090:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8d76 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba56 expref: 12 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.316097:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:2.0:1789130107.316099:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:2.0:1789130107.316102:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130107.316159:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+12:31954:x1876037604838400:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 790us (1001us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1789130107.316167:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:1.0:1789130107.316500:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316509:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316523:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316529:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.316532:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316539:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316548:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.316551:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.316554:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.316560:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8d5a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.320182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.320354:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604838656 00000100:00100000:1.0:1789130107.320364:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604838656 00000100:00100000:1.0:1789130107.320430:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1789130107.320441:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+12:31954:x1876037604838656:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130107.320466:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130107.320489:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8d84 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba5d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320563:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320578:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320625:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320653:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320660:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320667:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320804:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8d99 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320813:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8d99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.320821:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8d99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130107.320830:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:1.0:1789130107.320926:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321087:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321094:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321100:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.321114:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321122:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321135:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130107.321138:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.321143:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321149:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8d8b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321161:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321167:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321173:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321178:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.321181:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321186:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321193:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff90b4909bd500) 00010000:00010000:1.0:1789130107.321196:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.321206:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321212:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8d92 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321255:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8d84 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba5d expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321269:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8d99 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba5d expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.321277:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:1.0:1789130107.321279:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130107.321281:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130107.321346:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+14:31954:x1876037604838656:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 906us (1173us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1789130107.321355:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130107.325504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.325581:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604838912 00000100:00100000:2.0:1789130107.325590:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604838912 00000100:00100000:2.0:1789130107.325682:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789130107.325692:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+14:31954:x1876037604838912:12345-192.168.201.39@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1789130107.325722:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130107.325745:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8d76 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba56 expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.325761:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:2.0:1789130107.325766:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130107.325813:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604838912:12345-192.168.201.39@tcp:103:mmap_sanity.0 Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.325821:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1789130107.332651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.332838:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839040 00000100:00100000:2.0:1789130107.332847:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839040 00000100:00100000:2.0:1789130107.332908:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130107.332918:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604839040:12345-192.168.201.39@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1789130107.333031:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.333060:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.333069:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.333102:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.333115:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 27 pid: 36589 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.333149:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626793216:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130107.333249:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497e2acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789130107.334558:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130107.335247:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626793216:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130107.335273:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.336168:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.336264:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839168 00000100:00100000:0.0:1789130107.336273:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839168 00010000:00010000:0.0:1789130107.336321:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 28 pid: 36589 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.336367:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1789130107.336377:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037604839168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130107.336395:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130107.336402:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 28 pid: 36589 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336416:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 28 pid: 36589 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336441:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8d4c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba4f expref: 28 pid: 36589 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336479:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:0.0:1789130107.336485:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336495:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336503:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.336534:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130107.336593:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604839168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 217us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.336628:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:2.0:1789130107.336787:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.336795:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130107.337139:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].2, 136 off8464 00000100:00100000:2.0:1789130107.337213:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604839040:12345-192.168.201.39@tcp:58:mmap_sanity.0 Request processed in 4296us (4620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.337223:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1789130107.344372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.344470:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839296 00000100:00100000:1.0:1789130107.344479:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839296 00000100:00100000:1.0:1789130107.344544:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130107.344554:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604839296:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130107.344574:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130107.344595:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba64 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344705:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344735:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344754:0:38723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344767:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344781:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.344784:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130107.344788:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.344795:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00100000:1.0:1789130107.344854:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+14:31954:x1876037604839296:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 302us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130107.344861:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000040:00080000:2.0:1789130107.461979:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130107.462076:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130107.462152:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1789130107.462162:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130107.462844:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626793344:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130107.463112:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497e2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130107.481150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.481417:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626793344:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130107.481756:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839424 00000100:00100000:3.0:1789130107.481763:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839424 00000100:00100000:3.0:1789130107.481825:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130107.481836:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:31955:x1876037604839424:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130107.481896:0:36589:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130107.482017:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:31955:x1876037604839424:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 182us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.482026:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130107.486125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.486312:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839552 00000100:00100000:1.0:1789130107.486323:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839552 00000100:00100000:1.0:1789130107.486381:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1789130107.486392:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:31955:x1876037604839552:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130107.486480:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486497:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486529:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486546:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486553:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486560:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486585:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486593:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486647:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130107.486691:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:1.0:1789130107.486696:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130107.486719:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486730:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486736:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486753:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486758:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.486762:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486769:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486781:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:1.0:1789130107.486784:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.486788:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486795:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8db5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486807:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486813:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486818:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486822:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.486825:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486840:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486847:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x20b1fb9b (ffff90b4909bd500) 00010000:00010000:1.0:1789130107.486850:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.486852:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486857:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8dbc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486870:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486875:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486880:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486886:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.486888:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486893:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486899:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.486901:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.486904:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.486918:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8dc3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.486985:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:31955:x1876037604839552:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 594us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130107.486993:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:0.0:1789130107.489967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.490083:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839808 00000100:00100000:3.0:1789130107.490093:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839808 00000100:00100000:3.0:1789130107.490161:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789130107.490172:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:31955:x1876037604839808:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130107.490201:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130107.490224:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8dca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba6b expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490441:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490800:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490813:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130107.490828:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:3.0:1789130107.490948:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490956:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490962:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490967:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130107.490972:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.490978:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.491181:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:3.0:1789130107.491186:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130107.491192:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.491199:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8dd1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.491246:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8dca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba6b expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.491420:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789130107.491423:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130107.491428:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8dca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba6b expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.491521:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3e00, rc 0) 00000100:00100000:3.0:1789130107.493343:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:31955:x1876037604839808:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2453us (2666us total) trans 30064771122 rc 301/301 00000100:00100000:3.0:1789130107.493359:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1789130107.501412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.505895:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604839936 00000100:00100000:1.0:1789130107.505913:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604839936 00000100:00100000:1.0:1789130107.506322:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130107.506335:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:31955:x1876037604839936:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130107.506373:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130107.506489:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:31955:x1876037604839936:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 156us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130107.506498:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1789130107.511196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.512994:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604840192 00000100:00100000:1.0:1789130107.513010:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604840192 00000100:00100000:1.0:1789130107.513096:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:1.0:1789130107.513107:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:31955:x1876037604840192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130107.513130:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130107.513154:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ddf lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba72 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130107.514014:0:38723:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0xa5:0x0], count =29 00000004:00080000:1.0:1789130107.514023:0:38723:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0xa5:0x0]+29 in llog 00000004:00080000:1.0:1789130107.514095:0:38723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc2:0x0], index 0: 0 00010000:00010000:1.0:1789130107.514309:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8de6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.514333:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8de6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.514347:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8de6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.514416:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ddf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba72 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.514434:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8de6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba72 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.514442:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130107.514445:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130107.514448:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:1.0:1789130107.514516:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:31955:x1876037604840192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1410us (3330us total) trans 30064771123 rc 0/0 00000100:00100000:1.0:1789130107.514526:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130107.531174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.531344:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604840448 00000100:00100000:2.0:1789130107.531355:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604840448 00000100:00100000:2.0:1789130107.531419:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130107.531440:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:31955:x1876037604840448:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.531499:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130107.531529:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8de6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba72 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531814:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130107.531830:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130107.531855:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531870:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531882:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531897:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531904:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.531911:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532003:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532011:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532028:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532045:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.532050:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532058:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532066:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130107.532069:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.532072:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532078:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8df4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532089:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532095:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532102:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532105:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.532108:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532124:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532132:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x7de1f7b3 (ffff90b4976b8100) 00010000:00010000:2.0:1789130107.532134:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130107.532137:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.532142:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8dfb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7de1f7b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.532235:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31955:x1876037604840448:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 798us (1070us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130107.532244:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130107.536918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.537112:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604840576 00000100:00100000:1.0:1789130107.537122:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604840576 00000100:00100000:1.0:1789130107.537191:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130107.537203:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:31955:x1876037604840576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130107.537223:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130107.537250:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8e02 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba79 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537298:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537327:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537339:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537437:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8e02 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537455:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.537465:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130107.537468:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130107.537471:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362600, rc 0) 00000100:00100000:1.0:1789130107.537537:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:31955:x1876037604840576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 336us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130107.537545:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130107.541161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.541248:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604840832 00000100:00100000:2.0:1789130107.541259:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604840832 00000100:00100000:2.0:1789130107.541328:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130107.541339:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:31955:x1876037604840832:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.541442:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.541460:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.541473:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130107.542367:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].2, 88 off8344 00000004:00080000:2.0:1789130107.542383:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1270639780494ns, next at 1271639777537ns, rc = 0 00000004:00010000:2.0:1789130107.542496:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003843a674 reply state 00000000e416229b transno 30064771124 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.542506:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130107.542657:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31955:x1876037604840832:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1317us (1504us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1789130107.542665:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:0.0:1789130107.547574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130107.548878:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548896:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548903:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548910:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.548915:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548941:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548961:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130107.548964:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130107.548969:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.548976:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e10 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.549162:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604840960 00000100:00100000:2.0:1789130107.549172:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604840960 00000100:00100000:2.0:1789130107.549233:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1789130107.549244:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+31:31955:x1876037604840960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.549437:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130107.549460:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba80 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.549523:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 32 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.549538:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 32 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.550376:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130107.550382:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130107.550385:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130107.550464:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:31955:x1876037604840960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1220us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.550473:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130107.554678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.554964:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604841088 00000100:00100000:2.0:1789130107.554974:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604841088 00000100:00100000:2.0:1789130107.555057:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789130107.555069:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604841088:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789130107.555488:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130107.555545:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604841088:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 477us (874us total) trans 30064771074 rc 0/0 00000100:00100000:2.0:1789130107.555564:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130107.563472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.563995:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604841344 00000100:00100000:1.0:1789130107.564007:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604841344 00000100:00100000:1.0:1789130107.564081:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789130107.564092:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:31955:x1876037604841344:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130107.564344:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31955:x1876037604841344:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 254us (884us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1789130107.564352:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789130107.566769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.573328:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604841600 00000100:00100000:2.0:1789130107.573345:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604841600 00000100:00100000:2.0:1789130107.573444:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130107.573457:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31955:x1876037604841600:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130107.573644:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31955:x1876037604841600:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 148us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.573653:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789130107.576924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.577056:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604841728 00000100:00100000:3.0:1789130107.577065:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604841728 00000100:00100000:3.0:1789130107.577132:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130107.577143:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:31955:x1876037604841728:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130107.577164:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130107.577188:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e1e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba87 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577264:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577281:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577292:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130107.577330:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130107.577347:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577373:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e1e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba87 expref: 35 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577409:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba87 expref: 34 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.577417:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130107.577420:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130107.577423:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3600, rc 0) 00000100:00100000:3.0:1789130107.577487:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:31955:x1876037604841728:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 346us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.577495:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1789130107.586441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.586559:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604841856 00000100:00100000:1.0:1789130107.586571:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604841856 00000100:00100000:0.0:1789130107.587318:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130107.587334:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604841856:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130107.587353:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130107.587373:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba8e expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130107.587400:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f57b, blocks: 0x1 00010000:00010000:0.0:1789130107.587419:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=1270s v=(0 0) 00010000:00010000:0.0:1789130107.587423:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.587433:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.587452:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.587465:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:0.0:1789130107.587568:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604841856:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 238us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.587576:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789130107.594446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.597828:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842112 00000100:00100000:2.0:1789130107.597851:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842112 00000100:00100000:2.0:1789130107.598094:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130107.598107:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:31955:x1876037604842112:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130107.598283:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:31955:x1876037604842112:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 179us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.598292:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130107.610154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.615209:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842240 00000100:00100000:3.0:1789130107.615234:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842240 00000100:00100000:0.0:1789130107.620481:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789130107.620500:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:31955:x1876037604842240:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130107.620527:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130107.620554:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba95 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.620655:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.620675:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.620680:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.620686:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.620730:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.620745:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.620764:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626793472:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130107.620881:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130107.627397:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626793472:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130107.627443:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.627496:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:1.0:1789130107.627571:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:31955:x1876037604842240:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 7075us (17433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130107.627581:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789130107.630809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.630964:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842368 00000100:00100000:0.0:1789130107.630989:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842368 00010000:00010000:0.0:1789130107.631062:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.631120:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789130107.631132:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604842368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130107.631154:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130107.631206:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.631223:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.631254:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042208b73/0x5c74554e47ce8e2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba8e expref: 8 pid: 37273 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.631275:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.631280:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.631290:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.631302:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.631353:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.631370:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383357480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626793600:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130107.631468:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130107.641976:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383357480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626793600:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130107.642028:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130107.642131:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604842368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 10999us (11338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.642144:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789130107.658159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.658309:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842496 00000100:00100000:3.0:1789130107.658323:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842496 00002000:00100000:3.0:1789130107.658388:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff90b383355a40 x1876037604842496/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789130107.658402:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383355a40 with x1876037604842496 ext(0->409599) 00002000:00010000:3.0:1789130107.658411:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383355a40 00000100:00100000:3.0:1789130107.658453:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130107.658463:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604842496:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130107.706652:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604842496:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 48170us (48489us total) trans 30064771075 rc 0/0 00000100:00100000:2.0:1789130107.706673:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00002000:00100000:2.0:1789130107.706695:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff90b383355a40 x1876037604842496/t30064771075(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:578/0 lens 488/448 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789130107.706733:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383355a40 with x1876037604842496 ext(0->409599) 00002000:00010000:2.0:1789130107.706743:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383355a40 00000100:00100000:0.0:1789130107.720361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.720509:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842624 00000100:00100000:3.0:1789130107.720519:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842624 00000100:00100000:3.0:1789130107.720686:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130107.720698:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:31955:x1876037604842624:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130107.815009:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771112 is committed 00000001:00080000:2.0:1789130107.815073:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771125 is committed 00000001:00080000:2.0:1789130107.815086:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771121 is committed 00000004:00080000:2.0:1789130107.815115:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1789130107.815152:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789130107.815183:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487d55180 refcount 2 committed 0 result 0 batchid 25769803897 00000020:00080000:2.0:1789130107.815191:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486f62a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487d55d80 00000020:00080000:2.0:1789130107.815194:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486f62600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b383106c00 00000020:00080000:2.0:1789130107.815423:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803897 committed batchid 21474836520 00000020:00080000:2.0:1789130107.815667:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000100:00100000:2.0:1789130107.815693:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626793728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130107.815805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130107.815893:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130107.815900:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626793856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130107.815934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130107.816400:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626793728 00000100:00100000:2.0:1789130107.816410:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626793728 00000100:00100000:2.0:1789130107.816521:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626793856 00000100:00100000:2.0:1789130107.816525:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626793856 00000100:00100000:2.0:1789130107.816551:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130107.816560:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626793728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130107.816810:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1789130107.816814:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1789130107 00002000:00010000:2.0:1789130107.816834:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130107.816837:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789130107 -> 1789130107 00002000:00010000:2.0:1789130107.816839:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130107.816908:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626793728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 347us (1102us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1789130107.816917:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130107.817252:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130107.817263:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626793856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789130107.817283:0:37658:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:194 count 1 00010000:00010000:2.0:1789130107.817309:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.817334:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 5 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.817344:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130107.817349:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130107.817354:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.817394:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 5 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.817411:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 5 pid: 37273 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.817427:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626793984:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130107.817660:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefcc0 going to sleep for 11 seconds 00000004:00080000:2.0:1789130107.817722:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382f8cf00/2, rc 0, transno 30064771076 00000100:00100000:2.0:1789130107.817730:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626793728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130107.817863:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:31955:x1876037604842624:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 97166us (97511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130107.817874:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00080000:1.0:1789130107.819220:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130107.826254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.826385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.826480:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842752 00000100:00100000:0.0:1789130107.826492:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842752 00000100:00100000:0.0:1789130107.826579:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130107.826590:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604842752:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789130107.826850:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604842880 00000100:00100000:3.0:1789130107.826856:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604842880 00010000:00010000:3.0:1789130107.826907:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 6 pid: 37273 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.826949:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789130107.826958:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604842880:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130107.826971:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130107.826977:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 6 pid: 37273 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.826993:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 6 pid: 37273 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.827037:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130107.827042:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130107.827049:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.827062:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.827105:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130107.827177:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604842880:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.827186:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00080000:1.0:1789130107.827423:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789130107.827748:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce8c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba2c expref: 5 pid: 37273 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.827780:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626793984:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130107.828850:0:37658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.828870:0:37658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.828879:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.828893:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.828901:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.828950:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130107.829691:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626793856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12426us (13751us total) trans 30064771079 rc 0/0 00000100:00100000:2.0:1789130107.829704:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1789130107.830481:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382f8c780/2, rc 0, transno 30064771079 00000100:00100000:2.0:1789130107.830491:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626793856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789130107.832034:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130107.832052:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.832070:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130107.832076:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.832089:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.832117:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.832125:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce8e3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.832181:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130107.832183:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130107.832185:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130107.868234:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604842752:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 41626us (41977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.868253:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000001:00080000:0.0:1789130107.868303:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771076 is committed 00000001:00080000:0.0:1789130107.868316:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771074 is committed 00000001:00080000:0.0:1789130107.868328:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771075 is committed 00000100:00100000:1.0:1789130107.872393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.872507:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843136 00000100:00100000:3.0:1789130107.872522:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843136 00000100:00100000:3.0:1789130107.872820:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789130107.872834:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:31955:x1876037604843136:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130107.872909:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130107.872948:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8e25 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba87 expref: 14 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.872970:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130107.872988:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130107.873044:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.873061:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.873075:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130107.873289:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000577c1660 reply state 000000008e8eb8c5 transno 30064771126 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.873300:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130107.873452:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31955:x1876037604843136:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 621us (1070us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1789130107.873460:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1789130107.877358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.878254:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843264 00000100:00100000:2.0:1789130107.878273:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843264 00000100:00100000:2.0:1789130107.878363:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789130107.878376:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604843264:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130107.879224:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1789130107.879233:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1789130107 -> 1789130107 00002000:00010000:2.0:1789130107.879236:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1789130107 00002000:00010000:2.0:1789130107.879239:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789130107 -> 1789130107 00002000:00010000:2.0:1789130107.879241:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:2.0:1789130107.879351:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604843264:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 973us (2007us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1789130107.879362:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130107.882465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.882824:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843520 00000100:00100000:2.0:1789130107.882839:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843520 00000100:00100000:2.0:1789130107.882924:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789130107.882936:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:31955:x1876037604843520:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.883147:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.883190:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.883201:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.883250:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.883266:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.883283:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626794112:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130107.883399:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefe40 going to sleep for 11 seconds 00010000:00010000:1.0:1789130107.886708:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886738:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886747:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886754:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.886761:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886770:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886806:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130107.886810:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.886816:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.886823:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8e41 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.888470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.888553:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843648 00000100:00100000:3.0:1789130107.888566:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843648 00010000:00010000:3.0:1789130107.888664:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.888713:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130107.888726:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604843648:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130107.888745:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130107.888754:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.888768:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 15 pid: 38723 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.888808:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130107.888815:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.888829:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.888839:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.888866:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130107.888941:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604843648:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 218us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.888966:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:2.0:1789130107.891121:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8e09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba79 expref: 14 pid: 38723 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.891153:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626794112:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130107.891189:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891200:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891205:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891248:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891276:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891284:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891291:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130107.891296:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891304:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891322:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130107.891325:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130107.891331:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.891337:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e48 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.891486:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:31955:x1876037604843520:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 8550us (9035us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130107.891497:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789130107.895234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.895362:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843776 00000100:00100000:2.0:1789130107.895375:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843776 00000100:00100000:2.0:1789130107.895486:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130107.895498:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604843776:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.895571:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.895646:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.895667:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130107.895673:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130107.895679:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.895731:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.895748:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 7 pid: 37276 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.895768:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626794240:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130107.895877:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130107.899469:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626794240:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130107.899512:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.900643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.902002:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604843904 00000100:00100000:3.0:1789130107.902021:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604843904 00010000:00010000:0.0:1789130107.902246:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.902307:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130107.902320:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604843904:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130107.902344:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130107.902376:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.902391:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.902421:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba95 expref: 8 pid: 37276 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.902442:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130107.902470:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130107.902478:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.902490:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.902538:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130107.902803:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604843904:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 336us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.902813:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:3.0:1789130107.904220:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904241:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904285:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904294:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904303:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904311:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130107.904316:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904326:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904349:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130107.904379:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce8e4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.904509:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604843776:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 9009us (9287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130107.904521:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130107.907901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.908013:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844160 00000100:00100000:2.0:1789130107.908039:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844160 00000100:00100000:2.0:1789130107.908120:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130107.908134:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:31955:x1876037604844160:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130107.908281:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908304:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908322:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908718:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908734:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908743:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908793:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130107.908811:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 14 pid: 38723 timeout: 1371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130107.908832:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626794368:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130107.908959:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130107.913165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.913315:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626794368:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130107.913351:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130107.913579:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844288 00000100:00100000:3.0:1789130107.913588:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844288 00010000:00010000:3.0:1789130107.913966:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 15 pid: 38723 timeout: 1371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130107.914101:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789130107.914118:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604844288:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130107.914138:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130107.914148:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 15 pid: 38723 timeout: 1371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914163:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 15 pid: 38723 timeout: 1371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914192:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8e17 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba80 expref: 15 pid: 38723 timeout: 1371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914210:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130107.914215:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914225:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914256:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.914291:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130107.914364:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037604844288:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 253us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.914374:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00010000:00010000:1.0:1789130107.914505:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.914514:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130107.915012:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771127 00000001:00080000:1.0:1789130107.915220:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771128 00000001:00080000:1.0:1789130107.915270:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771129 00000100:00100000:1.0:1789130107.915376:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626794496:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130107.915451:0:36587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130107.915494:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130107.915727:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626794496 00000100:00100000:0.0:1789130107.915736:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626794496 00000100:00100000:0.0:1789130107.915787:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130107.916230:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626794496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130107.916375:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626794496:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.916384:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130107.916441:0:36587:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:0.0:1789130107.916448:0:36587:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382f8cf00, transno 30064771076 00000100:00100000:0.0:1789130107.916465:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626794496:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789130107.921213:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771130 00000100:00100000:0.0:1789130107.921373:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383354780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626794624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130107.921473:0:36587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130107.921717:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130107.922443:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626794624 00000100:00100000:3.0:1789130107.922455:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626794624 00000100:00100000:2.0:1789130107.922953:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130107.922966:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626794624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130107.923520:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36587:x1876037626794624:12345-0@lo:1000:mdt00_000.0 Request processed in 554us (2045us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1789130107.923530:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130107.923871:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383354780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626794624:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789130107.924147:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924159:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924167:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924174:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.924179:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924189:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924227:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130107.924230:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130107.924238:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924246:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e5d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924287:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924294:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924300:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924305:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.924308:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924315:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924323:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.924327:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130107.924336:0:36587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924349:0:36587:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924366:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.924411:0:36587:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.924427:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626794752:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130107.924568:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130107.929228:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626794752:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130107.929274:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929287:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8da7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929332:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929348:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929362:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929374:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929381:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929410:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929417:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.929426:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929435:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929451:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.929454:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130107.929458:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929464:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e64 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929474:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929481:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929486:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929491:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130107.929494:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929516:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929525:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130107.929528:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130107.929531:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.929536:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8e56 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130107.929913:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:31955:x1876037604844160:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 21777us (22021us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1789130107.929928:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000020:00080000:1.0:1789130107.929938:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789130107.930459:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130107.930466:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130107.930501:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1789130107.930508:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130107.935080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.935242:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844416 00000100:00100000:0.0:1789130107.935257:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844416 00000100:00100000:0.0:1789130107.935337:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1789130107.935348:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604844416:12345-192.168.201.39@tcp:49:mmap_sanity.0 00000100:00100000:0.0:1789130107.935546:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604844416:12345-192.168.201.39@tcp:49:mmap_sanity.0 Request processed in 198us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.935555:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130107.940160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.940230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.940502:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844544 00000100:00100000:0.0:1789130107.940516:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844544 00000100:00100000:0.0:1789130107.940715:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789130107.940728:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:31954:x1876037604844544:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789130107.940755:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130107.940788:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aba9c expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130107.940831:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa3f57b, atime: 0x6aa3f57b, ctime: 0x6aa3f57b, blocks: 0x403 00010000:00010000:0.0:1789130107.940860:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=1271s v=(0 0) 00010000:00010000:0.0:1789130107.940865:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130107.940876:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.940894:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130107.940911:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00080000:3.0:1789130107.941107:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130107.941151:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:31954:x1876037604844544:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 425us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130107.941159:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130107.941235:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844800 00000100:00100000:1.0:1789130107.941240:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844800 00000100:00100000:1.0:1789130107.941289:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130107.941298:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7829050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:31955:x1876037604844800:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130107.942194:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130107.942311:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771132 00010000:00010000:1.0:1789130107.942370:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942387:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942400:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942419:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942425:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942431:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.942459:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130107.942568:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7829050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31955:x1876037604844800:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1269us (2334us total) trans 30064771133 rc 0/0 00000100:00100000:1.0:1789130107.942577:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000020:00080000:1.0:1789130107.942583:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130107.943873:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130107.943886:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.943897:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130107.943901:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.943912:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.943934:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130107.943937:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130107.943944:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.943970:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e72 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130107.944010:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130107.944012:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130107.944014:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130107.948086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.948213:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604844928 00000100:00100000:0.0:1789130107.948250:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604844928 00002000:00100000:0.0:1789130107.948328:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff90b382f8cf00 x1876037604844928/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130107.948342:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8cf00 with x1876037604844928 ext(0->4095) 00002000:00010000:0.0:1789130107.948350:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8cf00 00000100:00100000:0.0:1789130107.948432:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789130107.948444:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604844928:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:0.0:1789130107.949033:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604844928:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 579us (955us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789130107.949045:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00002000:00100000:0.0:1789130107.949054:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff90b382f8cf00 x1876037604844928/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/4536 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130107.949064:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8cf00 with x1876037604844928 ext(0->4095) 00002000:00010000:0.0:1789130107.949068:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8cf00 00000100:00100000:3.0:1789130107.953513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130107.953905:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845056 00000100:00100000:0.0:1789130107.953919:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845056 00002000:00100000:1.0:1789130107.954072:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff90b3832b6580 x1876037604845056/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.954086:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6580 with x1876037604845056 ext(4096->8191) 00002000:00010000:1.0:1789130107.954095:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b6580 00000100:00100000:1.0:1789130107.954140:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789130107.954152:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604845056:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130107.954429:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604845056:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 278us (929us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789130107.954439:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00002000:00100000:1.0:1789130107.954446:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff90b3832b6580 x1876037604845056/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/4536 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.954455:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6580 with x1876037604845056 ext(4096->8191) 00002000:00010000:1.0:1789130107.954459:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b6580 00000100:00100000:3.0:1789130107.958155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.958252:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845184 00000100:00100000:1.0:1789130107.958264:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845184 00002000:00100000:1.0:1789130107.958333:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff90b3832b52c0 x1876037604845184/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.958347:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b52c0 with x1876037604845184 ext(8192->12287) 00002000:00010000:1.0:1789130107.958372:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b52c0 00000100:00100000:1.0:1789130107.958410:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789130107.958421:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604845184:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130107.958736:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604845184:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 315us (597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789130107.958746:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00002000:00100000:1.0:1789130107.958753:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff90b3832b52c0 x1876037604845184/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/4536 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.958762:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b52c0 with x1876037604845184 ext(8192->12287) 00002000:00010000:1.0:1789130107.958766:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b52c0 00000100:00100000:0.0:1789130107.965827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130107.966201:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845312 00000100:00100000:1.0:1789130107.966216:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845312 00002000:00100000:1.0:1789130107.966287:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff90b3833543c0 x1876037604845312/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.966299:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3833543c0 with x1876037604845312 ext(12288->69631) 00002000:00010000:1.0:1789130107.966308:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3833543c0 00000100:00100000:1.0:1789130107.966347:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130107.966360:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604845312:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130107.970137:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604845312:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 3761us (4305us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1789130107.970156:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00002000:00100000:1.0:1789130107.970175:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff90b3833543c0 x1876037604845312/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/440 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.970215:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3833543c0 with x1876037604845312 ext(12288->69631) 00002000:00010000:1.0:1789130107.970224:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3833543c0 00000100:00100000:3.0:1789130107.977337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130107.977855:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845440 00000100:00100000:2.0:1789130107.977871:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845440 00002000:00100000:2.0:1789130107.977946:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff90b3832b6940 x1876037604845440/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130107.977961:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6940 with x1876037604845440 ext(69632->106495) 00002000:00010000:2.0:1789130107.977970:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b6940 00000100:00100000:2.0:1789130107.978133:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130107.978146:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604845440:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130107.983296:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604845440:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 5134us (5959us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130107.983315:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00002000:00100000:1.0:1789130107.983332:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff90b3832b6940 x1876037604845440/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/440 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130107.983345:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6940 with x1876037604845440 ext(69632->106495) 00002000:00010000:1.0:1789130107.983354:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b6940 00000100:00100000:2.0:1789130107.989737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130107.989895:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845568 00000100:00100000:3.0:1789130107.989910:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845568 00002000:00100000:3.0:1789130107.989994:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff90b382f8fc00 x1876037604845568/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/0 e 0 to 0 dl 1789130118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130107.990006:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8fc00 with x1876037604845568 ext(106496->143359) 00002000:00010000:3.0:1789130107.990013:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8fc00 00000100:00100000:3.0:1789130107.990080:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789130107.990091:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604845568:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130108.000918:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604845568:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 10810us (11178us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789130108.000939:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00002000:00100000:3.0:1789130108.000961:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff90b382f8fc00 x1876037604845568/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:578/0 lens 488/440 e 0 to 0 dl 1789130118 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130108.000987:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8fc00 with x1876037604845568 ext(106496->143359) 00002000:00010000:3.0:1789130108.000998:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8fc00 00000100:00100000:2.0:1789130108.006342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130108.006452:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845696 00000100:00100000:1.0:1789130108.006466:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845696 00002000:00100000:1.0:1789130108.006543:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff90b382f8f0c0 x1876037604845696/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:579/0 lens 488/0 e 0 to 0 dl 1789130119 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130108.006558:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8f0c0 with x1876037604845696 ext(143360->180223) 00002000:00010000:1.0:1789130108.006567:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8f0c0 00000100:00100000:1.0:1789130108.006741:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789130108.006755:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604845696:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130108.012568:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604845696:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 5798us (6225us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789130108.012587:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00002000:00100000:3.0:1789130108.012645:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff90b382f8f0c0 x1876037604845696/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:579/0 lens 488/440 e 0 to 0 dl 1789130119 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130108.012669:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8f0c0 with x1876037604845696 ext(143360->180223) 00002000:00010000:3.0:1789130108.012679:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8f0c0 00000100:00100000:1.0:1789130108.017770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130108.018007:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845824 00000100:00100000:3.0:1789130108.018054:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845824 00002000:00100000:3.0:1789130108.018138:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff90b381d49e00 x1876037604845824/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:579/0 lens 488/0 e 0 to 0 dl 1789130119 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130108.018152:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d49e00 with x1876037604845824 ext(180224->217087) 00002000:00010000:3.0:1789130108.018160:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381d49e00 00000100:00100000:3.0:1789130108.018201:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789130108.018214:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604845824:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130108.027092:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604845824:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8859us (9317us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130108.027114:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00002000:00100000:2.0:1789130108.027133:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff90b381d49e00 x1876037604845824/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:579/0 lens 488/440 e 0 to 0 dl 1789130119 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130108.027147:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d49e00 with x1876037604845824 ext(180224->217087) 00002000:00010000:2.0:1789130108.027157:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381d49e00 00010000:00010000:1.0:1789130108.358489:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130109.191504:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130109.191536:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626794880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130109.191675:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130109.191683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626795264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130109.191732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130109.191802:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626795136:0@lo:400:kworker.0 00000100:00100000:0.0:1789130109.191853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130109.191914:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626795008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.191979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130109.192017:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626795520:0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.192047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130109.192069:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130109.192074:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626795392:0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.192099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130109.192133:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626794880 00000100:00100000:1.0:1789130109.192143:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626794880 00000100:00100000:1.0:1789130109.192210:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130109.192221:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626794880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130109.192285:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130109.192340:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626794880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130109.192349:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130109.192405:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626794880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130109.192452:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795264 00000100:00100000:1.0:1789130109.192457:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795264 00000100:00100000:1.0:1789130109.192482:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795136 00000100:00100000:1.0:1789130109.192485:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795136 00000100:00100000:1.0:1789130109.192511:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130109.192518:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626795264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.192992:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626795264:12345-0@lo:400:kworker.0 Request processed in 471us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130109.193011:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130109.193029:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130109.193037:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626795136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.193086:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626795136:12345-0@lo:400:kworker.0 Request processed in 51us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130109.193093:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130109.193127:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795008 00000100:00100000:1.0:1789130109.193132:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795008 00000100:00100000:1.0:1789130109.193160:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789130109.193166:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0cbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626795008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130109.193201:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0cbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626795008:12345-0@lo:400:kworker.0 Request processed in 35us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130109.193208:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789130109.193250:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626795008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.193973:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795520 00000100:00100000:3.0:1789130109.193981:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795520 00000100:00100000:3.0:1789130109.194038:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795392 00000100:00100000:3.0:1789130109.194042:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795392 00000100:00100000:3.0:1789130109.194070:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130109.194080:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626795520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.194151:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626795520:12345-0@lo:400:kworker.0 Request processed in 73us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130109.194159:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130109.194176:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130109.194183:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626795392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.194215:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626795392:12345-0@lo:400:kworker.0 Request processed in 33us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130109.194221:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789130109.194243:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130109.194248:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130109.194252:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130109.194344:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626795392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.194356:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626795520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130109.197816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626795264:0@lo:400:kworker.0 00000100:00100000:0.0:1789130109.198284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626795136:0@lo:400:kworker.0 00000100:00100000:0.0:1789130109.198300:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626795648:0@lo:400:kworker.0 00000100:00100000:0.0:1789130109.198397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130109.198565:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626795648 00000100:00100000:3.0:1789130109.198575:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626795648 00000100:00100000:3.0:1789130109.198702:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789130109.198713:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626795648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.198786:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626795648:12345-0@lo:400:kworker.0 Request processed in 74us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130109.198795:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789130109.199141:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130109.199226:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626795648:0@lo:400:kworker.0 00000100:00100000:3.0:1789130109.319299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130109.323250:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604845952 00000100:00100000:1.0:1789130109.323274:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604845952 00000100:00100000:1.0:1789130109.323405:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130109.323420:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604845952:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130109.323457:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130109.323488:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e79 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abaa3 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130109.323570:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e79 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaa3 expref: 20 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130109.323587:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e79 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaa3 expref: 20 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130109.323621:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130109.323646:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130109.323651:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00080000:0.0:1789130109.323833:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130109.329342:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604845952:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 5904us (10036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130109.329361:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:0.0:1789130109.334471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130109.334642:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846080 00000100:00100000:2.0:1789130109.334656:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846080 00000100:00100000:2.0:1789130109.334812:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130109.334825:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:31950:x1876037604846080:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130109.334850:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130109.334877:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abaaa expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.334921:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 5 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.334931:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130109.334936:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130109.334943:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.335011:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 5 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.335028:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 5 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130109.335071:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626795776:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130109.335192:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefd80 going to sleep for 11 seconds 00000100:00080000:0.0:1789130109.335530:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130109.340703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130109.340984:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626795776:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130109.341048:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.341079:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:3.0:1789130109.342162:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846208 00000100:00100000:3.0:1789130109.342177:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846208 00002000:00100000:3.0:1789130109.342267:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->204799) req@ffff90b383357480 x1876037604846208/t0(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:580/0 lens 488/0 e 0 to 0 dl 1789130120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130109.342281:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383357480 with x1876037604846208 ext(0->204799) 00010000:00010000:3.0:1789130109.342294:0:37280:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 6 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130109.342313:0:37280:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 6 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130109.342323:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b383357480 00000100:00100000:3.0:1789130109.342361:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789130109.342372:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604846208:12345-192.168.201.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789130109.342899:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:31950:x1876037604846080:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 8073us (8441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130109.342909:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00080000:0.0:1789130109.343575:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130109.364248:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604846208:12345-192.168.201.39@tcp:4:ldlm_bl.0 Request processed in 21858us (23540us total) trans 30064771079 rc 0/0 00000100:00100000:2.0:1789130109.364269:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:2.0:1789130109.364291:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->204799) req@ffff90b383357480 x1876037604846208/t30064771079(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:580/0 lens 488/448 e 0 to 0 dl 1789130120 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130109.364303:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383357480 with x1876037604846208 ext(0->204799) 00010000:00010000:2.0:1789130109.364319:0:37280:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130109.364346:0:37280:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130109.364355:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b383357480 00000100:00100000:1.0:1789130109.373174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130109.373778:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846336 00000100:00100000:0.0:1789130109.373929:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846336 00010000:00010000:0.0:1789130109.374143:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130109.374205:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130109.374219:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604846336:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130109.374244:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130109.374276:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130109.374294:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130109.374326:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbe405/0x5c74554e47ce8e6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba9c expref: 8 pid: 37276 timeout: 1372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130109.374350:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130109.374355:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130109.374365:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130109.374378:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130109.374453:0:36572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130109.374471:0:36572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626795904:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130109.374582:0:36572:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130109.387238:0:36572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626795904:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130109.387281:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130109.387360:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+7:2370:x1876037604846336:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 13142us (14202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130109.387374:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00010000:00010000:1.0:1789130109.399249:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130110.046239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.046658:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846464 00000100:00100000:2.0:1789130110.046672:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846464 00000100:00100000:2.0:1789130110.046756:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130110.046769:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+7:31954:x1876037604846464:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130110.046794:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130110.046819:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abab1 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.046864:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.046875:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789130110.046880:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789130110.046886:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 8 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.046929:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.046946:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 6 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130110.047106:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626796032:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130110.047233:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130110.065172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130110.065380:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626796032:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130110.065436:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 8 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.065468:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:1.0:1789130110.065685:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+8:31954:x1876037604846464:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 18918us (19461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130110.065696:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789130110.066297:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846592 00000100:00100000:3.0:1789130110.066311:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846592 00002000:00100000:3.0:1789130110.066381:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff90b4be5f0000 x1876037604846592/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789130110.066393:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f0000 with x1876037604846592 ext(0->409599) 00010000:00010000:3.0:1789130110.066404:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 7 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.066421:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 7 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130110.066461:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4be5f0000 00000100:00100000:3.0:1789130110.066499:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789130110.066509:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604846592:12345-192.168.201.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789130110.108473:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604846592:12345-192.168.201.39@tcp:4:mmap_sanity.0 Request processed in 41947us (43301us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1789130110.108492:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:3.0:1789130110.108509:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff90b4be5f0000 x1876037604846592/t30064771080(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:581/0 lens 488/448 e 0 to 0 dl 1789130121 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789130110.108521:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f0000 with x1876037604846592 ext(0->409599) 00010000:00010000:3.0:1789130110.108535:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.108561:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130110.108570:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4be5f0000 00000100:00100000:0.0:1789130110.117447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130110.118738:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846720 00000100:00100000:3.0:1789130110.118757:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846720 00010000:00010000:3.0:1789130110.118826:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130110.118959:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789130110.118973:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604846720:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130110.119029:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789130110.119059:0:36573:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1789130107 -> 1789130109 00002000:00010000:3.0:1789130110.119062:0:36573:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789130107 -> 1789130109 00010000:00010000:3.0:1789130110.119071:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.119101:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.119136:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce8e80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abaaa expref: 9 pid: 37276 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.119159:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789130110.119165:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789130110.119176:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 7 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.119189:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 7 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130110.119247:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 7 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130110.119264:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626796160:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130110.119397:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130110.125315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130110.125559:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626796160:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130110.125592:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130110.125708:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604846720:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6737us (8274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130110.125724:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130110.126005:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846848 00000100:00100000:2.0:1789130110.126031:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846848 00002000:00100000:2.0:1789130110.126117:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (176128->241663) req@ffff90b382f8e580 x1876037604846848/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.126131:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8e580 with x1876037604846848 ext(176128->241663) 00002000:00010000:2.0:1789130110.126139:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8e580 00000100:00100000:2.0:1789130110.126173:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789130110.126185:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604846848:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130110.139587:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604846848:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 13373us (14258us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1789130110.139656:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00002000:00100000:2.0:1789130110.139675:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (176128->241663) req@ffff90b382f8e580 x1876037604846848/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.139687:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8e580 with x1876037604846848 ext(176128->241663) 00002000:00010000:2.0:1789130110.139707:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8e580 00000100:00100000:0.0:1789130110.154906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130110.158826:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604846976 00000100:00100000:3.0:1789130110.158847:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604846976 00002000:00100000:0.0:1789130110.159580:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (241664->278527) req@ffff90b3839a4f00 x1876037604846976/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130110.159598:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a4f00 with x1876037604846976 ext(241664->278527) 00002000:00010000:0.0:1789130110.159783:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a4f00 00000100:00100000:0.0:1789130110.159924:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1789130110.160046:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2367:x1876037604846976:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130110.168770:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2367:x1876037604846976:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8818us (13865us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130110.168789:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00002000:00100000:2.0:1789130110.168808:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (241664->278527) req@ffff90b3839a4f00 x1876037604846976/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.168819:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a4f00 with x1876037604846976 ext(241664->278527) 00002000:00010000:2.0:1789130110.168827:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a4f00 00000100:00100000:0.0:1789130110.186286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.186425:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847104 00000100:00100000:2.0:1789130110.186439:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847104 00002000:00100000:2.0:1789130110.186512:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (278528->315391) req@ffff90b3839a4780 x1876037604847104/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.186547:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a4780 with x1876037604847104 ext(278528->315391) 00002000:00010000:2.0:1789130110.186556:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a4780 00000100:00100000:2.0:1789130110.186740:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789130110.186753:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2368:x1876037604847104:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130110.205738:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2368:x1876037604847104:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 18971us (19451us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130110.205757:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00002000:00100000:2.0:1789130110.205775:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (278528->315391) req@ffff90b3839a4780 x1876037604847104/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.205787:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a4780 with x1876037604847104 ext(278528->315391) 00002000:00010000:2.0:1789130110.205795:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a4780 00000100:00100000:0.0:1789130110.217916:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130110.217961:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130110.218081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130110.218511:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626796288 00000100:00100000:3.0:1789130110.218524:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626796288 00000100:00100000:3.0:1789130110.218647:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130110.218661:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626796288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130110.218696:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 3407872 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130110.218765:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626796288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130110.218775:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130110.218971:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130110.221525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.228450:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847232 00000100:00100000:2.0:1789130110.228472:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847232 00002000:00100000:2.0:1789130110.228568:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (315392->352255) req@ffff90b382f8da40 x1876037604847232/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.228581:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8da40 with x1876037604847232 ext(315392->352255) 00002000:00010000:2.0:1789130110.228590:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8da40 00000100:00100000:2.0:1789130110.228804:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789130110.228818:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604847232:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:0.0:1789130110.254498:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604847232:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 25665us (32971us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789130110.254518:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00002000:00100000:0.0:1789130110.254535:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (315392->352255) req@ffff90b382f8da40 x1876037604847232/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130110.254548:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8da40 with x1876037604847232 ext(315392->352255) 00002000:00010000:0.0:1789130110.254557:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8da40 00000100:00100000:1.0:1789130110.266519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.266673:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847360 00000100:00100000:2.0:1789130110.266685:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847360 00002000:00100000:2.0:1789130110.266756:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (352256->389119) req@ffff90b382f8f840 x1876037604847360/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.266795:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8f840 with x1876037604847360 ext(352256->389119) 00002000:00010000:2.0:1789130110.266803:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8f840 00000100:00100000:2.0:1789130110.266867:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130110.266879:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604847360:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130110.278463:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604847360:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 11571us (11942us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130110.278480:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00002000:00100000:2.0:1789130110.278496:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (352256->389119) req@ffff90b382f8f840 x1876037604847360/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.278508:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8f840 with x1876037604847360 ext(352256->389119) 00002000:00010000:2.0:1789130110.278517:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8f840 00000100:00100000:1.0:1789130110.287683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130110.287799:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847488 00000100:00100000:0.0:1789130110.287814:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847488 00002000:00100000:0.0:1789130110.287901:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (389120->409599) req@ffff90b381d4b0c0 x1876037604847488/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/0 e 0 to 0 dl 1789130121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789130110.287916:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d4b0c0 with x1876037604847488 ext(389120->409599) 00002000:00010000:0.0:1789130110.287926:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381d4b0c0 00000100:00100000:0.0:1789130110.287980:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789130110.288002:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604847488:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130110.291243:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604847488:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 3227us (3560us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1789130110.291261:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00002000:00100000:2.0:1789130110.291278:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (389120->409599) req@ffff90b381d4b0c0 x1876037604847488/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:581/0 lens 488/440 e 0 to 0 dl 1789130121 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130110.291290:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d4b0c0 with x1876037604847488 ext(389120->409599) 00002000:00010000:2.0:1789130110.291299:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381d4b0c0 00000100:00100000:1.0:1789130110.304323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.304516:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847744 00000100:00100000:2.0:1789130110.304531:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847744 00000100:00100000:2.0:1789130110.304731:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1789130110.304745:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604847744:12345-192.168.201.39@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1789130110.304790:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130110.304828:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8d99 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba5d expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.304852:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130110.304858:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130110.304947:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+9:31954:x1876037604847744:12345-192.168.201.39@tcp:103:mmap_sanity.0 Request processed in 204us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130110.304956:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789130110.307510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130110.307753:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604847872 00000100:00100000:1.0:1789130110.307765:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604847872 00000100:00100000:1.0:1789130110.307847:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:1.0:1789130110.307859:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+9:31954:x1876037604847872:12345-192.168.201.39@tcp:58:mmap_sanity.0 00010000:00010000:1.0:1789130110.308029:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.308074:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.308085:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.308136:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.308154:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 19 pid: 36589 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130110.308173:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626796416:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130110.308295:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789130110.312958:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626796416:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130110.313017:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130110.321283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.321824:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848000 00000100:00100000:2.0:1789130110.321841:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848000 00010000:00010000:2.0:1789130110.321918:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 20 pid: 36589 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130110.321981:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130110.322004:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604848000:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130110.322028:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130110.322036:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 20 pid: 36589 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322054:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 20 pid: 36589 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322082:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8d22 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aba48 expref: 20 pid: 36589 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322103:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130110.322136:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322149:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322158:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.322192:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130110.322283:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604848000:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 282us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130110.322294:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00010000:00010000:1.0:1789130110.323380:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130110.323399:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130110.323919:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].3, 136 off8600 00000100:00080000:0.0:1789130110.325521:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130110.328698:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+9:31954:x1876037604847872:12345-192.168.201.39@tcp:58:mmap_sanity.0 Request processed in 20822us (21182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130110.328718:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130110.333876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.333979:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848128 00000100:00100000:2.0:1789130110.334001:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848128 00000100:00100000:2.0:1789130110.334085:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130110.334097:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+9:31954:x1876037604848128:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130110.334132:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130110.334161:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abab8 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334251:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334263:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334287:0:38723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334321:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334337:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130110.334341:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130110.334345:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130110.334354:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:2.0:1789130110.334443:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604848128:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 348us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130110.334451:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00010000:00010000:1.0:1789130110.406106:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130110.490117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130110.490185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130110.490227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130110.490381:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848384 00000100:00100000:2.0:1789130110.490393:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848384 00000100:00100000:2.0:1789130110.490467:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848512 00000100:00100000:2.0:1789130110.490471:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848512 00000100:00100000:2.0:1789130110.490497:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130110.490508:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604848384:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130110.490898:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604848384:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 391us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130110.490909:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130110.491049:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848256 00000100:00100000:0.0:1789130110.491055:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848256 00000100:00100000:0.0:1789130110.491092:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789130110.491101:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604848256:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130110.491133:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604848256:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130110.491141:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789130110.491222:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789130110.491230:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604848512:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130110.491258:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604848512:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130110.491265:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00080000:3.0:1789130110.491384:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789130110.981854:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130110.981866:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130110.982068:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:2.0:1789130110.982077:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130110.982215:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626796544:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130110.982461:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497e2acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130111.002719:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626796544:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130111.005215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.006557:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848640 00000100:00100000:3.0:1789130111.006571:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848640 00000100:00100000:3.0:1789130111.006686:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789130111.006707:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604848640:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130111.006745:0:36588:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130111.006917:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604848640:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 221us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130111.006925:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00080000:0.0:1789130111.007148:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130111.011141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.011297:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604848768 00000100:00100000:2.0:1789130111.011308:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604848768 00000100:00100000:2.0:1789130111.011386:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789130111.011397:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604848768:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789130111.011490:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011509:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011522:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011540:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011548:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011555:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011580:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011589:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011595:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130111.011680:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:2.0:1789130111.011685:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130111.011900:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011913:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.011996:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012005:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012011:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.012016:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012025:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012040:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789130111.012043:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.012048:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012055:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8e9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012071:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012090:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012096:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012101:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.012105:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012112:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012120:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb6096ffe (ffff90b4976b8300) 00010000:00010000:2.0:1789130111.012123:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.012126:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012132:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8ea3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012148:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012154:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012159:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012165:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.012174:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012181:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012190:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130111.012193:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.012196:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.012202:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8eaa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.012292:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604848768:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 895us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.012300:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789130111.024255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.024395:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604849024 00000100:00100000:3.0:1789130111.024408:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604849024 00000100:00100000:3.0:1789130111.024482:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789130111.024494:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604849024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130111.024515:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.024540:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8eb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ababf expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.024679:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.024708:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.024722:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130111.024734:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:3.0:1789130111.025718:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025731:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025739:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025765:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.025769:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025778:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025794:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:3.0:1789130111.025797:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130111.025802:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025881:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8eb8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025933:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8eb1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ababf expref: 21 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025945:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789130111.025948:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130111.025951:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8eb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ababf expref: 21 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.025961:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789130111.026102:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:31956:x1876037604849024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1610us (1858us total) trans 30064771134 rc 301/301 00000100:00100000:3.0:1789130111.026111:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:0.0:1789130111.038312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.038468:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604849152 00000100:00100000:1.0:1789130111.038480:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604849152 00000100:00100000:1.0:1789130111.038557:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:1.0:1789130111.038568:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:31956:x1876037604849152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130111.038647:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130111.038805:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:31956:x1876037604849152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 238us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.038814:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789130111.054318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.054883:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604849408 00000100:00100000:1.0:1789130111.054897:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604849408 00000100:00100000:1.0:1789130111.054996:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:1.0:1789130111.055008:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:31956:x1876037604849408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.055047:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.055078:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ec6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abac6 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130111.055945:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc3:0x0], index 1: 0 00010000:00010000:1.0:1789130111.056201:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8ecd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.056221:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8ecd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.056234:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8ecd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.056306:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ec6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abac6 expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.056344:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8ecd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abac6 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.056355:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130111.056359:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130111.056363:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:1.0:1789130111.056448:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:31956:x1876037604849408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1441us (2143us total) trans 30064771135 rc 0/0 00000100:00100000:1.0:1789130111.056456:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789130111.072703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.072841:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604849664 00000100:00100000:1.0:1789130111.072860:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604849664 00000100:00100000:2.0:1789130111.073135:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789130111.073152:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+22:31956:x1876037604849664:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130111.073245:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130111.073282:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8ecd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abac6 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073306:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:2.0:1789130111.073319:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130111.073352:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073385:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073398:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073417:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073425:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073433:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073823:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073832:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073840:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073847:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.073864:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073873:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073883:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130111.073893:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.073898:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.073905:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce8edb lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074342:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074353:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074360:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074366:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.074369:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074378:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074389:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xe7ea194e (ffff90b4976b8300) 00010000:00010000:2.0:1789130111.074392:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.074395:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.074401:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8ee2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe7ea194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.074533:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:31956:x1876037604849664:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1383us (1843us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130111.074553:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:0.0:1789130111.078147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.078320:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604849792 00000100:00100000:1.0:1789130111.078336:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604849792 00000100:00100000:1.0:1789130111.078424:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1789130111.078438:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+21:31956:x1876037604849792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.078467:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.078501:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ee9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abacd expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.078550:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.078567:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.078581:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.078830:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ee9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.079470:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.079484:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130111.079488:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130111.079492:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:1.0:1789130111.079796:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:31956:x1876037604849792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1359us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.079806:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130111.092518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.092642:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850048 00000100:00100000:1.0:1789130111.092656:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850048 00000100:00100000:1.0:1789130111.092740:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789130111.092753:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:31956:x1876037604850048:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.092866:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.092885:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.092898:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130111.093448:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].4, 88 off8496 00000004:00080000:1.0:1789130111.093461:0:36587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1274190858101ns, next at 1275190855079ns, rc = 0 00000004:00010000:1.0:1789130111.093585:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001fcf786f reply state 00000000337f008e transno 30064771136 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.093597:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130111.093769:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:31956:x1876037604850048:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1016us (1262us total) trans 30064771136 rc 0/0 00000100:00100000:1.0:1789130111.093778:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00010000:00010000:1.0:1789130111.099564:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099590:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099652:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099661:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130111.099667:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099677:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099699:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130111.099703:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130111.099710:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.099717:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce8ef7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.106194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.106338:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850176 00000100:00100000:3.0:1789130111.106352:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850176 00000100:00100000:3.0:1789130111.106436:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130111.106450:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:31956:x1876037604850176:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130111.106482:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.106512:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abad4 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.106598:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.106654:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.106680:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130111.106684:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130111.106689:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789130111.106762:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:31956:x1876037604850176:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 315us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130111.106770:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130111.110483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.110642:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850304 00000100:00100000:1.0:1789130111.110675:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850304 00000100:00100000:1.0:1789130111.110745:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789130111.110757:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604850304:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789130111.111179:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604850304:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 423us (708us total) trans 30064771080 rc 0/0 00000100:00100000:1.0:1789130111.111188:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130111.120098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.120292:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850560 00000100:00100000:1.0:1789130111.120306:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850560 00000100:00100000:1.0:1789130111.120397:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789130111.120409:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:31956:x1876037604850560:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130111.121095:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:31956:x1876037604850560:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 686us (1012us total) trans 30064771137 rc 0/0 00000100:00100000:1.0:1789130111.121107:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130111.129167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.129315:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850816 00000100:00100000:1.0:1789130111.129333:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850816 00000100:00100000:1.0:1789130111.129437:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:1.0:1789130111.129450:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:31956:x1876037604850816:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130111.129665:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:31956:x1876037604850816:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 216us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.129674:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789130111.133384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.133486:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604850944 00000100:00100000:3.0:1789130111.133505:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604850944 00000100:00100000:3.0:1789130111.134178:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130111.134196:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:31956:x1876037604850944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130111.134228:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.134251:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f05 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abadb expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134356:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134372:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134386:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130111.134431:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130111.134451:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134480:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f05 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abadb expref: 27 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134500:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abadb expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.134508:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130111.134511:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130111.134516:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789130111.134657:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:31956:x1876037604850944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 466us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130111.134666:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789130111.138114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.138313:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851072 00000100:00100000:3.0:1789130111.138325:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851072 00000100:00100000:3.0:1789130111.138392:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1789130111.138418:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604851072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130111.138437:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.138460:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abae2 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130111.138488:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f57e, blocks: 0x1 00010000:00010000:3.0:1789130111.138507:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=1274s v=(0 0) 00010000:00010000:3.0:1789130111.138513:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130111.138525:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.138561:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.138577:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3e00, rc 0) 00000100:00100000:0.0:1789130111.138846:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604851072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 427us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.138854:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130111.144777:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.144854:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851328 00000100:00100000:1.0:1789130111.144870:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851328 00000100:00100000:1.0:1789130111.145035:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130111.145047:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:31956:x1876037604851328:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130111.145180:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:31956:x1876037604851328:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 134us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.145206:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789130111.150183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.150290:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851456 00000100:00100000:1.0:1789130111.150301:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851456 00000100:00100000:1.0:1789130111.150365:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130111.150377:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:31956:x1876037604851456:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.150397:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.150418:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abae9 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.150451:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 9 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.150463:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130111.150468:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130111.150474:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 9 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.150511:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 9 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.150527:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 9 pid: 37273 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.150541:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626796672:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130111.150684:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130111.153991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.154130:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851584 00000100:00100000:2.0:1789130111.154139:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851584 00010000:00010000:2.0:1789130111.154180:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 10 pid: 37273 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.154244:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789130111.154255:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604851584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130111.154272:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130111.154298:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 10 pid: 37273 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.154313:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 10 pid: 37273 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.154339:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130111.154344:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130111.154353:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.154389:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.154434:0:38711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.154450:0:38711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626796800:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130111.154541:0:38711:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497e2acc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789130111.154710:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077875fc0/0x5c74554e47ce8f13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae2 expref: 10 pid: 37273 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.154726:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626796672:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130111.154753:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 9 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.154765:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:1.0:1789130111.154794:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:31956:x1876037604851456:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4419us (4624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.154802:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789130111.161583:0:38711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626796800:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130111.161644:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130111.161703:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604851584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 7449us (7733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.161715:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789130111.177648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.177746:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851712 00000100:00100000:2.0:1789130111.177758:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851712 00002000:00100000:2.0:1789130111.177813:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->409599) req@ffff90b381fdbc00 x1876037604851712/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789130111.177825:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdbc00 with x1876037604851712 ext(0->409599) 00002000:00010000:2.0:1789130111.177831:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381fdbc00 00000100:00100000:2.0:1789130111.177867:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130111.177878:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604851712:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130111.200527:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604851712:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 22640us (22926us total) trans 30064771081 rc 0/0 00000100:00100000:2.0:1789130111.200582:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00002000:00100000:2.0:1789130111.200631:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->409599) req@ffff90b381fdbc00 x1876037604851712/t30064771081(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:582/0 lens 488/448 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789130111.200642:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdbc00 with x1876037604851712 ext(0->409599) 00002000:00010000:2.0:1789130111.200649:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381fdbc00 00000100:00100000:3.0:1789130111.206321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.206480:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851840 00000100:00100000:1.0:1789130111.206491:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851840 00000100:00100000:1.0:1789130111.206555:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:1.0:1789130111.206566:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:31956:x1876037604851840:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789130111.354460:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771131 is committed 00000020:00080000:1.0:1789130111.354476:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4856b7cc0 refcount 2 committed 0 result 0 batchid 25769803898 00000020:00080000:1.0:1789130111.354483:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b497e40d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4856b7240 00000020:00080000:1.0:1789130111.354486:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b497e40a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3837ab800 00000001:00080000:1.0:1789130111.354516:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771137 is committed 00000004:00080000:1.0:1789130111.354525:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789130111.354580:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803897 batchid updated 00000020:00080000:2.0:1789130111.354630:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803898 committed batchid 25769803897 00000020:00080000:2.0:1789130111.354956:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000100:00100000:3.0:1789130111.355110:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626796928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789130111.355320:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:31956:x1876037604851840:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 148753us (149005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.355331:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:3.0:1789130111.359720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130111.359808:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626796928 00000100:00100000:2.0:1789130111.359818:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626796928 00000100:00080000:3.0:1789130111.359854:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130111.359875:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130111.359885:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626796928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789130111.360125:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1789130111.360129:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1789130110 00002000:00010000:2.0:1789130111.360131:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130111.360133:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789130110 -> 1789130110 00002000:00010000:2.0:1789130111.360135:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130111.361378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.363052:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604851968 00000100:00100000:3.0:1789130111.363068:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604851968 00000100:00100000:3.0:1789130111.363211:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130111.363223:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604851968:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789130111.371150:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1876037626796928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 11259us (11428us total) trans 30064771082 rc 0/0 00000100:00100000:2.0:1789130111.371177:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:3.0:1789130111.371848:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382f8c000/2, rc 0, transno 30064771082 00000100:00100000:3.0:1789130111.371857:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626796928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130111.411918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.412376:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604852096 00000100:00100000:1.0:1789130111.412387:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604852096 00000100:00100000:1.0:1789130111.412448:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1789130111.412457:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:31950:x1876037604852096:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130111.412489:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.412511:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8f21 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abaf0 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412597:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412637:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412648:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412663:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412669:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.412675:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413019:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413028:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413037:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130111.413077:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:1.0:1789130111.413091:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130111.413117:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413128:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413136:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413142:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413148:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413154:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130111.413159:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413166:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413179:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130111.413183:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130111.413188:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413193:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce8f28 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413208:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413225:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413231:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413236:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130111.413240:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413245:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413253:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff90b4909bde00) 00010000:00010000:1.0:1789130111.413256:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130111.413258:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413264:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce8f2f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413302:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce8f21 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf0 expref: 16 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413316:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf0 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.413324:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130111.413326:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130111.413335:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:1.0:1789130111.413404:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604852096:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 947us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.413413:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00010000:00010000:3.0:1789130111.440538:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130111.440839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.443498:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604852352 00000100:00100000:3.0:1789130111.443513:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604852352 00000100:00100000:3.0:1789130111.443586:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:3.0:1789130111.443596:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604852352:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789130111.443679:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130111.443706:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce8f36 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf0 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443730:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce8e79 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaa3 expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443742:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:3.0:1789130111.443747:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130111.443775:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443788:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443797:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443811:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443819:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.443841:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.444168:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.444178:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.444198:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130111.445099:0:36588:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0x8:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1789130111.445234:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445243:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445250:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445256:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.445260:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445268:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445280:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:3.0:1789130111.445283:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130111.445298:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445304:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce8f4b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445318:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445323:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445328:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445332:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.445335:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445341:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445348:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.445350:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.445353:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.445358:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce8f3d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130111.445367:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ad7e9fbf reply state 000000001d2f2884 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.445384:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130111.445489:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604852352:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1892us (4654us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1789130111.445497:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00010000:00010000:0.0:1789130111.453684:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453704:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453712:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453719:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130111.453741:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453750:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453769:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff90b496419900) 00010000:00010000:0.0:1789130111.453773:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130111.453779:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.453786:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce8f44 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.464108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.464154:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604852480 00000100:00100000:3.0:1789130111.464165:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604852480 00000100:00100000:3.0:1789130111.464236:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1789130111.464246:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:31950:x1876037604852480:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789130111.464271:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.464292:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f52 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abaf7 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464361:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464377:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464389:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464403:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464410:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.464416:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466485:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466505:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466517:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130111.466800:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:3.0:1789130111.466806:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130111.466829:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466841:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466849:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466854:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466860:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466866:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.466870:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466877:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466902:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.466905:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.466910:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466916:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f59 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466931:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466937:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466942:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466947:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.466950:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466955:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466973:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff90b496419000) 00010000:00010000:3.0:1789130111.466976:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.466979:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.466985:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f60 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.467043:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f52 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf7 expref: 16 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.467058:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf7 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.467065:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:3.0:1789130111.467067:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130111.467070:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86a00, rc 0) 00000100:00100000:3.0:1789130111.467153:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604852480:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 2907us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130111.467163:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789130111.473816:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604851968:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 110586us (112438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.473830:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000001:00080000:3.0:1789130111.474848:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771078 is committed 00000001:00080000:3.0:1789130111.474863:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771077 is committed 00000001:00080000:3.0:1789130111.474871:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771080 is committed 00000001:00080000:3.0:1789130111.474876:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771082 is committed 00000001:00080000:3.0:1789130111.474881:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771081 is committed 00000100:00100000:3.0:1789130111.495317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.495510:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604852736 00000100:00100000:0.0:1789130111.495521:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604852736 00000100:00100000:0.0:1789130111.495586:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130111.495598:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604852736:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789130111.495695:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130111.495726:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce8f67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abaf7 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495745:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:0.0:1789130111.495752:0:36588:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495781:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130111.495807:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495820:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495830:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495846:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495852:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.495859:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.496140:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.496150:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.496157:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130111.496891:0:36588:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0x7:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1789130111.497438:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497462:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497470:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497476:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130111.497481:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497490:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497505:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:0.0:1789130111.497508:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130111.497513:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497518:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce8f7c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497535:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497541:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497547:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497552:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130111.497563:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497569:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497578:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130111.497581:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130111.497584:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.497589:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce8f6e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130111.497599:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006b72ec3a reply state 000000004878dadb transno 30064771139 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.497649:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130111.497741:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:31950:x1876037604852736:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 2143us (2429us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1789130111.497750:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1789130111.505861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.505946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.506100:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604852992 00000100:00100000:3.0:1789130111.506110:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604852992 00000100:00100000:3.0:1789130111.506169:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604853120 00000100:00100000:3.0:1789130111.506172:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604853120 00000100:00100000:3.0:1789130111.506192:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130111.506202:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:31956:x1876037604852992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130111.506269:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130111.506301:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce8f0c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abadb expref: 17 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506340:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130111.506345:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130111.506378:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506392:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506402:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130111.506567:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a5d2d326 reply state 00000000f54173f2 transno 30064771140 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.506577:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130111.506709:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:31956:x1876037604852992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 508us (857us total) trans 30064771140 rc 0/0 00000100:00100000:3.0:1789130111.506717:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130111.506739:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1789130111.506747:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:31950:x1876037604853120:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789130111.506760:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.506773:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f8a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abafe expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506817:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506827:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506843:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506858:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506866:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506873:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506918:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506940:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506947:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506953:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.506958:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506974:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.506986:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.506989:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.506993:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507012:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce8f91 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507022:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507027:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507032:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507037:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.507040:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507045:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507053:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff90b488939f00) 00010000:00010000:3.0:1789130111.507055:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.507057:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507062:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce8f98 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507093:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f8a lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abafe expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507116:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.507118:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.507123:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce8f8a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abafe expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.507131:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:3.0:1789130111.507155:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:31950:x1876037604853120:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 410us (1208us total) trans 0 rc 301/301 00000100:00100000:3.0:1789130111.507161:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00010000:00010000:2.0:1789130111.509089:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509126:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509133:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509138:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.509143:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509150:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509164:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff90b4a2a08d00) 00010000:00010000:2.0:1789130111.509167:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.509171:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.509177:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce8f75 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.517178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.517386:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604853248 00000100:00100000:2.0:1789130111.517399:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604853248 00000100:00100000:2.0:1789130111.517463:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1789130111.517474:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604853248:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130111.517769:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1789130111.517774:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1789130110 -> 1789130107 00002000:00010000:2.0:1789130111.517776:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1789130107 00002000:00010000:2.0:1789130111.517779:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789130110 -> 1789130107 00002000:00010000:2.0:1789130111.517796:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:2.0:1789130111.517855:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604853248:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 383us (687us total) trans 30064771083 rc 0/0 00000100:00100000:2.0:1789130111.517864:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00010000:00010000:0.0:1789130111.518054:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518065:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518072:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518078:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130111.518082:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518098:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518113:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130111.518116:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130111.518121:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.518127:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce8f83 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.528707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.529399:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604853504 00000100:00100000:1.0:1789130111.529410:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604853504 00000100:00100000:1.0:1789130111.529476:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130111.529487:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:31950:x1876037604853504:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130111.529513:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.529534:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8f9f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb05 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529703:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529718:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529728:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529740:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529746:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.529771:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.531424:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.531590:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604853760 00000100:00100000:2.0:1789130111.531599:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604853760 00000100:00100000:2.0:1789130111.531688:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130111.531698:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:31956:x1876037604853760:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130111.531760:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.531775:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 17 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.531784:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.531823:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 17 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.531838:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 17 pid: 36589 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.531854:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626797056:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130111.531941:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4917610c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130111.533877:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8fbb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.533924:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8fbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.533939:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8fbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130111.533954:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789130111.534003:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534010:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534016:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534022:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.534027:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534034:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534047:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130111.534050:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.534055:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534074:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fa6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130111.534089:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000af32ea7a reply state 00000000fa7e1510 transno 30064771141 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.534105:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130111.534144:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce8f9f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb05 expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534159:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8fbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb05 expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.534167:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130111.534170:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130111.534172:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:2.0:1789130111.535718:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604853504:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 6225us (7014us total) trans 30064771141 rc 0/0 00000100:00100000:2.0:1789130111.535731:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:2.0:1789130111.550664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.550840:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604853888 00000100:00100000:1.0:1789130111.550851:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604853888 00010000:00010000:1.0:1789130111.550897:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 19 pid: 36589 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.550948:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789130111.550959:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604853888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130111.550987:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130111.550996:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 19 pid: 36589 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.551011:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 19 pid: 36589 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.551039:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130111.551045:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.551056:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.551076:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.551099:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130111.551180:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604853888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 222us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.551189:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00010000:00010000:3.0:1789130111.551685:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce8ef0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abacd expref: 18 pid: 36589 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.551704:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626797056:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130111.551730:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551739:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551745:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551775:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551782:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551798:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551805:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.551809:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551818:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551828:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130111.551832:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130111.551835:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.551841:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce8fb4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.551895:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:31956:x1876037604853760:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 20198us (20480us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130111.551904:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789130111.554844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130111.554929:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.554943:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.554950:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.554956:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.554973:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.554983:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.555019:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff90b4909bde00) 00010000:00010000:2.0:1789130111.555022:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.555028:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.555035:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce8fad lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.555357:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854144 00000100:00100000:3.0:1789130111.555369:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854144 00000100:00100000:3.0:1789130111.555429:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1789130111.555439:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:31950:x1876037604854144:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130111.557441:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.557464:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.557476:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130111.557557:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771142 00000004:00010000:2.0:1789130111.557585:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d43199f2 reply state 00000000ddb0ba32 transno 30064771143 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.557596:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130111.557733:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604854144:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 2291us (2895us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1789130111.557742:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000020:00080000:2.0:1789130111.557747:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130111.560437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.561880:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854272 00000100:00100000:1.0:1789130111.561896:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854272 00000100:00100000:1.0:1789130111.561989:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130111.562000:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604854272:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.562053:0:38727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.562084:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.562094:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130111.562098:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130111.562102:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.562139:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.562153:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 7 pid: 37658 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.562166:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626797184:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130111.562417:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789130111.574344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.574770:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626797184:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130111.574799:0:38727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.574920:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854400 00000100:00100000:2.0:1789130111.574928:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854400 00002000:00100000:2.0:1789130111.575004:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (204800->409599) req@ffff90b3839a5a40 x1876037604854400/t0(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130111.575021:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a5a40 with x1876037604854400 ext(204800->409599) 00002000:00010000:2.0:1789130111.575027:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a5a40 00000100:00100000:2.0:1789130111.575058:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130111.575082:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604854400:12345-192.168.201.39@tcp:4:ldlm_bl.0 00000100:00080000:3.0:1789130111.575586:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130111.575717:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575729:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575737:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575743:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130111.575748:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575756:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575774:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789130111.575777:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130111.575782:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.575788:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce8fc9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.581934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.583045:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604854400:12345-192.168.201.39@tcp:4:ldlm_bl.0 Request processed in 7959us (8704us total) trans 30064771081 rc 0/0 00000100:00100000:1.0:1789130111.583071:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00002000:00100000:1.0:1789130111.583087:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (204800->409599) req@ffff90b3839a5a40 x1876037604854400/t30064771081(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/448 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.583099:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a5a40 with x1876037604854400 ext(204800->409599) 00002000:00010000:1.0:1789130111.583115:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a5a40 00000100:00100000:0.0:1789130111.583582:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854656 00000100:00100000:0.0:1789130111.583592:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854656 00010000:00010000:0.0:1789130111.583657:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 8 pid: 37658 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.583694:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130111.583704:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604854656:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130111.583720:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130111.583740:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 8 pid: 37658 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583754:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 8 pid: 37658 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583797:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000611a6508/0x5c74554e47ce8f1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abae9 expref: 8 pid: 37658 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583816:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130111.583821:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130111.583828:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583840:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583873:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130111.583907:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604854656:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 204us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.583928:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00010000:00010000:0.0:1789130111.583955:0:38727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583975:0:38727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.583998:0:38727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584006:0:38727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584021:0:38727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584029:0:38727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130111.584035:0:38727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584045:0:38727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584057:0:38727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.584077:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abccc73/0x5c74554e47ce8fd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.584123:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604854272:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 22125us (23697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.584132:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1789130111.605128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.605388:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854784 00000100:00100000:2.0:1789130111.605398:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854784 00000100:00100000:2.0:1789130111.605463:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789130111.605475:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604854784:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130111.605536:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130111.605567:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce8fbb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb05 expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605588:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130111.605598:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130111.605671:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605696:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605708:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605723:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605730:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605753:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605861:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605869:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.605876:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130111.606236:0:38723:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0xb:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1789130111.606857:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.606867:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.606874:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.606879:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.606883:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.606890:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.606901:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789130111.606904:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1789130111.607629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130111.608036:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608045:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce8fe5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608137:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608145:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608151:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608156:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.608160:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608167:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608190:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130111.608193:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.608196:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.608203:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce8fd7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130111.608212:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e2f56fa3 reply state 00000000a32d226a transno 30064771144 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.608234:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130111.608342:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604854912 00000100:00100000:1.0:1789130111.608351:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604854912 00000100:00100000:1.0:1789130111.608411:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789130111.608420:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:31333:x1876037604854912:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130111.608433:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789130111.608452:0:36574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1789130109 -> 1789130110 00002000:00010000:1.0:1789130111.608455:0:36574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789130109 -> 1789130110 00010000:00010000:1.0:1789130111.608471:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce8e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab1 expref: 10 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.608489:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130111.608600:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+9:31333:x1876037604854912:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.608627:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1789130111.608821:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604854784:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 3348us (3704us total) trans 30064771144 rc 0/0 00000100:00100000:2.0:1789130111.608828:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:3.0:1789130111.619707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.619925:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604855168 00000100:00100000:1.0:1789130111.619936:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604855168 00000100:00100000:1.0:1789130111.620014:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789130111.620026:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:31956:x1876037604855168:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130111.620126:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620144:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620167:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620628:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620640:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 20 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620648:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620696:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 20 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.620711:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 20 pid: 36588 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130111.620725:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626797312:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130111.620804:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00010000:00010000:2.0:1789130111.621429:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621440:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621447:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621453:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.621457:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621465:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621480:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff90b4976b8300) 00010000:00010000:2.0:1789130111.621484:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.621488:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.621494:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce8fde lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.622214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.622452:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604855424 00000100:00100000:3.0:1789130111.622461:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604855424 00000100:00100000:3.0:1789130111.622516:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130111.622526:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:31958:x1876037604855424:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000004:00080000:3.0:1789130111.622786:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1789130111.622878:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622891:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622901:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622908:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622914:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622920:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.622936:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130111.623033:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:31958:x1876037604855424:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 507us (822us total) trans 30064771146 rc 0/0 00000100:00100000:3.0:1789130111.623056:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:0.0:1789130111.623519:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130111.623527:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.623536:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130111.623549:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.623558:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.623571:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130111.623574:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130111.623578:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.623585:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce8ffa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.623620:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.623622:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.623624:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130111.624505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.624577:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604855552 00000100:00100000:2.0:1789130111.624595:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604855552 00000100:00100000:2.0:1789130111.624681:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130111.624837:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604855552:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130111.624859:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130111.624877:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9001 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb0c expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.624936:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.624948:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.624976:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.624992:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.624998:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625006:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625076:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625084:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625090:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625103:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.625107:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625114:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625125:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130111.625128:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.625132:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625139:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9008 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625162:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625168:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625173:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625178:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.625428:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625435:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625454:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff90b4976b8600) 00010000:00010000:2.0:1789130111.625456:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.625459:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625465:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce900f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625498:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9001 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb0c expref: 22 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625508:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130111.625511:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.625514:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9001 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb0c expref: 22 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.625523:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:2.0:1789130111.625590:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604855552:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 757us (1088us total) trans 0 rc 301/301 00000100:00100000:3.0:1789130111.626069:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626797312:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130111.626098:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.630581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.630639:0:36587:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789130111.630649:0:36587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789130111.630986:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604855936 00000100:00100000:3.0:1789130111.630997:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604855936 00000100:00100000:2.0:1789130111.632572:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789130111.632892:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130111.632913:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604855936:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789130111.632938:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.632975:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9016 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb13 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633414:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633433:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633446:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633465:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633473:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.633491:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635172:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635199:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635211:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130111.635223:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 0 00000100:00100000:1.0:1789130111.635415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130111.635864:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635874:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635882:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635888:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.635893:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635901:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635915:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.635919:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.635935:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.635942:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce901d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130111.635956:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004cd35d2f reply state 00000000e9e66e7e transno 30064771147 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.635976:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130111.636017:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9016 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 24 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.636031:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.636039:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130111.636042:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789130111.636044:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87e00, rc 0) 00000100:00100000:3.0:1789130111.636120:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:31950:x1876037604855936:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 3216us (5549us total) trans 30064771147 rc 0/0 00000100:00100000:3.0:1789130111.636130:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1789130111.636712:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604855680 00000100:00100000:0.0:1789130111.636724:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604855680 00010000:00010000:0.0:1789130111.636760:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.636798:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130111.636808:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:2368:x1876037604855680:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130111.636822:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130111.636829:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636841:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636868:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce8efe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abad4 expref: 24 pid: 36588 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636881:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130111.636886:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636895:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636902:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.636930:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130111.636978:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037604855680:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 171us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.636986:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00010000:00010000:0.0:1789130111.637009:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.637017:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130111.637235:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771145 00000001:00080000:0.0:1789130111.638005:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771148 00000001:00080000:0.0:1789130111.638052:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771149 00000100:00100000:0.0:1789130111.638418:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bba580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626797440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789130111.638485:0:36589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130111.638566:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130111.643021:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626797440 00000100:00100000:1.0:1789130111.643037:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626797440 00000100:00100000:1.0:1789130111.643131:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130111.643143:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36589:x1876037626797440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789130111.643540:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36589:x1876037626797440:12345-0@lo:1000:mdt00_002.0 Request processed in 398us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130111.643549:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130111.643677:0:36589:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771082 gen 2 00000004:00080000:2.0:1789130111.643694:0:36589:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771082 00000004:00080000:2.0:1789130111.643717:0:36589:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382f8c780, transno 30064771079 00000004:00080000:2.0:1789130111.643727:0:36589:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382f8c000, transno 30064771082 00000100:00100000:2.0:1789130111.643734:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bba580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626797440:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789130111.644732:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771150 00000100:00100000:2.0:1789130111.644829:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626797568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789130111.644902:0:36589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130111.644938:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130111.644981:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626797568 00000100:00100000:2.0:1789130111.644988:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626797568 00000100:00100000:2.0:1789130111.645030:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130111.645038:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36589:x1876037626797568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789130111.645447:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36589:x1876037626797568:12345-0@lo:1000:mdt00_002.0 Request processed in 408us (542us total) trans 30064771084 rc 0/0 00000100:00100000:2.0:1789130111.645455:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130111.645496:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626797568:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789130111.645533:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645543:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645551:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645557:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.645563:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645571:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645589:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:2.0:1789130111.645592:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130111.645597:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645639:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce8ff3 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645670:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645676:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645826:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645831:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.645835:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645840:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645849:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130111.645851:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130111.645860:0:36589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645872:0:36589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645881:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.645925:0:36589:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.645938:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626797696:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130111.646020:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130111.648647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130111.648809:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648825:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648833:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648839:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.648845:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648853:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648871:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff90b488939200) 00010000:00010000:2.0:1789130111.648875:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.648880:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.648886:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9024 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.651068:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604856192 00000100:00100000:3.0:1789130111.651200:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604856192 00000100:00100000:3.0:1789130111.651368:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130111.651382:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604856192:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789130111.651857:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.651881:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.652360:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130111.652450:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771152 00000004:00010000:3.0:1789130111.652486:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ea414333 reply state 00000000b10acc91 transno 30064771153 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.652499:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130111.652716:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31950:x1876037604856192:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1332us (4073us total) trans 30064771153 rc 0/0 00000100:00100000:3.0:1789130111.652727:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000020:00080000:3.0:1789130111.652736:0:36588:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130111.653878:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626797696:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130111.653913:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.653925:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce8e8e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.653979:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.653993:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654006:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654017:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654023:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654030:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654036:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.654041:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654048:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654091:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130111.654094:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.654099:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654105:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9040 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654117:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654123:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654129:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654134:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.654137:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654143:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654162:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:2.0:1789130111.654164:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130111.654168:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.654173:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce8fec lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130111.655024:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:31956:x1876037604855168:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 34994us (35332us total) trans 30064771151 rc 0/0 00000100:00100000:2.0:1789130111.655038:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000020:00080000:2.0:1789130111.655045:0:36589:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789130111.656442:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130111.656453:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130111.656489:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:3.0:1789130111.656497:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130111.656778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130111.657015:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657029:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657037:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657043:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130111.657048:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657055:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657083:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130111.657087:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130111.657093:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.657099:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9039 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.657827:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604856320 00000100:00100000:3.0:1789130111.657846:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604856320 00000100:00100000:3.0:1789130111.659893:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789130111.659937:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604856320:12345-192.168.201.39@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1789130111.660173:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604856320:12345-192.168.201.39@tcp:49:mmap_sanity.0 Request processed in 263us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130111.660183:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130111.661676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.661787:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604856576 00000100:00100000:3.0:1789130111.661803:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604856576 00000100:00100000:3.0:1789130111.661886:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:3.0:1789130111.661898:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+10:31950:x1876037604856576:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789130111.661970:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130111.662009:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9047 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb1a expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663503:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663529:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663544:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663564:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663571:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.663578:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.664671:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce905c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.664688:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce905c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.664700:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce905c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130111.664722:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1789130111.664888:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.664897:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666130:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666142:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.666147:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666158:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666178:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130111.666182:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.666188:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666194:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce904e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666216:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666222:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666228:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666333:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130111.666337:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666344:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666353:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff90b488939b00) 00010000:00010000:3.0:1789130111.666356:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130111.666359:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.666365:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9055 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.666543:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9047 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb1a expref: 13 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.666636:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce905c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb1a expref: 12 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.666647:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130111.666650:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130111.666653:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86200, rc 0) 00000100:00100000:2.0:1789130111.666755:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+12:31950:x1876037604856576:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 4857us (5086us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1789130111.666767:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789130111.685485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.685535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.685641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.685681:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604856832 00000100:00100000:3.0:1789130111.685702:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604856832 00000100:00100000:3.0:1789130111.685823:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130111.685837:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:31956:x1876037604856832:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130111.687822:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789130111.687868:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771155 00010000:00010000:0.0:1789130111.687919:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.687937:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.687948:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.687957:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.687983:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.687990:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.688016:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130111.688097:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604856960 00000100:00100000:1.0:1789130111.688112:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604856960 00000100:00100000:1.0:1789130111.688182:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130111.688194:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:31954:x1876037604856960:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130111.688217:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130111.688243:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077708524/0x5c74554e47ce9071 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb21 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130111.688415:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6aa3f57b, atime: 0x6aa3f57b, ctime: 0x6aa3f57b, blocks: 0x403 00010000:00010000:1.0:1789130111.688443:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=1274s v=(0 0) 00010000:00010000:1.0:1789130111.688450:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130111.688465:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077708524/0x5c74554e47ce9071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb21 expref: 6 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.688483:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077708524/0x5c74554e47ce9071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb21 expref: 6 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.688499:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00010000:00010000:3.0:1789130111.688698:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130111.688708:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.688717:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130111.688722:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.688733:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.688777:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:3.0:1789130111.688781:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130111.688786:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.688793:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce906a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.688819:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130111.688821:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130111.688824:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130111.689006:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31956:x1876037604856832:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3163us (3521us total) trans 30064771156 rc 0/0 00000100:00100000:0.0:1789130111.689020:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789130111.689028:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:31954:x1876037604856960:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 830us (3486us total) trans 0 rc 0/0 00000020:00080000:0.0:1789130111.689030:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130111.689043:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789130111.689388:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857216 00000100:00100000:2.0:1789130111.689398:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857216 00000100:00100000:2.0:1789130111.689454:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789130111.689464:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+12:31950:x1876037604857216:12345-192.168.201.39@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1789130111.689478:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130111.689501:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce905c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb1a expref: 12 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.689515:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130111.689520:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130111.689555:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604857216:12345-192.168.201.39@tcp:103:mmap_sanity.0 Request processed in 93us (3956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.689563:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789130111.694578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.695037:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857344 00000100:00100000:2.0:1789130111.695050:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857344 00000100:00100000:2.0:1789130111.695192:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130111.695226:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec5d7172-884c-4596-96b1-f5256d22e019+9:31954:x1876037604857344:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130111.695325:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130111.695358:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb28 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130111.695400:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa3f57e, atime: 0x6aa3f57b, ctime: 0x6aa3f57e, blocks: 0x403 00010000:00010000:2.0:1789130111.695430:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=1274s v=(0 0) 00010000:00010000:2.0:1789130111.695435:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130111.695448:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.695467:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.695484:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:2.0:1789130111.695563:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:31954:x1876037604857344:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 340us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.695571:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:0.0:1789130111.695784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130111.696054:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857472 00000100:00100000:3.0:1789130111.696061:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857472 00000100:00100000:3.0:1789130111.696132:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789130111.696141:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604857472:12345-192.168.201.39@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1789130111.696268:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.696286:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.696296:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.696337:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.696352:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 28 pid: 36587 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130111.696384:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626797824:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130111.696468:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130111.705405:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626797824:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130111.705447:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.706785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.707231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.707404:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857600 00000100:00100000:1.0:1789130111.707418:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857600 00002000:00100000:1.0:1789130111.707494:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->65535) req@ffff90b382bb8f00 x1876037604857600/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.707507:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8f00 with x1876037604857600 ext(0->65535) 00002000:00010000:1.0:1789130111.707523:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bb8f00 00000100:00100000:1.0:1789130111.707643:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789130111.707655:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604857600:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130111.715895:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857728 00000100:00100000:2.0:1789130111.715921:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857728 00010000:00010000:0.0:1789130111.716069:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 29 pid: 36587 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130111.716136:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130111.716148:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:2367:x1876037604857728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130111.716169:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130111.716177:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 29 pid: 36587 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716193:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 29 pid: 36587 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716225:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce902b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb13 expref: 29 pid: 36587 timeout: 1374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716255:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130111.716262:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716274:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716284:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.716380:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130111.716465:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:2367:x1876037604857728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 318us (9689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130111.716499:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00010000:00010000:2.0:1789130111.718776:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.718798:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130111.719303:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].4, 136 off8736 00000100:00100000:2.0:1789130111.719466:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604857472:12345-192.168.201.39@tcp:58:mmap_sanity.0 Request processed in 23318us (23755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.719481:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:1.0:1789130111.725755:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604857600:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 17592us (18014us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1789130111.725777:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00002000:00100000:1.0:1789130111.725813:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (0->65535) req@ffff90b382bb8f00 x1876037604857600/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.725826:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8f00 with x1876037604857600 ext(0->65535) 00002000:00010000:1.0:1789130111.725836:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bb8f00 00000100:00100000:0.0:1789130111.729777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.730213:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857856 00000100:00100000:2.0:1789130111.730230:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857856 00000100:00100000:2.0:1789130111.730328:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:2.0:1789130111.730342:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604857856:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130111.730376:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130111.730407:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb2f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730491:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730504:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 12 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730529:0:36589:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730545:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 12 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730562:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130111.730566:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130111.730571:0:36589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 12 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.730579:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:2.0:1789130111.730810:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+12:31950:x1876037604857856:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 470us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130111.730819:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:0.0:1789130111.737240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.737462:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604857984 00000100:00100000:2.0:1789130111.737476:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604857984 00002000:00100000:2.0:1789130111.737543:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (65536->102399) req@ffff90b382bb8780 x1876037604857984/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130111.737556:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8780 with x1876037604857984 ext(65536->102399) 00002000:00010000:2.0:1789130111.737565:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bb8780 00000100:00100000:2.0:1789130111.737637:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130111.737649:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604857984:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130111.743773:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604857984:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 6106us (6531us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130111.743793:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00002000:00100000:2.0:1789130111.743811:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (65536->102399) req@ffff90b382bb8780 x1876037604857984/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130111.743823:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8780 with x1876037604857984 ext(65536->102399) 00002000:00010000:2.0:1789130111.743833:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bb8780 00000100:00100000:3.0:1789130111.748822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.749016:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858112 00000100:00100000:1.0:1789130111.749030:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858112 00002000:00100000:1.0:1789130111.749174:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (102400->139263) req@ffff90b381fdad00 x1876037604858112/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.749187:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdad00 with x1876037604858112 ext(102400->139263) 00002000:00010000:1.0:1789130111.749196:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fdad00 00000100:00100000:1.0:1789130111.749271:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130111.749284:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2367:x1876037604858112:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130111.756583:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2367:x1876037604858112:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 7282us (7758us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789130111.756646:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00002000:00100000:2.0:1789130111.756666:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (102400->139263) req@ffff90b381fdad00 x1876037604858112/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130111.756679:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdad00 with x1876037604858112 ext(102400->139263) 00002000:00010000:2.0:1789130111.756711:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fdad00 00000100:00100000:1.0:1789130111.762395:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.762515:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858240 00000100:00100000:2.0:1789130111.762529:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858240 00002000:00100000:2.0:1789130111.762762:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (139264->176127) req@ffff90b38274bc00 x1876037604858240/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130111.762777:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274bc00 with x1876037604858240 ext(139264->176127) 00002000:00010000:2.0:1789130111.762787:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274bc00 00000100:00100000:2.0:1789130111.762874:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1789130111.762887:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858240:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.789785:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858240:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 26883us (27389us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.789804:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00002000:00100000:1.0:1789130111.789822:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (139264->176127) req@ffff90b38274bc00 x1876037604858240/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.789863:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274bc00 with x1876037604858240 ext(139264->176127) 00002000:00010000:1.0:1789130111.789871:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274bc00 00000100:00100000:2.0:1789130111.795022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.799133:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858368 00000100:00100000:1.0:1789130111.799158:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858368 00002000:00100000:1.0:1789130111.799247:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (176128->212991) req@ffff90b382f8d2c0 x1876037604858368/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.799260:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8d2c0 with x1876037604858368 ext(176128->212991) 00002000:00010000:1.0:1789130111.799269:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8d2c0 00000100:00100000:1.0:1789130111.799369:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789130111.799383:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858368:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.822585:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858368:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 23189us (27667us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.822634:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00002000:00100000:1.0:1789130111.822651:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (176128->212991) req@ffff90b382f8d2c0 x1876037604858368/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.822663:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8d2c0 with x1876037604858368 ext(176128->212991) 00002000:00010000:1.0:1789130111.822673:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8d2c0 00000100:00100000:2.0:1789130111.827301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.827509:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858496 00000100:00100000:1.0:1789130111.827524:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858496 00002000:00100000:1.0:1789130111.827679:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (212992->249855) req@ffff90b382f8c780 x1876037604858496/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.827692:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c780 with x1876037604858496 ext(212992->249855) 00002000:00010000:1.0:1789130111.827722:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8c780 00000100:00100000:1.0:1789130111.827816:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130111.827845:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604858496:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.836654:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604858496:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8809us (9352us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.836675:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00002000:00100000:1.0:1789130111.836693:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (212992->249855) req@ffff90b382f8c780 x1876037604858496/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.836706:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c780 with x1876037604858496 ext(212992->249855) 00002000:00010000:1.0:1789130111.836715:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8c780 00000100:00100000:2.0:1789130111.845442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.845568:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858624 00000100:00100000:1.0:1789130111.845595:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858624 00002000:00100000:1.0:1789130111.845690:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (249856->286719) req@ffff90b382f8c000 x1876037604858624/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.845702:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c000 with x1876037604858624 ext(249856->286719) 00002000:00010000:1.0:1789130111.845709:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8c000 00000100:00100000:1.0:1789130111.845750:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130111.845762:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858624:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.851047:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858624:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 5267us (5600us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.851068:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00002000:00100000:1.0:1789130111.851087:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (249856->286719) req@ffff90b382f8c000 x1876037604858624/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.851132:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c000 with x1876037604858624 ext(249856->286719) 00002000:00010000:1.0:1789130111.851142:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8c000 00000100:00100000:3.0:1789130111.856282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.856653:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858752 00000100:00100000:1.0:1789130111.856669:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858752 00002000:00100000:1.0:1789130111.856750:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (286720->323583) req@ffff90b381fd8f00 x1876037604858752/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.856764:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd8f00 with x1876037604858752 ext(286720->323583) 00002000:00010000:1.0:1789130111.856772:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd8f00 00000100:00100000:1.0:1789130111.857068:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130111.857083:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604858752:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.865272:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604858752:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 8174us (8990us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.865291:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00002000:00100000:1.0:1789130111.865310:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (286720->323583) req@ffff90b381fd8f00 x1876037604858752/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.865322:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd8f00 with x1876037604858752 ext(286720->323583) 00002000:00010000:1.0:1789130111.865331:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd8f00 00000100:00100000:3.0:1789130111.868752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.868947:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604858880 00000100:00100000:1.0:1789130111.868969:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604858880 00002000:00100000:1.0:1789130111.869041:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (323584->360447) req@ffff90b381fd8780 x1876037604858880/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.869055:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd8780 with x1876037604858880 ext(323584->360447) 00002000:00010000:1.0:1789130111.869086:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd8780 00000100:00100000:1.0:1789130111.869127:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789130111.869138:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858880:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.873861:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604858880:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 4706us (5107us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.873880:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00002000:00100000:1.0:1789130111.873897:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (323584->360447) req@ffff90b381fd8780 x1876037604858880/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.873919:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd8780 with x1876037604858880 ext(323584->360447) 00002000:00010000:1.0:1789130111.873928:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd8780 00000100:00100000:2.0:1789130111.887750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.887862:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604859008 00000100:00100000:1.0:1789130111.887876:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604859008 00002000:00100000:1.0:1789130111.887976:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (360448->397311) req@ffff90b4876be1c0 x1876037604859008/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.887991:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876be1c0 with x1876037604859008 ext(360448->397311) 00002000:00010000:1.0:1789130111.888015:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876be1c0 00000100:00100000:1.0:1789130111.888062:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1789130111.888074:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604859008:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.892501:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604859008:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 4411us (4750us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789130111.892520:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00002000:00100000:1.0:1789130111.892538:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (360448->397311) req@ffff90b4876be1c0 x1876037604859008/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/440 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.892578:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876be1c0 with x1876037604859008 ext(360448->397311) 00002000:00010000:1.0:1789130111.892598:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876be1c0 00000100:00100000:3.0:1789130111.897841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.898089:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604859136 00000100:00100000:1.0:1789130111.898102:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604859136 00002000:00100000:1.0:1789130111.898178:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (397312->409599) req@ffff90b381fd9680 x1876037604859136/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/0 e 0 to 0 dl 1789130122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.898191:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd9680 with x1876037604859136 ext(397312->409599) 00002000:00010000:1.0:1789130111.898199:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd9680 00000100:00100000:1.0:1789130111.898426:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789130111.898442:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604859136:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:1.0:1789130111.899528:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+10:2369:x1876037604859136:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 1082us (1695us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1789130111.899542:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00002000:00100000:1.0:1789130111.899552:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (397312->409599) req@ffff90b381fd9680 x1876037604859136/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:582/0 lens 488/12728 e 0 to 0 dl 1789130122 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789130111.899563:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fd9680 with x1876037604859136 ext(397312->409599) 00002000:00010000:1.0:1789130111.899570:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fd9680 00000100:00100000:2.0:1789130111.906735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.906848:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604859392 00000100:00100000:0.0:1789130111.906862:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604859392 00000100:00100000:0.0:1789130111.906972:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130111.906987:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+12:31954:x1876037604859392:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789130111.907538:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604859392:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 551us (817us total) trans 30064771157 rc 0/0 00000100:00100000:0.0:1789130111.907548:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789130111.911760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130111.912086:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604859648 00000100:00100000:0.0:1789130111.912102:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604859648 00000100:00100000:0.0:1789130111.912184:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130111.912197:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a782ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+13:31954:x1876037604859648:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789130111.913099:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a782ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+14:31954:x1876037604859648:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 898us (1348us total) trans 30064771158 rc 0/0 00000100:00100000:0.0:1789130111.913111:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789130111.916238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130111.916409:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604859904 00000100:00100000:2.0:1789130111.916424:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604859904 00000100:00100000:2.0:1789130111.916504:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130111.916517:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:31954:x1876037604859904:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000004:00080000:2.0:1789130111.917310:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130111.917452:0:36591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].3, 64 off8408 00000004:00080000:2.0:1789130111.917466:0:36591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1275014863556ns, next at 1276014860271ns, rc = 0 00010000:00010000:2.0:1789130111.917553:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917575:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917830:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917841:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917847:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917854:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130111.917919:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130111.918069:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31954:x1876037604859904:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 1552us (1845us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1789130111.918079:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130111.920876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130111.921019:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604860160 00000100:00100000:1.0:1789130111.921036:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604860160 00000100:00100000:1.0:1789130111.921133:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130111.921148:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:31954:x1876037604860160:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000004:00080000:1.0:1789130111.921824:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789130111.922414:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].5, 64 off8560 00010000:00010000:1.0:1789130111.922529:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.922551:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.922565:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.922575:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922694:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130111.922705:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922715:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130111.922720:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922731:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922760:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:0.0:1789130111.922763:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130111.922770:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922777:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce908d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.922887:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.922890:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.922892:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130111.923024:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.923032:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130111.923111:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130111.923292:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:31954:x1876037604860160:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 2141us (2426us total) trans 30064771160 rc 0/0 00000100:00100000:1.0:1789130111.923304:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00010000:00010000:3.0:1789130111.926017:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130111.926041:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.926058:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130111.926063:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.926076:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.926102:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:3.0:1789130111.926106:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130111.926112:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130111.926119:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9094 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130111.926342:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.926345:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130111.926347:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130112.454286:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130112.710131:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130112.710145:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130112.710213:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1789130112.710222:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130112.710416:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626797952:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130112.710707:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130112.737383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130112.737726:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626797952:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130112.738686:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604860288 00000100:00100000:0.0:1789130112.738699:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604860288 00000100:00100000:0.0:1789130112.738782:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1789130112.738795:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:31960:x1876037604860288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130112.738845:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130112.739201:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:31960:x1876037604860288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 407us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130112.739384:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130112.743975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.748596:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604860416 00000100:00100000:2.0:1789130112.748636:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604860416 00000100:00100000:2.0:1789130112.748745:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789130112.748758:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:31960:x1876037604860416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789130112.748865:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.748886:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.748913:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.748976:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.748986:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749003:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749033:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749043:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749051:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130112.749106:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1789130112.749112:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130112.749128:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749141:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749149:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749157:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749174:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130112.749179:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749188:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749202:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789130112.749217:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130112.749225:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749231:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce909b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749248:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749254:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749260:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749266:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130112.749402:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749413:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749434:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadcadaa3 (ffff90b4976b8100) 00010000:00010000:2.0:1789130112.749437:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130112.749441:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749448:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749465:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749472:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749478:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749483:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130112.749486:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749491:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749499:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130112.749501:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130112.749504:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.749510:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90a9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130112.749701:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:31960:x1876037604860416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 942us (5739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130112.749711:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789130112.757851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.758091:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604860672 00000100:00100000:0.0:1789130112.758105:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604860672 00000100:00100000:0.0:1789130112.758177:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789130112.758192:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:31960:x1876037604860672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130112.758224:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130112.758283:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce90b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb36 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.758425:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.758446:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.758462:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130112.758477:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1789130112.759242:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759256:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759263:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759334:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130112.759339:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759348:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759366:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130112.759369:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130112.759375:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759399:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90b7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759461:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce90b0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb36 expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759473:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:0.0:1789130112.759476:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130112.759480:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce90b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb36 expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.759491:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:0.0:1789130112.759694:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31960:x1876037604860672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1504us (1860us total) trans 30064771161 rc 301/301 00000100:00100000:0.0:1789130112.759704:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:2.0:1789130112.775691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.775773:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604860800 00000100:00100000:0.0:1789130112.775785:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604860800 00000100:00100000:0.0:1789130112.775865:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:0.0:1789130112.775878:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:31960:x1876037604860800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130112.775945:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130112.776138:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:31960:x1876037604860800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 261us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130112.776147:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:1.0:1789130112.784255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.784739:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861056 00000100:00100000:0.0:1789130112.784753:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861056 00000100:00100000:0.0:1789130112.784835:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:0.0:1789130112.784868:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:31960:x1876037604861056:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130112.784907:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130112.784947:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce90c5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb3d expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130112.785982:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc3:0x0], index 0: 0 00010000:00010000:0.0:1789130112.787173:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90cc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.787198:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.787225:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.787476:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce90c5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb3d expref: 34 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.787500:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb3d expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.787510:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:0.0:1789130112.787514:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130112.787518:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:0.0:1789130112.787909:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:31960:x1876037604861056:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3041us (3673us total) trans 30064771162 rc 0/0 00000100:00100000:0.0:1789130112.787920:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130112.793851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.794031:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861312 00000100:00100000:0.0:1789130112.794056:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861312 00000100:00100000:0.0:1789130112.794138:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:0.0:1789130112.794150:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31960:x1876037604861312:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130112.794241:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130112.794288:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce90cc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb3d expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794311:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:0.0:1789130112.794325:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130112.794356:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794371:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794385:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794402:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794411:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794418:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794525:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794533:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794549:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794557:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130112.794562:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794573:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794583:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130112.794585:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130112.794590:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794597:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce90da lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794634:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794641:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794647:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794653:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130112.794655:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794673:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794682:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x7b94c6df (ffff90b4a2a08500) 00010000:00010000:0.0:1789130112.794685:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130112.794688:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.794694:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90e1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7b94c6df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130112.794807:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:31960:x1876037604861312:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 657us (971us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130112.794816:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:3.0:1789130112.800454:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.801100:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861440 00000100:00100000:2.0:1789130112.801115:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861440 00000100:00100000:2.0:1789130112.801197:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130112.801222:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31960:x1876037604861440:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130112.801253:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130112.801457:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90e8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb44 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801516:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801535:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801550:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801752:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90e8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 34 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801780:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 33 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.801807:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130112.801810:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130112.801816:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130112.801905:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:31960:x1876037604861440:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 697us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130112.801914:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:1.0:1789130112.807790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.808112:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861696 00000100:00100000:0.0:1789130112.808126:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861696 00000100:00100000:0.0:1789130112.808216:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:0.0:1789130112.808229:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:31960:x1876037604861696:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130112.808539:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.808563:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.808580:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130112.809912:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].4, 88 off8496 00000004:00010000:0.0:1789130112.810071:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000021ff5740 reply state 000000007a24dd24 transno 30064771163 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130112.810100:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130112.811174:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+35:31960:x1876037604861696:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2044us (2495us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1789130112.811190:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00010000:00010000:2.0:1789130112.814956:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.814979:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.814996:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.815003:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130112.815009:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.815019:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.815043:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130112.815047:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130112.815055:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.815061:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce90f6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130112.818831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.818960:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861824 00000100:00100000:2.0:1789130112.818976:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861824 00000100:00100000:2.0:1789130112.819072:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130112.819085:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+34:31960:x1876037604861824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130112.819124:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130112.819160:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb4b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.819260:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 35 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.819286:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 35 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.819310:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130112.819313:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130112.819318:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130112.819396:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:31960:x1876037604861824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 313us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130112.819404:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:0.0:1789130112.826395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130112.826523:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604861952 00000100:00100000:3.0:1789130112.826539:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604861952 00000100:00100000:3.0:1789130112.826693:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789130112.826707:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604861952:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789130112.827174:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130112.829599:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604861952:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 2876us (3204us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1789130112.829633:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789130112.833800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130112.834257:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604862208 00000100:00100000:3.0:1789130112.834351:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604862208 00000100:00100000:3.0:1789130112.834439:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130112.834451:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+35:31960:x1876037604862208:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130112.835382:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:31960:x1876037604862208:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 926us (1591us total) trans 30064771164 rc 0/0 00000100:00100000:2.0:1789130112.835395:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789130112.849385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.849549:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604862464 00000100:00100000:0.0:1789130112.849577:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604862464 00000100:00100000:0.0:1789130112.849754:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1789130112.849767:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+36:31960:x1876037604862464:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130112.849976:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+36:31960:x1876037604862464:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 211us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130112.849987:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789130112.857426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130112.857740:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604862592 00000100:00100000:0.0:1789130112.857754:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604862592 00000100:00100000:0.0:1789130112.857829:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:0.0:1789130112.857842:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+36:31960:x1876037604862592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130112.857872:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130112.857912:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9104 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb52 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.859460:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.859488:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.859529:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130112.862784:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130112.862845:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.862921:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9104 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb52 expref: 38 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.862962:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb52 expref: 37 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130112.862974:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789130112.862976:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789130112.862981:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:0.0:1789130112.863109:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:31960:x1876037604862592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5267us (5697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130112.863122:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130112.873431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.873545:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604862720 00000100:00100000:2.0:1789130112.873561:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604862720 00000100:00100000:2.0:1789130112.873676:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130112.873712:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604862720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130112.873739:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130112.873769:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb59 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130112.873806:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f580, blocks: 0x1 00010000:00010000:2.0:1789130112.873836:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=1275s v=(0 0) 00010000:00010000:2.0:1789130112.873842:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130112.873855:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 10 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.873877:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 10 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.873907:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:2.0:1789130112.874022:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604862720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 313us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130112.874032:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789130112.881808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.882478:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604862976 00000100:00100000:2.0:1789130112.882494:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604862976 00000100:00100000:2.0:1789130112.882584:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1789130112.882597:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:31960:x1876037604862976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130112.882815:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:31960:x1876037604862976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 219us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130112.882824:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:1.0:1789130112.889853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130112.890129:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863104 00000100:00100000:2.0:1789130112.890144:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863104 00000100:00100000:2.0:1789130112.890460:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130112.890474:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:31960:x1876037604863104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130112.890501:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130112.890530:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb60 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.890581:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.890594:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130112.890629:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130112.890637:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 11 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.890683:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130112.890700:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130112.890719:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626798080:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130112.890849:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130112.895216:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626798080:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130112.895408:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 11 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130112.895441:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:3.0:1789130112.895554:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:31960:x1876037604863104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5082us (5715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130112.895566:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130112.898073:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130112.898331:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863232 00000100:00100000:1.0:1789130112.898362:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863232 00010000:00010000:1.0:1789130112.898421:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130112.898524:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130112.898536:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037604863232:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130112.898558:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130112.898588:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130112.898628:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130112.898661:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff25c04c/0x5c74554e47ce9112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb59 expref: 11 pid: 37658 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130112.898688:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130112.898693:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130112.898704:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130112.898716:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130112.898767:0:36574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130112.898801:0:36574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626798208:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130112.898910:0:36574:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130112.920663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130112.921056:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863360 00000100:00100000:3.0:1789130112.921071:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863360 00002000:00100000:3.0:1789130112.921139:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b48a172d00 x1876037604863360/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:583/0 lens 4584/0 e 0 to 0 dl 1789130123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789130112.921154:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48a172d00 with x1876037604863360 ext(0->4095) 00002000:00010000:3.0:1789130112.921170:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48a172d00 00000100:00100000:3.0:1789130112.921205:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130112.921215:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037604863360:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130112.922786:0:36574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626798208:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130112.922820:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130112.923642:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604863360:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 2420us (3032us total) trans 30064771083 rc 0/0 00000100:00100000:3.0:1789130112.923658:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00002000:00100000:3.0:1789130112.923673:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b48a172d00 x1876037604863360/t30064771083(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:583/0 lens 4584/448 e 0 to 0 dl 1789130123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789130112.923685:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48a172d00 with x1876037604863360 ext(0->4095) 00002000:00010000:3.0:1789130112.923694:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48a172d00 00000100:00100000:2.0:1789130112.928261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130112.929791:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863488 00000100:00100000:1.0:1789130112.929813:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863488 00000100:00100000:1.0:1789130112.929908:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1789130112.929921:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:31960:x1876037604863488:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789130112.936922:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037604863232:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 38365us (38839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130112.936955:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000001:00080000:0.0:1789130113.055861:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771163 is committed 00000001:00080000:0.0:1789130113.055904:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771158 is committed 00000001:00080000:0.0:1789130113.055956:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771164 is committed 00000004:00080000:0.0:1789130113.055965:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1789130113.056401:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:31960:x1876037604863488:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 126473us (128148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130113.056415:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:3.0:1789130113.060363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.060519:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863616 00000100:00100000:1.0:1789130113.060533:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863616 00000100:00100000:1.0:1789130113.060667:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130113.060682:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604863616:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789130113.061429:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130113.061453:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626798336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789130113.061534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130113.061807:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626798336 00000100:00100000:3.0:1789130113.061835:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626798336 00000100:00080000:1.0:1789130113.062055:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130113.062112:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130113.062124:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626798336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130113.062157:0:37276:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:194 count 1 00010000:00010000:3.0:1789130113.062190:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.062217:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.062230:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789130113.062236:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130113.062241:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.062400:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.062419:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 9 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.062432:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626798464:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130113.062573:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b240 going to sleep for 11 seconds 00000020:00080000:0.0:1789130113.062768:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4917610c0 refcount 2 committed 0 result 0 batchid 25769803899 00000020:00080000:0.0:1789130113.062786:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b6653800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b491761a80 00000020:00080000:0.0:1789130113.062790:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b6653600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4ba48a800 00000020:00080000:0.0:1789130113.062809:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803898 batchid updated 00000020:00080000:1.0:1789130113.065390:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803899 committed batchid 25769803898 00000020:00080000:1.0:1789130113.065684:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803898 00000100:00100000:0.0:1789130113.084245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.087500:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626798464:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130113.087546:0:37276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.087852:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604863744 00000100:00100000:2.0:1789130113.087862:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604863744 00010000:00010000:2.0:1789130113.087967:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.088024:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130113.088036:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+10:2370:x1876037604863744:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130113.088059:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130113.088066:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.088081:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.088113:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47ce9078 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb28 expref: 10 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.088134:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130113.088139:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130113.088145:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.088157:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.088198:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130113.088287:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+9:2370:x1876037604863744:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 251us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.088297:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00080000:3.0:1789130113.089086:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130113.089288:0:37276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.089303:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.089315:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.089323:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.089355:0:37276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130113.090230:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626798336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28104us (28691us total) trans 30064771084 rc 0/0 00000100:00100000:3.0:1789130113.090244:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:3.0:1789130113.090326:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382e65a40/2, rc 0, transno 30064771084 00000100:00100000:3.0:1789130113.090343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626798336:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789130113.090617:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130113.090628:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.090642:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130113.090647:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.090660:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.090686:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.090695:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028febcdb/0x5c74554e47ce9120 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.090720:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130113.090722:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130113.090724:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130113.146460:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771081 is committed 00000001:00080000:3.0:1789130113.146500:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771078 is committed 00000001:00080000:3.0:1789130113.146509:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771077 is committed 00000001:00080000:3.0:1789130113.146515:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771083 is committed 00000100:00100000:1.0:1789130113.147003:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604863616:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 86313us (86728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130113.147019:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789130113.150978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.152427:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864000 00000100:00100000:1.0:1789130113.152445:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864000 00000100:00100000:1.0:1789130113.152599:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:1.0:1789130113.152646:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:31960:x1876037604864000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130113.152724:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130113.152767:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce910b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb52 expref: 13 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.152813:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789130113.152821:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130113.152865:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.152908:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.152920:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130113.153169:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000000625dbf reply state 000000007498625e transno 30064771165 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.153180:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130113.154646:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:31960:x1876037604864000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1993us (3757us total) trans 30064771165 rc 0/0 00000100:00100000:1.0:1789130113.154662:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00080000:3.0:1789130113.156535:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130113.160059:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160083:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160118:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160126:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130113.160132:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160142:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160165:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789130113.160169:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130113.160175:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.160182:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9127 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.162242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.162851:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864128 00000100:00100000:3.0:1789130113.162866:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864128 00000100:00100000:3.0:1789130113.162979:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130113.162992:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604864128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789130113.163376:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1789130113.163382:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1789130111 00002000:00010000:3.0:1789130113.163384:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1789130111 00002000:00010000:3.0:1789130113.163387:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1789130112 -> 1789130111 00002000:00010000:3.0:1789130113.163390:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789130113.163481:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604864128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 490us (1252us total) trans 30064771085 rc 0/0 00000100:00100000:3.0:1789130113.163491:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130113.172309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.172421:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864384 00000100:00100000:0.0:1789130113.172435:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864384 00000100:00100000:0.0:1789130113.172512:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789130113.172529:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:31960:x1876037604864384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789130113.172668:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.172689:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 13 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.172700:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.172745:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 13 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.172761:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 13 pid: 36588 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.172779:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bb8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626798592:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130113.173091:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130113.176786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.177527:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864512 00000100:00100000:3.0:1789130113.177539:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864512 00010000:00010000:3.0:1789130113.177644:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 14 pid: 36588 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.177721:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789130113.177735:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604864512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130113.177759:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130113.177768:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 14 pid: 36588 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.177784:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 14 pid: 36588 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.177852:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:3.0:1789130113.177858:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.177870:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.177880:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.178188:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130113.178443:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce90ef lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb44 expref: 14 pid: 36588 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.178476:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bb8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626798592:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130113.178505:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178515:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178522:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178563:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178571:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178579:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178586:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130113.178591:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178630:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178643:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789130113.178646:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789130113.178651:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.178666:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce912e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.178892:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604864512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1149us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130113.178905:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130113.183098:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:31960:x1876037604864384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 10557us (10785us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789130113.183120:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789130113.187783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.187863:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864640 00000100:00100000:1.0:1789130113.187876:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864640 00000100:00100000:1.0:1789130113.188097:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130113.188110:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604864640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789130113.188182:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.188874:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.188926:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789130113.188940:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130113.188947:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.189009:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.189030:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 7 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.189050:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626798720:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130113.189168:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130113.192962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.193105:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604864768 00000100:00100000:0.0:1789130113.193119:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604864768 00010000:00010000:0.0:1789130113.193176:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 8 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.193223:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130113.193235:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604864768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130113.193254:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130113.193295:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 8 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.193312:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 8 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.193346:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130113.193351:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130113.193358:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.193395:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.193429:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130113.193502:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604864768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 268us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130113.193510:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00010000:00010000:1.0:1789130113.194958:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47ce9119 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb60 expref: 7 pid: 37275 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.194993:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626798720:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130113.195024:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195037:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195045:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195107:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195117:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195128:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195136:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130113.195141:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195153:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195174:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.195182:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a88a6733/0x5c74554e47ce9135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.195831:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604864640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7718us (8057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130113.195858:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1789130113.200237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.200389:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865024 00000100:00100000:1.0:1789130113.200404:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865024 00000100:00100000:1.0:1789130113.200490:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:1.0:1789130113.200502:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:31960:x1876037604865024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130113.200657:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.200678:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.200692:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.201038:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.201052:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 13 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.201061:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.201104:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 13 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.201122:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 13 pid: 38734 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.201152:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626798848:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130113.201445:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130113.205499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.205680:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626798848:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130113.205721:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.206022:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865152 00000100:00100000:2.0:1789130113.206049:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865152 00010000:00010000:2.0:1789130113.206100:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 14 pid: 38734 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.206143:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130113.206154:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604865152:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130113.206174:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130113.206183:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 14 pid: 38734 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206196:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 14 pid: 38734 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206224:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce90fd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb4b expref: 14 pid: 38734 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206243:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789130113.206249:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206260:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206392:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.206442:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130113.206518:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604865152:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 364us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.206537:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00010000:00010000:1.0:1789130113.207878:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.207904:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130113.208424:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771166 00000001:00080000:1.0:1789130113.209598:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771167 00000001:00080000:1.0:1789130113.209744:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771168 00000100:00100000:1.0:1789130113.210195:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626798976:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130113.210439:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130113.210539:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130113.211126:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626798976 00000100:00100000:2.0:1789130113.211137:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626798976 00000100:00100000:2.0:1789130113.211250:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130113.211340:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38734:x1876037626798976:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789130113.211488:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38734:x1876037626798976:12345-0@lo:1000:mdt00_004.0 Request processed in 226us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.211497:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130113.211627:0:38734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771078 gen 2 00000004:00080000:3.0:1789130113.211636:0:38734:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771078 00000100:00100000:3.0:1789130113.211673:0:38734:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b382e65a40 x1876037626798336/t30064771084(30064771084) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130129 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130113.211689:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626798976:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789130113.212537:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771169 00000100:00100000:3.0:1789130113.212810:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626799104:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789130113.213069:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130113.213590:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130113.213815:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626799104 00000100:00100000:1.0:1789130113.213826:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626799104 00000100:00100000:1.0:1789130113.213895:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130113.213906:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38734:x1876037626799104:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130113.214239:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:38734:x1876037626799104:12345-0@lo:1000:mdt00_004.0 Request processed in 333us (1253us total) trans 30064771086 rc 0/0 00000100:00100000:1.0:1789130113.214249:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130113.214584:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626799104:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789130113.214681:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214694:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214704:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214711:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.214717:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214727:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214748:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:3.0:1789130113.214751:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130113.214757:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214765:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce9143 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214804:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214810:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214815:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214830:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.214834:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214841:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214850:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130113.214853:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130113.214863:0:38734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.214876:0:38734:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.215127:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.215173:0:38734:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.215192:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626799232:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130113.215465:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130113.219453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.219545:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865280 00000100:00100000:0.0:1789130113.219565:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865280 00000100:00100000:0.0:1789130113.219667:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130113.219679:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604865280:12345-192.168.201.39@tcp:49:mmap_sanity.0 00000100:00100000:0.0:1789130113.219847:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604865280:12345-192.168.201.39@tcp:49:mmap_sanity.0 Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130113.219856:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00080000:1.0:1789130113.220735:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130113.222331:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626799232:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130113.222374:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222413:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce907f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222460:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222479:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222494:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222506:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222514:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222521:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222528:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.222533:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222542:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222555:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130113.222571:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130113.222576:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222589:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce914a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222639:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222647:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222653:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222658:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.222663:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222669:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222679:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130113.222682:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130113.222685:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.222692:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce913c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130113.223374:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130113.223381:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130113.223414:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:2.0:1789130113.223422:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130113.223666:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:31960:x1876037604865024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 23162us (23440us total) trans 30064771170 rc 0/0 00000100:00100000:3.0:1789130113.223681:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000020:00080000:3.0:1789130113.223696:0:38734:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789130113.227196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.227381:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865408 00000100:00100000:2.0:1789130113.227396:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865408 00000100:00100000:2.0:1789130113.227480:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130113.227495:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:31950:x1876037604865408:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130113.227523:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130113.227568:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb67 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130113.227651:0:38727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6aa3f57f, atime: 0x6aa3f57f, ctime: 0x6aa3f57f, blocks: 0xb 00010000:00010000:2.0:1789130113.227684:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=1276s v=(0 0) 00010000:00010000:2.0:1789130113.227689:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130113.227702:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 6 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.227758:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 6 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.227778:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130113.227851:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:31950:x1876037604865408:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 360us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.227861:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130113.234150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.234598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.235023:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865792 00000100:00100000:2.0:1789130113.235040:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865792 00002000:00100000:2.0:1789130113.235115:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a4000 x1876037604865792/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 488/0 e 0 to 0 dl 1789130124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130113.235129:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4000 with x1876037604865792 ext(0->4095) 00002000:00010000:2.0:1789130113.235137:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a4000 00000100:00100000:2.0:1789130113.235172:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130113.235185:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604865792:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:2.0:1789130113.235485:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604865792:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 302us (887us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789130113.235495:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00002000:00100000:2.0:1789130113.235502:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a4000 x1876037604865792/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 488/4536 e 0 to 0 dl 1789130124 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789130113.235510:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4000 with x1876037604865792 ext(0->4095) 00002000:00010000:2.0:1789130113.235514:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a4000 00000100:00100000:0.0:1789130113.235870:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865664 00000100:00100000:0.0:1789130113.235877:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865664 00000100:00100000:0.0:1789130113.235916:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130113.235924:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:31960:x1876037604865664:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130113.237149:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789130113.237549:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771171 00010000:00010000:0.0:1789130113.237740:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.237763:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.237788:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.238110:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.238117:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.238123:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.238153:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130113.238504:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+18:31960:x1876037604865664:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2573us (4367us total) trans 30064771172 rc 0/0 00000100:00100000:0.0:1789130113.238527:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000020:00080000:0.0:1789130113.238535:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789130113.238689:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130113.238711:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.238720:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130113.238725:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.238736:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.238754:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:2.0:1789130113.238757:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130113.238763:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.238769:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9158 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.238796:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130113.238798:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130113.238800:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130113.244397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.244749:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604865920 00000100:00100000:2.0:1789130113.244764:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604865920 00000100:00100000:2.0:1789130113.245108:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:2.0:1789130113.245123:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:31950:x1876037604865920:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130113.245156:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130113.245188:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce915f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb6e expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.245283:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce915f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb6e expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.245330:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce915f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb6e expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.245356:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130113.245360:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130113.245366:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:2.0:1789130113.245450:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604865920:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 330us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.245458:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789130113.248428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.248821:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866048 00000100:00100000:1.0:1789130113.248836:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866048 00000100:00100000:1.0:1789130113.248915:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130113.248928:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:31950:x1876037604866048:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130113.248961:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130113.248990:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb75 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.249036:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 5 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.249048:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130113.249053:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130113.249060:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.249106:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 5 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.249123:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 5 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.249139:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626799360:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130113.249514:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130113.252944:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626799360:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130113.253003:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.253034:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130113.253123:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:31950:x1876037604866048:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 4196us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130113.253136:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130113.256116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.256230:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866176 00000100:00100000:3.0:1789130113.256245:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866176 00002000:00100000:3.0:1789130113.256330:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a70c0 x1876037604866176/t0(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 4584/0 e 0 to 0 dl 1789130124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.256344:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a70c0 with x1876037604866176 ext(0->4095) 00010000:00010000:3.0:1789130113.256358:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 6 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.256380:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 6 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130113.256389:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4bd9a70c0 00000100:00100000:3.0:1789130113.256469:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1789130113.256482:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604866176:12345-192.168.201.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789130113.257146:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2370:x1876037604866176:12345-192.168.201.39@tcp:4:ldlm_bl.0 Request processed in 662us (1042us total) trans 30064771087 rc 0/0 00000100:00100000:3.0:1789130113.257157:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:3.0:1789130113.257166:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a70c0 x1876037604866176/t30064771087(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 4584/448 e 0 to 0 dl 1789130124 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.257176:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a70c0 with x1876037604866176 ext(0->4095) 00010000:00010000:3.0:1789130113.257184:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.257223:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130113.257231:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4bd9a70c0 00000100:00100000:1.0:1789130113.261415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.261531:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866304 00000100:00100000:0.0:1789130113.261545:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866304 00010000:00010000:0.0:1789130113.261742:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.261971:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130113.261984:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+8:2367:x1876037604866304:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130113.262003:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130113.262028:0:36572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1789130111 -> 1789130112 00002000:00010000:0.0:1789130113.262032:0:36572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1789130111 -> 1789130112 00010000:00010000:0.0:1789130113.262058:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.262076:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.262108:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9151 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb67 expref: 8 pid: 38727 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.262130:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130113.262135:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130113.262147:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.262160:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.262207:0:36572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.262226:0:36572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bbb840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626799488:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130113.262495:0:36572:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130113.268186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.268626:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866432 00000100:00100000:3.0:1789130113.268641:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866432 00002000:00100000:3.0:1789130113.268716:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b382bba1c0 x1876037604866432/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:584/0 lens 488/0 e 0 to 0 dl 1789130124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.268731:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bba1c0 with x1876037604866432 ext(0->4095) 00002000:00010000:3.0:1789130113.268738:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bba1c0 00000100:00100000:3.0:1789130113.268780:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130113.268803:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604866432:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130113.269114:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604866432:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 323us (944us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130113.269125:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00002000:00100000:3.0:1789130113.269133:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b382bba1c0 x1876037604866432/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:584/0 lens 488/4536 e 0 to 0 dl 1789130124 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.269142:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bba1c0 with x1876037604866432 ext(0->4095) 00002000:00010000:3.0:1789130113.269146:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bba1c0 00000100:00100000:2.0:1789130113.271214:0:36572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bbb840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626799488:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130113.271254:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130113.271529:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+7:2367:x1876037604866304:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 9545us (10126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130113.271544:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130113.275198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.275394:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866560 00000100:00100000:1.0:1789130113.275409:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866560 00000100:00100000:1.0:1789130113.275489:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130113.275500:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+7:31950:x1876037604866560:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130113.275527:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130113.275551:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb7c expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.275647:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.275660:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130113.275666:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789130113.275672:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.275743:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.275761:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 6 pid: 37658 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130113.275780:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626799616:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130113.275890:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130113.282748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.282923:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866688 00000100:00100000:2.0:1789130113.282945:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866688 00010000:00010000:2.0:1789130113.283005:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.283057:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1789130113.283070:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604866688:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130113.283090:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130113.283123:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.283139:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.283205:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789130113.283211:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789130113.283224:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.283236:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.283480:0:36574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.283499:0:36574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626799744:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130113.283660:0:36574:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568840 going to sleep for 11 seconds 00010000:00010000:0.0:1789130113.285092:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000445471d/0x5c74554e47ce9166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abb75 expref: 7 pid: 37658 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130113.285124:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626799616:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130113.285164:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.285181:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:0.0:1789130113.285282:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+8:31950:x1876037604866560:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 9783us (10098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130113.285293:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130113.304481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.304686:0:36574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626799744:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130113.304723:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130113.304796:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604866688:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 21726us (22064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130113.304811:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130113.306662:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604866816 00000100:00100000:3.0:1789130113.306680:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604866816 00002000:00100000:3.0:1789130113.306759:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a7480 x1876037604866816/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 488/0 e 0 to 0 dl 1789130124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.306802:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a7480 with x1876037604866816 ext(0->4095) 00002000:00010000:3.0:1789130113.306811:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a7480 00000100:00100000:3.0:1789130113.306859:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130113.306870:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604866816:12345-192.168.201.39@tcp:3:kworker.0 00000100:00100000:3.0:1789130113.307592:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec5d7172-884c-4596-96b1-f5256d22e019+8:2369:x1876037604866816:12345-192.168.201.39@tcp:3:kworker.0 Request processed in 719us (3125us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130113.307631:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00002000:00100000:3.0:1789130113.307640:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->4095) req@ffff90b4bd9a7480 x1876037604866816/t0(0) o3->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:584/0 lens 488/4536 e 0 to 0 dl 1789130124 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789130113.307650:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a7480 with x1876037604866816 ext(0->4095) 00002000:00010000:3.0:1789130113.307654:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a7480 00000100:00100000:1.0:1789130113.319667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.323002:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604867072 00000100:00100000:2.0:1789130113.323024:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604867072 00000100:00100000:2.0:1789130113.323199:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130113.323214:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a782b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+11:31950:x1876037604867072:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000001:00080000:2.0:1789130113.324831:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771173 00000100:00100000:2.0:1789130113.325227:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a782b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec5d7172-884c-4596-96b1-f5256d22e019+13:31950:x1876037604867072:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 2009us (5981us total) trans 30064771174 rc 0/0 00000100:00100000:2.0:1789130113.326027:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000020:00080000:2.0:1789130113.326036:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130113.329852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.335935:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604867328 00000100:00100000:0.0:1789130113.335959:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604867328 00000100:00100000:0.0:1789130113.336066:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789130113.336081:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:31950:x1876037604867328:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789130113.338025:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604867328:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 1934us (8172us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1789130113.338041:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130113.342236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130113.342456:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604867456 00000100:00100000:0.0:1789130113.342471:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604867456 00000100:00100000:0.0:1789130113.342545:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130113.342556:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604867456:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789130113.342592:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130113.342641:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9174 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb83 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343234:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343255:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343270:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343290:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343298:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.343318:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.346761:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.346787:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348736:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130113.348807:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1789130113.348814:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130113.348844:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348863:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348874:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348881:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348889:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348896:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130113.348902:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348944:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348960:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130113.348964:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130113.348970:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348977:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce917b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.348996:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349002:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349008:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349014:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130113.349017:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349293:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349305:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff90b4909bd500) 00010000:00010000:1.0:1789130113.349307:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130113.349312:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349329:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9182 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349395:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9174 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb83 expref: 22 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349414:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb83 expref: 21 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.349423:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130113.349425:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130113.349428:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:1.0:1789130113.349547:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604867456:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 6990us (7322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130113.349558:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:1.0:1789130113.356103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.356277:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604867712 00000100:00100000:2.0:1789130113.356293:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604867712 00000100:00100000:2.0:1789130113.356454:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:2.0:1789130113.356467:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604867712:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789130113.356547:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130113.356588:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9189 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb83 expref: 21 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356688:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce915f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb6e expref: 20 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356703:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130113.356710:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130113.356762:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356779:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356805:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356827:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356835:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.356865:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.357899:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.357915:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.357926:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130113.361510:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].5, 64 off8560 00000004:00080000:2.0:1789130113.361542:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1276458938339ns, next at 1277458932522ns, rc = 0 00010000:00010000:2.0:1789130113.361728:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361753:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361769:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361782:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361791:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361798:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361850:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130113.361884:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361892:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361900:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361908:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130113.361914:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361924:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361955:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130113.361959:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130113.361966:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361974:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce919e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.361999:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362007:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362026:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362033:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130113.362036:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362044:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362055:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130113.362058:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130113.362061:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.362069:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9190 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130113.362082:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b6571042 reply state 00000000a1672511 transno 30064771176 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.362095:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130113.362229:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+21:31950:x1876037604867712:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 5758us (6134us total) trans 30064771176 rc 0/0 00000100:00100000:2.0:1789130113.362241:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00010000:00010000:1.0:1789130113.362857:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130113.362870:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.362879:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130113.362885:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.362894:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.362912:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130113.362923:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130113.362939:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.362946:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce91a5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.362960:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130113.362962:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130113.362964:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130113.375461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130113.376441:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376461:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376497:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376504:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130113.376510:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376519:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376539:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130113.376542:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130113.376547:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.376553:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9197 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.376620:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604867968 00000100:00100000:2.0:1789130113.376633:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604867968 00000100:00100000:2.0:1789130113.376707:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:2.0:1789130113.376719:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:31950:x1876037604867968:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130113.376754:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130113.376778:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce91ac lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb8a expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379565:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379634:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379652:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379673:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379682:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.379691:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.381971:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce91c1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.381997:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce91c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.382012:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce91c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130113.382027:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789130113.382070:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.382078:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.382085:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.382104:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130113.382110:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.382119:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.383519:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130113.383523:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130113.383532:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.383540:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce91b3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130113.383561:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000340d620a reply state 00000000d6e6e89f transno 30064771177 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.383571:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130113.383651:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce91ac lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb8a expref: 23 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.383672:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce91c1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb8a expref: 22 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.383681:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130113.383684:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130113.383687:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:2.0:1789130113.383786:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:31950:x1876037604867968:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 7067us (8355us total) trans 30064771177 rc 0/0 00000100:00100000:2.0:1789130113.385671:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00010000:00010000:3.0:1789130113.392270:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392293:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392303:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392310:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.392316:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392326:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392366:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff90b48a1fdb00) 00010000:00010000:3.0:1789130113.392370:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130113.392377:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.392385:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce91ba lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.482220:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130113.537107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.537261:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604868224 00000100:00100000:1.0:1789130113.537275:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604868224 00000100:00100000:1.0:1789130113.537373:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130113.537386:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:31950:x1876037604868224:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789130113.537882:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:31950:x1876037604868224:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 497us (789us total) trans 30064771178 rc 0/0 00000100:00100000:1.0:1789130113.537891:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130113.544747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.544798:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604868480 00000100:00100000:1.0:1789130113.544811:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604868480 00000100:00100000:1.0:1789130113.544884:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:1.0:1789130113.544896:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:31950:x1876037604868480:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130113.544942:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130113.544969:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce91cf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb91 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.545100:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce91d6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.545134:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce91d6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.545148:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce91d6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130113.545179:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789130113.545354:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce91cf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb91 expref: 26 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.545376:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce91d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb91 expref: 25 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.545385:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:1.0:1789130113.545388:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130113.545392:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:1.0:1789130113.545465:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604868480:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 572us (732us total) trans 30064771179 rc 0/0 00000100:00100000:1.0:1789130113.545475:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:0.0:1789130113.673317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.675633:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604868736 00000100:00100000:2.0:1789130113.675657:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604868736 00000100:00100000:2.0:1789130113.675755:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130113.675768:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604868736:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1789130113.676138:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604868736:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 371us (2835us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1789130113.676146:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789130113.680042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130113.680106:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604868992 00000100:00100000:3.0:1789130113.680119:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604868992 00000100:00100000:3.0:1789130113.680194:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:3.0:1789130113.680208:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604868992:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789130113.680298:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130113.680336:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce91d6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb91 expref: 26 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680360:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce91c1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb8a expref: 25 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680372:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:3.0:1789130113.680387:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130113.680421:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680437:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680463:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680482:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680489:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680496:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680671:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680680:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.680688:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681237:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681248:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681257:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681264:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681282:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681289:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681319:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130113.681345:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681351:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681358:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681365:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.681370:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681378:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681387:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130113.681390:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130113.681395:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130113.681397:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681400:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681416:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130113.681418:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce91f2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681422:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681435:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681442:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681457:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130113.681459:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681463:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130113.681469:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681471:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681480:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce91f9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681483:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130113.681489:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681499:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.681502:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130113.681506:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130113.681510:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130113.681513:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130113.681518:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130113.681522:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130113.681527:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce91e4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130113.681539:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000659cd649 reply state 00000000dbe1bbc3 transno 30064771181 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.681548:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130113.681689:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:31950:x1876037604868992:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1481us (1673us total) trans 30064771181 rc 0/0 00000100:00100000:3.0:1789130113.681700:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:3.0:1789130113.686475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130113.686536:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686554:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686563:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686570:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130113.686576:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686585:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686630:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff90b488939100) 00010000:00010000:0.0:1789130113.686634:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130113.686641:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130113.686648:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce91eb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.686758:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604869248 00000100:00100000:2.0:1789130113.686771:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604869248 00000100:00100000:2.0:1789130113.686849:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:2.0:1789130113.686861:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:31950:x1876037604869248:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789130113.686891:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130113.686915:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9200 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb98 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687109:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687126:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687139:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687154:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687173:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.687180:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688072:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9215 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688088:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9215 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688098:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9215 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130113.688112:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1789130113.688147:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688154:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688161:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688167:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130113.688172:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688180:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688214:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130113.688217:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130113.688223:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688230:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9207 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130113.688245:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000372e2f6a reply state 0000000086aa72e1 transno 30064771182 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130113.688256:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130113.688299:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9200 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb98 expref: 28 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688317:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9215 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb98 expref: 27 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130113.688326:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130113.688329:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130113.688332:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130113.688435:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:31950:x1876037604869248:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 1576us (1976us total) trans 30064771182 rc 0/0 00000100:00100000:2.0:1789130113.688446:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00010000:00010000:1.0:1789130113.691227:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691253:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691261:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691268:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130113.691274:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691283:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691314:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff90b48a1fd800) 00010000:00010000:1.0:1789130113.691318:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130113.691324:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.691350:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce920e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130113.937752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130113.938047:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604869504 00000100:00100000:2.0:1789130113.938062:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604869504 00000100:00100000:2.0:1789130113.938139:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:2.0:1789130113.938151:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:31950:x1876037604869504:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1789130113.938682:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:31950:x1876037604869504:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 531us (943us total) trans 30064771183 rc 0/0 00000100:00100000:2.0:1789130113.938691:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130113.947584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130113.948415:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604869760 00000100:00100000:1.0:1789130113.948433:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604869760 00000100:00100000:1.0:1789130113.948532:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:1.0:1789130113.948547:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:31950:x1876037604869760:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130113.948585:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130113.948652:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9223 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abb9f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.948796:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce922a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.948815:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce922a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.948833:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce922a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130113.948847:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:1.0:1789130113.949036:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9223 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb9f expref: 31 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.949060:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce922a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb9f expref: 30 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130113.949069:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130113.949087:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130113.949092:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:1.0:1789130113.949189:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+30:31950:x1876037604869760:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 644us (1620us total) trans 30064771184 rc 0/0 00000100:00100000:1.0:1789130113.949198:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:2.0:1789130114.083544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130114.086554:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870016 00000100:00100000:1.0:1789130114.086576:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870016 00000100:00100000:1.0:1789130114.086691:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789130114.086704:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:31950:x1876037604870016:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789130114.087090:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604870016:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 387us (3559us total) trans 30064771185 rc 0/0 00000100:00100000:1.0:1789130114.087101:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130114.097857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130114.098199:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870272 00000100:00100000:3.0:1789130114.098214:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870272 00000100:00100000:3.0:1789130114.098307:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:3.0:1789130114.098320:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604870272:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789130114.098409:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130114.098451:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce922a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb9f expref: 31 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098481:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce9215 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb98 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098494:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:3.0:1789130114.098508:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130114.098540:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098556:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098569:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098587:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098594:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098675:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098849:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098859:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.098879:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099472:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099483:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099491:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099500:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099506:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099512:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099545:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130114.099571:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099578:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099593:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099599:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130114.099640:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099650:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099661:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130114.099665:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130114.099669:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099676:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9246 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099697:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099703:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099709:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099714:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130114.099717:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099733:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099742:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130114.099744:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130114.099747:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130114.099753:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9238 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130114.099763:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d054f450 reply state 00000000780efe10 transno 30064771186 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130114.099773:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130114.099893:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604870272:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 1572us (2050us total) trans 30064771186 rc 0/0 00000100:00100000:3.0:1789130114.099903:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00010000:00010000:0.0:1789130114.100781:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130114.100804:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.100813:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130114.100817:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.100826:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.100843:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff90b488939500) 00010000:00010000:0.0:1789130114.100846:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130114.100850:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.100856:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce924d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.100890:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130114.100892:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130114.100893:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130114.107325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130114.107381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130114.107525:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870528 00000100:00100000:1.0:1789130114.107538:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870528 00000100:00100000:1.0:1789130114.107655:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:1.0:1789130114.107668:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31950:x1876037604870528:12345-192.168.201.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789130114.107701:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130114.107732:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9254 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abba6 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130114.107887:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce925b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130114.107906:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce925b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130114.107930:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce925b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130114.107967:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789130114.108153:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9254 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abba6 expref: 34 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130114.108176:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce925b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abba6 expref: 33 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130114.108186:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789130114.108189:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130114.108194:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:1.0:1789130114.108286:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31950:x1876037604870528:12345-192.168.201.39@tcp:101:mmap_sanity.0 Request processed in 621us (979us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1789130114.108295:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00010000:00010000:0.0:1789130114.108642:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108651:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108659:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108666:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130114.108671:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108690:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108704:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff90b488939c00) 00010000:00010000:0.0:1789130114.108707:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130114.108713:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.108719:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce923f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130114.108821:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870656 00000100:00100000:2.0:1789130114.108829:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870656 00000100:00100000:2.0:1789130114.108888:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130114.108898:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+8:31333:x1876037604870656:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130114.108911:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130114.108964:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce916d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb7c expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130114.108986:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130114.109024:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+7:31333:x1876037604870656:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 128us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130114.109031:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789130114.114262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130114.114429:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870784 00000100:00100000:1.0:1789130114.114443:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870784 00002000:00100000:1.0:1789130114.114532:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->409599) req@ffff90b382749680 x1876037604870784/t0(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:585/0 lens 488/0 e 0 to 0 dl 1789130125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789130114.114558:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382749680 with x1876037604870784 ext(0->409599) 00002000:00010000:1.0:1789130114.114565:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382749680 00000100:00100000:1.0:1789130114.114687:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130114.114703:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604870784:12345-192.168.201.39@tcp:4:mmap_sanity.0 00000100:00080000:3.0:1789130114.115275:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130114.138438:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:2367:x1876037604870784:12345-192.168.201.39@tcp:4:mmap_sanity.0 Request processed in 23720us (24173us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1789130114.138455:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00002000:00100000:0.0:1789130114.138472:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->409599) req@ffff90b382749680 x1876037604870784/t30064771085(0) o4->ec5d7172-884c-4596-96b1-f5256d22e019@192.168.201.39@tcp:585/0 lens 488/448 e 0 to 0 dl 1789130125 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789130114.138485:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382749680 with x1876037604870784 ext(0->409599) 00002000:00010000:0.0:1789130114.138493:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382749680 00000100:00100000:3.0:1789130114.144036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130114.147406:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604870912 00000100:00100000:0.0:1789130114.147435:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604870912 00000100:00100000:0.0:1789130114.147572:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1789130114.147585:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+8:31850:x1876037604870912:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130114.147653:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130114.147682:0:36573:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1789130107 -> 1789130111 00002000:00010000:0.0:1789130114.147687:0:36573:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789130107 -> 1789130111 00010000:00010000:0.0:1789130114.147722:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077708524/0x5c74554e47ce9071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb21 expref: 8 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130114.147784:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130114.147886:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+7:31850:x1876037604870912:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 303us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130114.147896:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000004:00080000:2.0:1789130114.312735:0:36612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1277410128637ns, next at 1278410125158ns, rc = 0 00000100:00100000:2.0:1789130114.312803:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626800256:0@lo:400:kworker.0 00000100:00100000:1.0:1789130114.312836:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626800384:0@lo:400:kworker.0 00000100:00100000:2.0:1789130114.312908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130114.312909:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626800000:0@lo:400:kworker.0 00000100:00100000:3.0:1789130114.313038:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626800128:0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.313106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130114.316199:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626799872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130114.316296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130114.316305:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800000 00000100:00100000:2.0:1789130114.316316:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800000 00000100:00100000:0.0:1789130114.316329:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626800512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.316359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130114.316382:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789130114.316394:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.316419:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626799872 00000100:00100000:0.0:1789130114.316423:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626799872 00000100:00100000:2.0:1789130114.316462:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626800000:12345-0@lo:400:kworker.0 Request processed in 71us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130114.316481:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130114.316487:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789130114.316487:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626799872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130114.316507:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789130114.316544:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626799872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130114.316550:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130114.316552:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626800000:0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.316570:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800256 00000100:00100000:2.0:1789130114.316574:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626799872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130114.316575:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800256 00000100:00100000:2.0:1789130114.316628:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800512 00000100:00100000:0.0:1789130114.316628:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130114.316632:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800512 00000100:00100000:0.0:1789130114.316636:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626800256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130114.316662:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130114.316669:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626800512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.316674:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626800256:12345-0@lo:400:kworker.0 Request processed in 40us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130114.316690:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130114.316702:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626800512:12345-0@lo:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130114.316709:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130114.316735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626800256:0@lo:400:kworker.0 00000100:00100000:2.0:1789130114.316757:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626800512:0@lo:400:kworker.0 00000100:00080000:2.0:1789130114.316777:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130114.316784:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130114.318716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130114.321035:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800384 00000100:00100000:2.0:1789130114.321052:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800384 00000100:00100000:2.0:1789130114.321142:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130114.321154:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130114.321510:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626800384:12345-0@lo:400:kworker.0 Request processed in 356us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130114.321519:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130114.326075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130114.326167:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626800640:0@lo:400:kworker.0 00000100:00100000:3.0:1789130114.326230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130114.326419:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800640 00000100:00100000:2.0:1789130114.326430:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800640 00000100:00100000:2.0:1789130114.326530:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789130114.326542:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626800640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130114.326720:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626800640:12345-0@lo:400:kworker.0 Request processed in 177us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130114.326735:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789130114.326859:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130114.326936:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626800640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.327063:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800128 00000100:00100000:0.0:1789130114.327069:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800128 00000100:00100000:0.0:1789130114.327140:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789130114.327149:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626800128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130114.327246:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626800128:12345-0@lo:400:kworker.0 Request processed in 95us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130114.327253:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130114.327354:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626800128:0@lo:400:kworker.0 00000100:00100000:1.0:1789130114.327780:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626800384:0@lo:400:kworker.0 00010000:00010000:1.0:1789130114.503976:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130115.114142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130115.123149:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871168 00000100:00100000:2.0:1789130115.123172:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871168 00000100:00100000:2.0:1789130115.123288:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789130115.123306:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7828c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:31950:x1876037604871168:12345-192.168.201.39@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1789130115.123861:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7828c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:31950:x1876037604871168:12345-192.168.201.39@tcp:35:mmap_sanity.0 Request processed in 549us (9721us total) trans 30064771188 rc 0/0 00000100:00100000:2.0:1789130115.123870:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00080000:3.0:1789130115.125092:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130115.128559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130115.128775:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871424 00000100:00100000:0.0:1789130115.128788:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871424 00000100:00100000:0.0:1789130115.128892:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1789130115.128915:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:31950:x1876037604871424:12345-192.168.201.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789130115.129005:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789130115.129045:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce925b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abba6 expref: 33 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129071:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce8a5f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a0 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129082:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789130115.129095:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130115.129126:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129143:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129156:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129196:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129204:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129210:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129358:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129367:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.129374:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133276:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133305:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133318:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133328:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133335:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133356:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133393:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130115.133425:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133432:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133438:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133444:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130115.133449:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133458:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133474:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130115.133477:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130115.133483:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133489:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9277 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133516:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.133523:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.134905:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130115.134919:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.134931:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130115.134936:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.134945:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.134964:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:2.0:1789130115.134967:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130115.134972:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.134978:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce927e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130115.135039:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130115.135042:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130115.135044:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130115.136383:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.136392:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130115.136397:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.136406:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.136423:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130115.136426:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130115.136431:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130115.136438:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9269 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130115.136459:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000047314783 reply state 00000000ce003d21 transno 30064771189 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130115.136470:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130115.136655:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:31950:x1876037604871424:12345-192.168.201.39@tcp:36:mmap_sanity.0 Request processed in 7737us (8105us total) trans 30064771189 rc 0/0 00000100:00100000:0.0:1789130115.136666:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00010000:00010000:1.0:1789130115.144729:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144754:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144762:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144770:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130115.144777:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144786:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144809:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff90b4a2a08500) 00010000:00010000:1.0:1789130115.144813:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130115.144818:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130115.144826:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9270 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130115.334339:0:36610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1278431732571ns, next at 1279431729182ns, rc = 0 00000100:00100000:1.0:1789130115.334372:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130115.334409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626800768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130115.334529:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130115.334786:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800768 00000100:00100000:0.0:1789130115.334797:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800768 00000100:00080000:3.0:1789130115.334963:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130115.335067:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130115.335082:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626800768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130115.335155:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 59572224 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789130115.335233:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626800768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130115.335242:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130115.335377:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626800768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130115.527557:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130115.610595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130115.610922:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871552 00000100:00100000:3.0:1789130115.610935:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871552 00000100:00100000:3.0:1789130115.611023:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130115.611037:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604871552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611140:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604871552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 105us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611148:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130115.611195:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871936 00000100:00100000:3.0:1789130115.611200:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871936 00000100:00100000:3.0:1789130115.611246:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872192 00000100:00100000:3.0:1789130115.611249:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872192 00000100:00100000:3.0:1789130115.611264:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871808 00000100:00100000:3.0:1789130115.611266:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871808 00000100:00100000:3.0:1789130115.611277:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872320 00000100:00100000:3.0:1789130115.611279:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872320 00000100:00100000:3.0:1789130115.611321:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1789130115.611327:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604871936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611363:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604871936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611370:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1789130115.611383:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789130115.611389:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2367:x1876037604872192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611414:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2367:x1876037604872192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611420:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789130115.611432:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130115.611438:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604871808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611462:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604871808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611468:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130115.611480:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1789130115.611486:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2367:x1876037604872320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611512:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+7:2367:x1876037604872320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611518:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00080000:3.0:1789130115.611545:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130115.611550:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130115.611568:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604871680 00000100:00100000:3.0:1789130115.611572:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604871680 00000100:00100000:3.0:1789130115.611643:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872064 00000100:00100000:3.0:1789130115.611647:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872064 00000100:00100000:3.0:1789130115.611679:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130115.611686:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:2367:x1876037604871680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611725:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:2367:x1876037604871680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611733:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130115.611745:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130115.611752:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+13:2367:x1876037604872064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130115.611778:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+13:2367:x1876037604872064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130115.611784:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00080000:3.0:1789130115.611798:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789130116.298771:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130116.298784:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130116.298858:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1789130116.298865:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130116.311970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130116.312287:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872448 00000100:00100000:1.0:1789130116.312320:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872448 00000100:00100000:1.0:1789130116.312417:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130116.312431:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+13:31850:x1876037604872448:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130116.312463:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:1.0:1789130116.312501:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47ce8b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9df expref: 13 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312527:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130116.312541:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce8be7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9f4 expref: 12 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312553:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130116.312583:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9086 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abb2f expref: 11 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312594:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130116.312665:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce8e95 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abab8 expref: 10 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312675:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff90b4976b8700) 00010000:00010000:1.0:1789130116.312686:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce8dae lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aba64 expref: 9 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312695:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789130116.312708:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce8bb6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9e6 expref: 8 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130116.312730:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130116.312734:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130116.312814:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+7:31850:x1876037604872448:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 386us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130116.312823:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130116.317353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130116.317449:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872576 00000100:00100000:0.0:1789130116.317462:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872576 00000100:00100000:0.0:1789130116.317555:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130116.317567:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31332:x1876037604872576:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130116.317591:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789130116.317764:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47ce89cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab976 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.318918:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130116.319148:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce8a82 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab9a7 expref: 31 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.319170:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130116.319184:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47ce89a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab96f expref: 30 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.319194:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:0.0:1789130116.319204:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce898d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab968 expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.319214:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:0.0:1789130116.319220:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130116.319399:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:31332:x1876037604872576:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1832us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130116.319412:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130116.365512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130116.365820:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872704 00000100:00100000:0.0:1789130116.365845:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872704 00000100:00100000:0.0:1789130116.365934:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:0.0:1789130116.365946:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+28:31987:x1876037604872704:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130116.365976:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130116.366011:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbad expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366104:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366122:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366137:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130116.366413:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130116.366418:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130116.366551:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366583:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbad expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366684:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbad expref: 29 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.366717:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130116.366721:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130116.366725:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb800, rc 0) 00000100:00100000:0.0:1789130116.366818:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:31987:x1876037604872704:12345-192.168.201.39@tcp:101:rm.0 Request processed in 874us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130116.366828:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1789130116.376456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130116.377012:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604872832 00000100:00100000:0.0:1789130116.377026:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604872832 00000100:00100000:0.0:1789130116.377111:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:0.0:1789130116.377122:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:31987:x1876037604872832:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130116.377152:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130116.377180:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbb4 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377266:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377284:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377298:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377317:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377325:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.377351:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378001:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378013:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378021:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130116.378072:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130116.378077:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130116.378108:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378123:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378130:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378137:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378144:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130116.378149:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378158:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378180:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130116.378183:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130116.378189:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378197:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce929a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378212:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378218:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378224:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378229:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130116.378232:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378238:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378246:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130116.378249:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130116.378253:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378258:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378310:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbb4 expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378326:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbb4 expref: 30 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.378334:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4a2a08700) 00010000:00010000:0.0:1789130116.378336:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130116.378340:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eaa00, rc 0) 00000100:00100000:0.0:1789130116.378442:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:31987:x1876037604872832:12345-192.168.201.39@tcp:101:rm.0 Request processed in 1320us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130116.378451:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:2.0:1789130116.386947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130116.389038:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873088 00000100:00100000:0.0:1789130116.389057:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873088 00000100:00100000:0.0:1789130116.389140:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:0.0:1789130116.389150:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:31987:x1876037604873088:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130116.389174:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130116.389201:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce92af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbbb expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130116.389359:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789130116.389518:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce92af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbbb expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.389536:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130116.389539:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130116.389564:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce92af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbbb expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.389582:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb400, rc 0) 00000100:00100000:0.0:1789130116.389716:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31987:x1876037604873088:12345-192.168.201.39@tcp:101:rm.0 Request processed in 566us (2784us total) trans 30064771190 rc 301/301 00000100:00100000:0.0:1789130116.389725:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:3.0:1789130116.395336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130116.398297:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873216 00000100:00100000:2.0:1789130116.398325:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873216 00000100:00100000:2.0:1789130116.398427:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1789130116.398440:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31987:x1876037604873216:12345-192.168.201.39@tcp:37:rm.0 00000100:00100000:1.0:1789130116.413756:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:31987:x1876037604873216:12345-192.168.201.39@tcp:37:rm.0 Request processed in 15298us (18415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130116.413774:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130116.430592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130116.431144:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873472 00000100:00100000:0.0:1789130116.431159:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873472 00000100:00100000:0.0:1789130116.431241:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1789130116.431253:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:31987:x1876037604873472:12345-192.168.201.39@tcp:35:rm.0 00000100:00100000:0.0:1789130116.432247:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:31987:x1876037604873472:12345-192.168.201.39@tcp:35:rm.0 Request processed in 989us (1664us total) trans 30064771191 rc 0/0 00000100:00100000:0.0:1789130116.432258:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130116.436424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130116.437953:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873728 00000100:00100000:2.0:1789130116.437973:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873728 00000100:00100000:2.0:1789130116.438071:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:2.0:1789130116.438084:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:31987:x1876037604873728:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1789130116.438167:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130116.438207:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce92a8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbb4 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438232:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b4a2a08700) 00010000:00010000:2.0:1789130116.438251:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce928c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbad expref: 31 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438260:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:2.0:1789130116.438266:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130116.438322:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438338:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438350:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438364:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438371:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438379:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438839:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438849:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.438858:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130116.439547:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789130116.439576:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439587:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439640:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439647:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130116.439653:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439662:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439677:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130116.439681:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130116.439686:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439692:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92cb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439717:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439724:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439729:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439734:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130116.439737:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439753:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439761:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130116.439763:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130116.439765:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.439771:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130116.439785:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000050739ee9 reply state 00000000272db3b7 transno 30064771192 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130116.439796:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130116.439950:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:31987:x1876037604873728:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1865us (3538us total) trans 30064771192 rc 0/0 00000100:00100000:2.0:1789130116.439961:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00010000:00010000:0.0:1789130116.447251:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447274:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447282:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447289:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130116.447295:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447304:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447351:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff90b48a1fd100) 00010000:00010000:0.0:1789130116.447354:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130116.447361:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130116.447368:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce92c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130116.550160:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130116.947096:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771085 is committed 00000001:00080000:1.0:1789130116.947218:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771084 is committed 00000001:00080000:1.0:1789130116.947227:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771083 is committed 00010000:00010000:3.0:1789130117.575004:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130118.548822:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771191 is committed 00000020:00080000:2.0:1789130118.548887:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803899 batchid updated 00000001:00080000:2.0:1789130118.548900:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771192 is committed 00000004:00080000:2.0:1789130118.548910:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789130118.548944:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1789130118.548954:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771174 is committed 00000004:00080000:2.0:1789130118.548960:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789130118.548976:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487d55180 refcount 2 committed 0 result 0 batchid 25769803900 00000020:00080000:2.0:1789130118.548981:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486f62000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487d55cc0 00000020:00080000:2.0:1789130118.548984:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486f62900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3837aa000 00000020:00080000:2.0:1789130118.549013:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803900 committed batchid 25769803899 00000020:00080000:2.0:1789130118.549220:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000100:00100000:2.0:1789130118.549336:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626800896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130118.549412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130118.553512:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626800896 00000100:00100000:3.0:1789130118.553522:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626800896 00000100:00100000:3.0:1789130118.553583:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130118.553594:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626800896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789130118.553655:0:37276:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:195 count 1 00002000:00010000:3.0:1789130118.553690:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6aa3f57f, atime: 0x6aa3f57b, ctime: 0x6aa3f57f, blocks: 0x403 00010000:00010000:3.0:1789130118.553705:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.553722:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=1281s v=(0 0) 00010000:00010000:3.0:1789130118.553728:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130118.553735:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.553753:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.553765:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.553774:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.553802:0:37276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130118.554512:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626800896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 917us (5098us total) trans 30064771086 rc 0/0 00000100:00100000:3.0:1789130118.554523:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130118.554560:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383220780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789130118.554599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789130118.554665:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130118.554680:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801024 00000100:00100000:3.0:1789130118.554685:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801024 00000100:00100000:3.0:1789130118.554721:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130118.554737:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626801024:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789130118.555078:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130118.555090:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130118.555101:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130118.555107:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130118.555118:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130118.555143:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130118.555151:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce92d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130118.555175:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130118.555177:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130118.555180:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130118.555211:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:2.0:1789130118.555217:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771084 committed transno 30064771084 00000100:00100000:2.0:1789130118.555241:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b382e67840 x1876037626800896/t30064771086(30064771086) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130134 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789130118.555260:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382e67840/2, rc 0, transno 30064771086 00000100:00100000:2.0:1789130118.555265:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626800896:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1789130118.555875:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130118.556305:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1876037626801024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1567us (1703us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1789130118.556316:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000001:00080000:3.0:1789130118.557740:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771086 is committed 00000001:00080000:3.0:1789130118.557761:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771087 is committed 00000001:00080000:3.0:1789130118.557773:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771085 is committed 00000004:00080000:2.0:1789130118.559246:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383220780/2, rc 0, transno 30064771088 00000100:00100000:2.0:1789130118.559277:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383220780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789130118.560212:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130118.560228:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130118.560315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130118.560372:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801152 00000100:00100000:3.0:1789130118.560379:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801152 00000100:00100000:3.0:1789130118.560423:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130118.560432:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626801152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130118.560459:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:195 count 1 00002000:00010000:3.0:1789130118.560496:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6aa3f580, atime: 0x6aa3f57f, ctime: 0x6aa3f580, blocks: 0xb 00010000:00010000:3.0:1789130118.560505:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.560521:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=1281s v=(0 0) 00010000:00010000:3.0:1789130118.560525:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130118.560532:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.560547:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.560569:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.560578:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.560595:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130118.561389:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626801152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 954us (1071us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1789130118.561399:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1789130118.561430:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130118.561438:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.561448:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130118.561452:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.561463:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.561483:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.561492:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a395cc/0x5c74554e47ce92d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130118.561521:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130118.561523:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130118.561525:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130118.561555:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771086 gen 2 00000004:00080000:3.0:1789130118.561561:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382e65a40, transno 30064771084 00000004:00080000:3.0:1789130118.561571:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771086 committed transno 30064771086 00000100:00100000:3.0:1789130118.561595:0:3306:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b383220780 x1876037626801024/t30064771088(30064771088) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789130134 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789130118.561628:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383220000/2, rc 0, transno 30064771089 00000100:00100000:3.0:1789130118.561633:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801152:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789130118.601767:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130119.432711:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130119.432737:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130119.432832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130119.432916:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801280 00000100:00100000:1.0:1789130119.432924:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801280 00000100:00100000:1.0:1789130119.432971:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130119.432979:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626801280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130119.433019:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130119.433062:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626801280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130119.433069:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130119.433116:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130119.434158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801536:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130119.434232:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130119.434237:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626801664:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130119.434306:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801664 00000100:00100000:3.0:1789130119.434311:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801664 00000100:00100000:3.0:1789130119.434360:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130119.434367:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434424:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626801664:12345-0@lo:400:kworker.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130119.434431:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130119.434754:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626801664:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434777:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626801408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130119.434858:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626801920:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434928:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130119.434950:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130119.434956:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626801792:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.434979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130119.435007:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801408 00000100:00100000:3.0:1789130119.435011:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801408 00000100:00100000:3.0:1789130119.435039:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130119.435046:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626801408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.435080:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626801408:12345-0@lo:400:kworker.0 Request processed in 35us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130119.435087:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130119.435115:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801920 00000100:00100000:3.0:1789130119.435119:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801920 00000100:00100000:3.0:1789130119.435143:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801792 00000100:00100000:3.0:1789130119.435146:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801792 00000100:00100000:3.0:1789130119.435165:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130119.435172:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626801920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.435201:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626801920:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130119.435207:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130119.435219:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130119.435225:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626801792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.435252:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626801792:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130119.435271:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130119.435327:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626801792:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.435336:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626801408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130119.435345:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626801920:0@lo:400:kworker.0 00000100:00100000:2.0:1789130119.436018:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626801536 00000100:00100000:2.0:1789130119.436026:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626801536 00000100:00100000:2.0:1789130119.436066:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789130119.436074:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626801536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130119.436126:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626801536:12345-0@lo:400:kworker.0 Request processed in 53us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130119.436133:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789130119.436151:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130119.438102:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626801536:0@lo:400:kworker.0 00010000:00010000:0.0:1789130119.622463:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130120.453842:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383220f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626802048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130120.453917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130120.456956:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802048 00000100:00100000:1.0:1789130120.456970:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802048 00000100:00100000:1.0:1789130120.457042:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130120.457053:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626802048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130120.457098:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130120.457192:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626802048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130120.457201:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789130120.457230:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130120.457277:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383220f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626802048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130120.646273:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130120.730979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130120.731040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130120.731078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130120.731108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130120.731139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130120.731167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130120.731182:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874112 00000100:00100000:3.0:1789130120.731198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130120.731202:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874112 00000100:00100000:3.0:1789130120.731235:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874624 00000100:00100000:3.0:1789130120.731246:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874624 00000100:00100000:3.0:1789130120.731312:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874240 00000100:00100000:3.0:1789130120.731316:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874240 00000100:00100000:1.0:1789130120.731364:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874368 00000100:00100000:1.0:1789130120.731372:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874368 00000100:00100000:2.0:1789130120.731410:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873856 00000100:00100000:2.0:1789130120.731418:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873856 00000100:00100000:1.0:1789130120.731432:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604873984 00000100:00100000:1.0:1789130120.731438:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604873984 00000100:00100000:1.0:1789130120.731484:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130120.731493:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130120.731509:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604873856:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130120.731520:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874368:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130120.731678:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604873856:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 170us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130120.731697:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:1.0:1789130120.731699:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874368:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 190us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130120.731715:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789130120.731753:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130120.731762:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874496 00000100:00100000:1.0:1789130120.731769:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604873984:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130120.731770:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874496 00000100:00100000:1.0:1789130120.731831:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604873984:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 69us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130120.731859:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00080000:1.0:1789130120.731903:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130120.731907:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130120.731910:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130120.735713:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130120.735739:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874624:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130120.735942:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874624:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 215us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130120.735951:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130120.736134:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130120.736145:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604874112:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130120.736173:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604874112:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130120.736180:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1789130120.738926:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1789130120.738952:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604874240:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130120.739079:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604874240:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 138us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130120.739088:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130120.741311:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789130120.741344:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874496:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130120.742708:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604874496:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1371us (11501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130120.742724:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:0.0:1789130121.679808:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130122.125223:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771086 is committed 00000100:00100000:3.0:1789130122.634689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130122.643039:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874752 00000100:00100000:2.0:1789130122.643063:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874752 00000100:00100000:2.0:1789130122.643194:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:2.0:1789130122.643218:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:32410:x1876037604874752:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:2.0:1789130122.643247:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130122.643279:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbc2 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643381:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643399:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643416:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130122.643686:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789130122.643691:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130122.643816:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643850:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce92e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc2 expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643885:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc2 expref: 6 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130122.643895:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130122.643900:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130122.643904:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:2.0:1789130122.643995:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:32410:x1876037604874752:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 780us (9321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130122.644004:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00080000:2.0:1789130122.644040:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130122.695149:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130122.714415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130122.714572:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604874880 00000100:00100000:1.0:1789130122.714585:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604874880 00000100:00100000:1.0:1789130122.714701:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130122.714713:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31939:x1876037604874880:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789130122.714862:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31939:x1876037604874880:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 151us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130122.714872:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:2.0:1789130122.717528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130122.717799:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875136 00000100:00100000:0.0:1789130122.717812:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875136 00000100:00100000:0.0:1789130122.717880:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130122.717891:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:31939:x1876037604875136:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130122.718591:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:31939:x1876037604875136:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 696us (1070us total) trans 30064771193 rc 0/0 00000100:00100000:0.0:1789130122.718665:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789130123.148333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130123.148567:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875264 00000100:00100000:0.0:1789130123.148581:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875264 00000100:00100000:0.0:1789130123.148762:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:0.0:1789130123.148786:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:32427:x1876037604875264:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130123.148817:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789130123.149051:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130123.149219:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce92ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbc9 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.149312:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.149329:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.149344:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130123.149598:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130123.149637:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130123.154553:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.154646:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce92ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 7 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.154673:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 6 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130123.154693:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130123.154696:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130123.154700:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:0.0:1789130123.154829:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:32427:x1876037604875264:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 6055us (6510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130123.154839:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000001:00080000:0.0:1789130123.623147:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771193 is committed 00000020:00080000:0.0:1789130123.623173:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803900 batchid updated 00000020:00080000:2.0:1789130123.624100:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000020:00080000:2.0:1789130123.624116:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000001:00080000:3.0:1789130123.640327:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771089 is committed 00010000:00010000:0.0:1789130123.720552:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130124.550088:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626802176:0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130124.550253:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c17f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626802688:0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130124.550312:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130124.550317:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626802560:0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130124.550370:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802688 00000100:00100000:2.0:1789130124.550377:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802688 00000100:00100000:2.0:1789130124.550424:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802560 00000100:00100000:2.0:1789130124.550428:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802560 00000100:00100000:2.0:1789130124.550460:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130124.550469:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626802688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550521:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626802688:12345-0@lo:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130124.550529:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130124.550545:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130124.550552:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626802560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550578:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626802560:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130124.550584:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789130124.550624:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130124.550657:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626802560:0@lo:400:kworker.0 00000100:00100000:2.0:1789130124.550668:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c17f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626802688:0@lo:400:kworker.0 00000100:00100000:0.0:1789130124.550928:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802176 00000100:00100000:0.0:1789130124.550934:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802176 00000100:00100000:0.0:1789130124.550972:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789130124.550980:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626802176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130124.551022:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626802176:12345-0@lo:400:kworker.0 Request processed in 43us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130124.551028:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130124.551181:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626802176:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626802304:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130124.551486:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626802816:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130124.551539:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130124.551544:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626802432:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130124.551598:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802304 00000100:00100000:3.0:1789130124.551621:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802304 00000100:00100000:3.0:1789130124.551658:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802432 00000100:00100000:3.0:1789130124.551661:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802432 00000100:00100000:3.0:1789130124.551686:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130124.551692:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626802304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551742:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626802304:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130124.551749:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130124.551883:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130124.551890:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626802432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.551918:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626802432:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130124.551923:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130124.551955:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802816 00000100:00100000:3.0:1789130124.551959:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802816 00000100:00100000:3.0:1789130124.551989:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130124.551996:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626802816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.552025:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626802816:12345-0@lo:400:kworker.0 Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130124.552043:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789130124.552061:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130124.552065:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130124.552067:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130124.552085:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771086 gen 2 00000004:00080000:3.0:1789130124.552091:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382e67840, transno 30064771086 00000100:00100000:3.0:1789130124.552182:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626802432:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.552339:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:3.0:1789130124.552344:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383220780, transno 30064771088 00000004:00080000:3.0:1789130124.552353:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383220000, transno 30064771089 00000100:00100000:3.0:1789130124.552358:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626802304:0@lo:400:kworker.0 00000100:00100000:3.0:1789130124.552370:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626802816:0@lo:400:kworker.0 00000100:00100000:0.0:1789130124.553685:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626802944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130124.553753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130124.553918:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626802944 00000100:00100000:1.0:1789130124.553925:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626802944 00000100:00100000:1.0:1789130124.553981:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130124.553990:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626802944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130124.554024:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130124.556578:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626802944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2581us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130124.556592:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130124.561749:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626802944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130124.742219:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130125.574048:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626803072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130125.574131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130125.574275:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626803072 00000100:00100000:2.0:1789130125.574283:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626803072 00000100:00100000:2.0:1789130125.574334:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130125.574343:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626803072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130125.574380:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130125.574433:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626803072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130125.574442:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130125.574487:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626803072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130125.765918:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130125.853640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130125.853817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130125.853886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130125.853915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130125.853946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130125.853979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130125.854196:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875392 00000100:00100000:1.0:1789130125.854276:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875392 00000100:00100000:0.0:1789130125.854291:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875904 00000100:00100000:0.0:1789130125.854307:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875904 00000100:00100000:1.0:1789130125.854348:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789130125.854363:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604875392:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130125.854387:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875520 00000100:00100000:0.0:1789130125.854393:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875520 00000100:00100000:0.0:1789130125.854459:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130125.854466:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604875392:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 103us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130125.854476:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604875904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130125.854497:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:0.0:1789130125.854587:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604875904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 98us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130125.854778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130125.855622:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130125.855649:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604875520:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130125.855694:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130125.855740:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604875520:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 99us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130125.855752:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789130125.855795:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875648 00000100:00100000:0.0:1789130125.855805:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875648 00000100:00100000:1.0:1789130125.855819:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876160 00000100:00100000:1.0:1789130125.855827:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876160 00000100:00100000:0.0:1789130125.855859:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604875776 00000100:00100000:1.0:1789130125.855864:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876032 00000100:00100000:0.0:1789130125.855865:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604875776 00000100:00100000:1.0:1789130125.855872:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876032 00000100:00100000:0.0:1789130125.855917:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130125.855928:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604875648:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130125.856005:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604875648:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130125.856689:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130125.856728:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130125.856742:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604876160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130125.856764:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1789130125.856778:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604875776:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130125.856818:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604876160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 115us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130125.856829:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130125.856840:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604875776:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 64us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130125.856850:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130125.856858:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789130125.856873:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604876032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130125.856915:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604876032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130125.856923:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00080000:0.0:1789130125.856938:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130125.856946:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130125.856950:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789130126.535065:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130126.535080:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130126.535128:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1789130126.535136:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789130126.790170:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130127.603547:0:38947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 5: Mmap 00010000:00010000:2.0:1789130127.816578:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130128.838190:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130129.111528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.111891:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876288 00000100:00100000:0.0:1789130129.111907:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876288 00000100:00100000:0.0:1789130129.112021:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:0.0:1789130129.112036:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:32687:x1876037604876288:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130129.112086:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.112115:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce92fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbd0 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112340:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112360:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112377:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112396:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112404:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112411:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112891:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112902:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.112911:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130129.113002:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789130129.113011:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130129.113084:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113099:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113106:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113115:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113121:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.113126:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113135:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113149:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130129.113152:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.113158:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113166:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113181:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130129.113550:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130129.113915:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113945:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113952:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.113956:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113964:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113976:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.113978:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.113982:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.113989:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce930a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.114039:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce92fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd0 expref: 8 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.114053:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd0 expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.114061:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130129.114063:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130129.114066:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:0.0:1789130129.114538:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:32687:x1876037604876288:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2502us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.114559:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:1.0:1789130129.132572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.135829:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876544 00000100:00100000:0.0:1789130129.135857:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876544 00000100:00100000:0.0:1789130129.135967:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:0.0:1789130129.135981:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:32687:x1876037604876544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130129.136014:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.136047:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9318 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbd7 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136152:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136173:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136188:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136212:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136219:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136226:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136826:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce932d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136853:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce932d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.136862:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce932d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130129.136876:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130129.137107:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137117:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137125:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137131:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.137136:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137144:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137160:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130129.137164:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.137170:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137177:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce931f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137192:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137205:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137212:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137217:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.137221:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137227:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137236:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4a2a08500) 00010000:00010000:0.0:1789130129.137239:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.137242:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137248:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9326 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137736:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9318 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd7 expref: 10 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137757:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce932d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd7 expref: 9 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.137766:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130129.137769:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.137778:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc600, rc 0) 00000100:00100000:0.0:1789130129.137902:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:32687:x1876037604876544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1922us (5345us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1789130129.137914:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:1.0:1789130129.157231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.158371:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876672 00000100:00100000:0.0:1789130129.158388:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876672 00000100:00100000:0.0:1789130129.158479:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130129.158492:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:32687:x1876037604876672:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789130129.158745:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:32687:x1876037604876672:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 256us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.158755:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130129.283093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130129.283303:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604876928 00000100:00100000:3.0:1789130129.283327:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604876928 00000100:00100000:3.0:1789130129.283416:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:3.0:1789130129.283429:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:32701:x1876037604876928:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130129.283463:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130129.283467:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789130129.283506:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce92e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc2 expref: 9 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.283554:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:3.0:1789130129.283560:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130129.283579:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce933b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbde expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.284561:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.284590:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.284654:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.284707:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.284725:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 5 pid: 38734 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.284743:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626803200:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130129.285080:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130129.295387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.295425:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626803200:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130129.295466:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130129.296350:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877056 00000100:00100000:1.0:1789130129.296364:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877056 00010000:00010000:1.0:1789130129.296456:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 6 pid: 38734 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130129.296505:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789130129.296516:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604877056:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130129.296535:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130129.296543:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 6 pid: 38734 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296558:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 6 pid: 38734 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296586:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce92f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbc9 expref: 6 pid: 38734 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296655:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130129.296662:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296672:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296681:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.296770:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130129.296858:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604877056:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 342us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130129.296868:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:0.0:1789130129.297424:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.297438:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.297471:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.297483:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.297492:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130129.298411:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789130129.303778:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc4:0x0], index 1: 0 00010000:00010000:0.0:1789130129.305015:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305045:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305061:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305114:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305132:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305140:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305363:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.305369:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305378:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305394:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130129.305397:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.305403:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305409:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9342 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130129.305429:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009ee0796d reply state 00000000a227dd85 transno 30064771195 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.305440:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130129.305489:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce933b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 11 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305516:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 10 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.305536:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.305539:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130129.305542:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:0.0:1789130129.305901:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:32701:x1876037604876928:12345-192.168.201.39@tcp:101:bash.0 Request processed in 22473us (22820us total) trans 30064771195 rc 0/0 00000100:00100000:0.0:1789130129.305913:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:2.0:1789130129.313398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130129.313500:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313516:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313526:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313533:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130129.313540:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313550:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313572:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b4a2a08500) 00010000:00010000:1.0:1789130129.313576:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130129.313582:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.313589:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9349 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.315415:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877184 00000100:00100000:0.0:1789130129.315437:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877184 00000100:00100000:0.0:1789130129.315622:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130129.315637:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604877184:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130129.315672:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.315705:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbe5 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130129.315742:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130129.315773:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=1292s v=(0 0) 00010000:00010000:0.0:1789130129.315779:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130129.315804:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 6 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.315829:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 6 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.315846:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:0.0:1789130129.315979:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604877184:12345-192.168.201.39@tcp:101:bash.0 Request processed in 346us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.315988:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00080000:3.0:1789130129.320102:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130129.321055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.322374:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877312 00000100:00100000:1.0:1789130129.322391:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877312 00000100:00100000:2.0:1789130129.322856:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:2.0:1789130129.322873:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:32701:x1876037604877312:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130129.322900:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130129.322930:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbec expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.322989:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.323001:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130129.323007:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130129.323014:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.323068:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.323109:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 1392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130129.323129:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626803328:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130129.324899:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130129.330090:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626803328:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130129.330138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130129.330160:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.330191:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:1.0:1789130129.330306:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:32701:x1876037604877312:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7437us (9262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130129.330317:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130129.332387:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877440 00000100:00100000:0.0:1789130129.332408:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877440 00010000:00010000:0.0:1789130129.332479:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 1392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.332581:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130129.332624:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604877440:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130129.332655:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130129.332689:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 1392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.332708:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 1392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.332745:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca123742/0x5c74554e47ce935e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbe5 expref: 7 pid: 37276 timeout: 1392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.332769:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130129.332775:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130129.332786:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.332813:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.332908:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.332929:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626803456:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130129.333077:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130129.338081:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626803456:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130129.338121:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130129.338215:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604877440:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 5621us (8074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.338229:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1789130129.342340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.342650:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877696 00000100:00100000:1.0:1789130129.342664:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877696 00000100:00100000:1.0:1789130129.342757:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130129.342771:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:32701:x1876037604877696:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130129.343767:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:32701:x1876037604877696:12345-192.168.201.39@tcp:35:bash.0 Request processed in 817us (1259us total) trans 30064771196 rc 0/0 00000100:00100000:1.0:1789130129.343781:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1789130129.486665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.486809:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604877824 00000100:00100000:1.0:1789130129.486826:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604877824 00000100:00100000:1.0:1789130129.486914:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:1.0:1789130129.486927:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:32707:x1876037604877824:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130129.486978:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130129.487013:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce936c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbf3 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487108:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487129:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487145:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130129.487228:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789130129.487249:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130129.487295:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487327:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce936c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbf3 expref: 13 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487348:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbf3 expref: 12 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.487357:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130129.487360:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130129.487364:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:1.0:1789130129.487452:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:32707:x1876037604877824:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 527us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130129.487460:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789130129.506114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.506876:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878080 00000100:00100000:0.0:1789130129.506894:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878080 00000100:00100000:0.0:1789130129.507001:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:0.0:1789130129.507016:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:32707:x1876037604878080:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130129.507047:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.507077:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce937a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abbfa expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.507243:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9381 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.507263:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9381 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.507400:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9381 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130129.507435:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1789130129.507668:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce937a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbfa expref: 15 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.507692:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9381 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbfa expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.507703:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.507707:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130129.507712:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd400, rc 0) 00000100:00100000:0.0:1789130129.507803:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:32707:x1876037604878080:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 790us (1705us total) trans 30064771197 rc 0/0 00000100:00100000:0.0:1789130129.507812:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:3.0:1789130129.518218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130129.518315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130129.518520:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878464 00000100:00100000:2.0:1789130129.518534:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878464 00000100:00100000:2.0:1789130129.518690:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130129.518704:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037604878464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130129.518726:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130129.518766:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9381 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbfa expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.518804:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:2.0:1789130129.518812:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130129.518895:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604878464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130129.518903:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789130129.519823:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878336 00000100:00100000:0.0:1789130129.519835:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878336 00000100:00100000:0.0:1789130129.519902:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1789130129.519913:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:32707:x1876037604878336:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130129.519953:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.519978:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce938f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc01 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.520115:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.520135:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.520711:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130129.520734:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1789130129.521347:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce938f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc01 expref: 16 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.521373:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc01 expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.521383:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.521387:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130129.521391:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd800, rc 0) 00000100:00100000:0.0:1789130129.521483:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:32707:x1876037604878336:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1572us (3280us total) trans 30064771198 rc 0/0 00000100:00100000:0.0:1789130129.521492:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:3.0:1789130129.532769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130129.534401:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878592 00000100:00100000:2.0:1789130129.534420:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878592 00000100:00100000:2.0:1789130129.534533:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789130129.534546:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604878592:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130129.534636:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.534673:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.534684:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130129.534690:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130129.534695:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.534748:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.534767:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 6 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130129.534787:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:37273:1876037626803584:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130129.534932:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130129.540465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130129.540697:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:37273:1876037626803584:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130129.540793:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.540876:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878720 00000100:00100000:0.0:1789130129.540885:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878720 00002000:00100000:0.0:1789130129.540964:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff90b3839a61c0 x1876037604878720/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:600/0 lens 504/0 e 0 to 0 dl 1789130140 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130129.540975:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a61c0 with x1876037604878720 ext(0->15) 00010000:00010000:0.0:1789130129.540984:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 7 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.541000:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 7 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130129.541031:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b3839a61c0 00000100:00100000:0.0:1789130129.541076:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789130129.541088:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604878720:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:0.0:1789130129.541925:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604878720:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 833us (1471us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1789130129.541935:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:0.0:1789130129.541944:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff90b3839a61c0 x1876037604878720/t30064771087(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:600/0 lens 504/448 e 0 to 0 dl 1789130140 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130129.541954:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a61c0 with x1876037604878720 ext(0->15) 00010000:00010000:0.0:1789130129.541962:0:37281:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.541979:0:37281:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130129.541986:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b3839a61c0 00000100:00100000:3.0:1789130129.546733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.546879:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604878848 00000100:00100000:1.0:1789130129.546893:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604878848 00010000:00010000:1.0:1789130129.546957:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130129.547015:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130129.547030:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604878848:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130129.547055:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789130129.547082:0:36572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:1.0:1789130129.547086:0:36572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1789130129 00002000:00010000:1.0:1789130129.547089:0:36572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1789130129 00002000:00010000:1.0:1789130129.547091:0:36572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 0 -> 1789130129 00010000:00010000:1.0:1789130129.547118:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.547135:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.547166:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac221064/0x5c74554e47ce9365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbec expref: 9 pid: 37658 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.547188:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130129.547205:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130129.547214:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.547226:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.547266:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130129.547349:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2368:x1876037604878848:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 322us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130129.547357:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:3.0:1789130129.547684:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547754:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547787:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547797:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547814:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547821:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130129.547826:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547836:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547851:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.547859:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce93a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130129.547940:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604878592:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 13395us (15186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130129.547950:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789130129.550142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.555361:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879104 00000100:00100000:1.0:1789130129.555388:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879104 00000100:00100000:1.0:1789130129.555486:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130129.555499:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7829c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:32707:x1876037604879104:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:1.0:1789130129.555625:0:36590:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc01 expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130129.555993:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771199 00000001:00080000:1.0:1789130129.556044:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771200 00000001:00080000:1.0:1789130129.556907:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771201 00010000:00010000:1.0:1789130129.556989:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.557010:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.557021:0:36590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.557071:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.557089:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 19 pid: 36589 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130129.557107:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626803712:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130129.557231:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c34c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130129.561939:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626803712:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130129.561980:0:36590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130129.572464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130129.572872:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879232 00000100:00100000:2.0:1789130129.572887:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879232 00010000:00010000:2.0:1789130129.572946:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 20 pid: 36589 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130129.573025:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789130129.573039:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604879232:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130129.573062:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130129.573071:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 20 pid: 36589 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573099:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 20 pid: 36589 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573129:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9350 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abbde expref: 20 pid: 36589 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573152:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:2.0:1789130129.573158:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573169:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573178:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.573231:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130129.573299:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604879232:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 263us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130129.573307:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00010000:00010000:3.0:1789130129.573442:0:36590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130129.573453:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130129.573699:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771202 00000001:00080000:3.0:1789130129.574001:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771203 00000100:00100000:3.0:1789130129.574131:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e412c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626803840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130129.574211:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130129.574251:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4887e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130129.574277:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626803840 00000100:00100000:2.0:1789130129.574297:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626803840 00000100:00100000:2.0:1789130129.574363:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130129.574372:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626803840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130129.574480:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626803840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130129.574488:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130129.574575:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e412c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626803840:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1789130129.574579:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789130129.575237:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771204 00000100:00100000:0.0:1789130129.575319:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626803968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130129.575363:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130129.575393:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c31540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130129.575637:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626803968 00000100:00100000:2.0:1789130129.575653:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626803968 00000100:00100000:2.0:1789130129.575687:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130129.575696:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626803968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130129.575897:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36590:x1876037626803968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 202us (532us total) trans 30064771088 rc 0/0 00000100:00100000:2.0:1789130129.575907:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130129.576054:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1966940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626803968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130129.576217:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771205 00010000:00010000:0.0:1789130129.576268:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576280:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576288:0:36590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576296:0:36590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.576302:0:36590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576311:0:36590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576331:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.576334:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130129.576339:0:36590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.576347:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce93ab lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130129.576690:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130129.576809:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].6, 64 off8624 00000004:00080000:0.0:1789130129.576823:0:36590:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1292674220174ns, next at 1293674217365ns, rc = 0 00000001:00080000:0.0:1789130129.576831:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771206 00010000:00010000:0.0:1789130129.576871:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.576874:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130129.576889:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9396 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc01 expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.577033:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7829c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:32707:x1876037604879104:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 21535us (26900us total) trans 30064771207 rc 0/0 00000100:00100000:0.0:1789130129.577043:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000020:00080000:0.0:1789130129.577049:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789130129.600543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130129.600708:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879360 00000100:00100000:2.0:1789130129.600723:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879360 00000100:00100000:2.0:1789130129.600809:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:2.0:1789130129.600821:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:32707:x1876037604879360:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130129.600863:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130129.600895:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce93b2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc08 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.600978:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce93b2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc08 expref: 23 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.600996:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce93b2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc08 expref: 23 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130129.601044:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130129.601048:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130129.601053:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130129.601145:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:32707:x1876037604879360:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 326us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130129.601154:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000040:00080000:3.0:1789130129.605982:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130129.605997:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130129.606042:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1789130129.606050:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130129.608474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.614107:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879616 00000100:00100000:0.0:1789130129.614133:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879616 00000100:00100000:3.0:1789130129.614959:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130129.614978:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:32707:x1876037604879616:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130129.615715:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:32707:x1876037604879616:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 738us (7253us total) trans 30064771208 rc 0/0 00000100:00100000:3.0:1789130129.615727:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130129.673392:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626804224:0@lo:400:kworker.0 00000100:00100000:2.0:1789130129.673501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130129.673594:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130129.673629:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626804352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130129.673672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130129.673855:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626804096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.673912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130129.673953:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626804608:0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.673981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130129.674002:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130129.674008:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626804480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130129.674072:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804352 00000100:00100000:0.0:1789130129.674082:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804352 00000100:00100000:0.0:1789130129.674142:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804608 00000100:00100000:0.0:1789130129.674146:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804608 00000100:00100000:0.0:1789130129.674183:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804480 00000100:00100000:0.0:1789130129.674199:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804480 00000100:00100000:0.0:1789130129.674225:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130129.674235:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626804352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674313:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626804352:12345-0@lo:400:kworker.0 Request processed in 79us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.674322:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130129.674342:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130129.674371:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626804608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674406:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626804608:12345-0@lo:400:kworker.0 Request processed in 36us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.674413:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130129.674428:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130129.674435:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626804480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674464:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626804480:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.674471:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789130129.674491:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130129.674527:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626804480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674540:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383356940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626804608:0@lo:400:kworker.0 00000100:00100000:0.0:1789130129.674574:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626804352:0@lo:400:kworker.0 00000100:00100000:1.0:1789130129.674810:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804224 00000100:00100000:1.0:1789130129.674816:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804224 00000100:00100000:1.0:1789130129.674875:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789130129.674893:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626804224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130129.674944:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626804224:12345-0@lo:400:kworker.0 Request processed in 53us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130129.674951:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789130129.674985:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626804224:0@lo:400:kworker.0 00000100:00100000:2.0:1789130129.675477:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804096 00000100:00100000:2.0:1789130129.675483:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804096 00000100:00100000:2.0:1789130129.675526:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130129.675534:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130129.675583:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626804096:12345-0@lo:400:kworker.0 Request processed in 50us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130129.675591:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130129.675669:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626804096:0@lo:400:kworker.0 00000100:00100000:1.0:1789130129.676473:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382f8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130129.676530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789130129.676689:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130129.676744:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804736 00000100:00100000:3.0:1789130129.676751:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804736 00000100:00100000:3.0:1789130129.676801:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130129.676810:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626804736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130129.676834:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130129.676889:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626804736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130129.676896:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130129.677021:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382f8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130129.813689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.813859:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879744 00000100:00100000:0.0:1789130129.813874:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879744 00000100:00100000:0.0:1789130129.813963:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:0.0:1789130129.813977:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:32717:x1876037604879744:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130129.814092:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814115:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814131:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814170:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814179:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814793:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814942:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814952:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.814960:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130129.815015:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815029:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815036:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815044:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815050:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.815055:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815074:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815089:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130129.815092:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.815098:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815104:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815119:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815125:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815131:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815135:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.815137:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815142:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815149:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.815153:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.815155:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815171:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815198:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815205:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815212:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815217:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.815220:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815227:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815234:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:0.0:1789130129.815237:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.815240:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.815247:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93c7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130129.815358:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:32717:x1876037604879744:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1383us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.815368:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00010000:00010000:2.0:1789130129.862044:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130129.936673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.936846:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604879872 00000100:00100000:0.0:1789130129.936860:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604879872 00000100:00100000:0.0:1789130129.936955:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:0.0:1789130129.936967:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:32718:x1876037604879872:12345-192.168.201.39@tcp:101:mmap_cat.0 00010000:00010000:0.0:1789130129.937000:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130129.937031:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc0f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937144:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937166:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937185:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937206:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937214:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937221:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937358:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937368:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937394:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130129.937446:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1789130129.937451:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130129.937511:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937526:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937536:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937544:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937552:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937558:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.937563:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.937571:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939114:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130129.939127:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.939212:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939250:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce93d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939279:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939286:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939294:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939301:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130129.939306:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939314:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939326:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130129.939329:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130129.939333:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939339:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce93dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939410:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce93ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc0f expref: 26 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939447:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc0f expref: 25 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.939455:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:0.0:1789130129.939457:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130129.939460:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:0.0:1789130129.942082:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:32718:x1876037604879872:12345-192.168.201.39@tcp:101:mmap_cat.0 Request processed in 2620us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.942102:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:3.0:1789130129.951076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130129.969777:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604880128 00000100:00100000:1.0:1789130129.969803:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604880128 00000100:00100000:1.0:1789130129.969906:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:1.0:1789130129.969919:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:32718:x1876037604880128:12345-192.168.201.39@tcp:101:mmap_cat.0 00010000:00010000:1.0:1789130129.969949:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130129.969980:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc16 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.970114:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce93f1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.970134:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce93f1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.970147:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce93f1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130129.970174:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:1.0:1789130129.970363:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc16 expref: 28 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.970412:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce93f1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc16 expref: 27 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130129.970421:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:1.0:1789130129.970425:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130129.970429:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362200, rc 0) 00000100:00100000:1.0:1789130129.970524:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:32718:x1876037604880128:12345-192.168.201.39@tcp:101:mmap_cat.0 Request processed in 607us (19467us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1789130129.970532:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130129.985327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130129.988789:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604880256 00000100:00100000:0.0:1789130129.988814:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604880256 00000100:00100000:0.0:1789130129.988941:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789130129.988954:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2367:x1876037604880256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130129.988978:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130129.989012:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce93f1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc16 expref: 27 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130129.989039:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:0.0:1789130129.989045:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130129.989137:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604880256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 186us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130129.989146:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789130130.009782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.013051:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604880512 00000100:00100000:1.0:1789130130.013073:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604880512 00000100:00100000:1.0:1789130130.013196:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1789130130.013210:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:32718:x1876037604880512:12345-192.168.201.39@tcp:35:mmap_cat.0 00000100:00100000:1.0:1789130130.013572:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:32718:x1876037604880512:12345-192.168.201.39@tcp:35:mmap_cat.0 Request processed in 362us (3804us total) trans 30064771210 rc 0/0 00000100:00100000:1.0:1789130130.013582:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789130130.040832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.041093:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604880768 00000100:00100000:2.0:1789130130.041105:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604880768 00000100:00100000:2.0:1789130130.041191:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130130.041207:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:32719:x1876037604880768:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1789130130.041252:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130130.041287:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce93e3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc0f expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.041316:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce93b2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc08 expref: 26 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.041330:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130130.041344:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130130.041411:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:32719:x1876037604880768:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 211us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130130.041418:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789130130.049830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.049956:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604880896 00000100:00100000:1.0:1789130130.049973:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604880896 00000100:00100000:1.0:1789130130.050070:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:1.0:1789130130.050084:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:32719:x1876037604880896:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1789130130.050268:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.050289:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.050324:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130130.050769:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].5, 136 off8872 00000100:00100000:1.0:1789130130.050900:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:32719:x1876037604880896:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 817us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130130.050910:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:3.0:1789130130.091535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.091887:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881024 00000100:00100000:0.0:1789130130.091903:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881024 00000100:00100000:0.0:1789130130.092005:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1789130130.092017:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:32721:x1876037604881024:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130130.092048:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130130.092079:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc1d expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092206:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092226:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092240:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092367:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092377:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092385:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092529:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092540:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.092546:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130130.093006:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1789130130.093014:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130130.093041:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093056:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093066:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093073:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093081:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093088:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.093093:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093103:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093134:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130130.093139:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130130.093146:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093153:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce940d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093473:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093479:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093486:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093491:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.093495:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093502:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093512:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130130.093515:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130130.093519:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093525:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.093571:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.095404:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 26 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.095448:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130130.095451:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130130.095456:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:0.0:1789130130.095567:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:32721:x1876037604881024:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3549us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.095578:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000040:00080000:3.0:1789130130.630892:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130130.630907:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130130.630957:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1789130130.630966:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130130.631147:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626804864:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130130.631306:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4887e7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130130.644860:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626804864:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130130.653210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130130.653753:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881152 00000100:00100000:3.0:1789130130.653770:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881152 00000100:00100000:3.0:1789130130.653867:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:3.0:1789130130.653882:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:32732:x1876037604881152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130130.653937:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130130.654098:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:32732:x1876037604881152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 219us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130130.654107:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:0.0:1789130130.665847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.665914:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881280 00000100:00100000:0.0:1789130130.665928:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881280 00000100:00100000:0.0:1789130130.666006:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:0.0:1789130130.666021:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:32732:x1876037604881280:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.666141:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666165:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666182:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666204:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666212:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666219:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666275:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666285:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666291:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130130.666343:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1789130130.666350:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130130.666367:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666383:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666391:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666399:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666407:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.666413:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666422:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666437:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130130.666447:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130130.666455:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666462:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9422 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666479:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666484:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666490:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666496:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.666499:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666505:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666513:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x743283ca (ffff90b4a2a08600) 00010000:00010000:0.0:1789130130.666516:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130130.666519:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666526:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9429 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666546:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666557:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666563:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666568:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.666572:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666578:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666586:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130130.666589:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130130.666592:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.666598:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9430 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130130.666745:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:32732:x1876037604881280:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 725us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.666755:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:3.0:1789130130.669522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.669843:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881536 00000100:00100000:0.0:1789130130.669857:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881536 00000100:00100000:0.0:1789130130.669934:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:0.0:1789130130.669946:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:32732:x1876037604881536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.669976:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130130.670023:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9437 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc24 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670154:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670172:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670187:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130130.670202:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1789130130.670352:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670360:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670368:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670375:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130130.670381:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670390:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670405:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130130.670408:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130130.670414:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670429:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce943e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670479:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9437 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc24 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670490:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130130.670493:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130130.670496:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9437 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc24 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.670505:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:0.0:1789130130.670848:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604881536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 903us (1338us total) trans 30064771211 rc 301/301 00000100:00100000:0.0:1789130130.670857:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:0.0:1789130130.697463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130130.697834:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881664 00000100:00100000:3.0:1789130130.697846:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881664 00000100:00100000:3.0:1789130130.697936:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:3.0:1789130130.697951:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604881664:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130130.698032:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130130.698189:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604881664:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 240us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130130.698199:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:0.0:1789130130.701986:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626804992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130130.702113:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130130.702222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130130.705442:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604881920 00000100:00100000:3.0:1789130130.705463:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604881920 00000100:00100000:3.0:1789130130.705553:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:3.0:1789130130.705565:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604881920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130130.705595:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130130.705599:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789130130.705675:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9373 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbf3 expref: 27 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.705702:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:3.0:1789130130.705720:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130130.705742:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce944c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc2b expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130130.706300:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc4:0x0], index 0: 0 00010000:00010000:3.0:1789130130.706563:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9453 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.706582:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9453 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.706595:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9453 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.706737:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce944c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc2b expref: 29 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.706764:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9453 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc2b expref: 28 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.706774:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b488939c00) 00010000:00010000:3.0:1789130130.706778:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130130.706781:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86c00, rc 0) 00000100:00100000:3.0:1789130130.706886:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:32732:x1876037604881920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1321us (4666us total) trans 30064771212 rc 0/0 00000100:00100000:3.0:1789130130.706897:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:3.0:1789130130.706964:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626804992 00000100:00100000:3.0:1789130130.706973:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626804992 00000100:00100000:3.0:1789130130.707027:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130130.707037:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626804992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130130.707079:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130130.707167:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626804992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130130.707174:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130130.708651:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626804992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130130.717190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.717490:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882048 00000100:00100000:0.0:1789130130.717504:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882048 00000100:00100000:0.0:1789130130.717593:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:0.0:1789130130.717647:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:32732:x1876037604882048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.717684:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130130.717721:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce9461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc32 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.717858:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.717876:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.717893:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130130.717979:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130130.717985:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130130.718025:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.718062:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce9461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc32 expref: 30 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.718087:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc32 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.718098:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130130.718101:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130130.718106:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:0.0:1789130130.718469:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:32732:x1876037604882048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 863us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.718479:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:0.0:1789130130.725009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.725338:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882304 00000100:00100000:2.0:1789130130.725353:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882304 00000100:00100000:2.0:1789130130.725437:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:2.0:1789130130.725451:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:32732:x1876037604882304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130130.725537:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130130.725576:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9453 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc2b expref: 29 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725637:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130130.725664:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9468 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc32 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725675:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:2.0:1789130130.725696:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130130.725737:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725753:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725766:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725779:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725787:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725794:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725888:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725896:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725904:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725911:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130130.725916:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725923:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725938:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130130.725941:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130130.725945:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725952:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce946f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725965:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725972:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725978:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725984:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130130.725987:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.725994:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.726000:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa04f2cba (ffff90b48a1fd900) 00010000:00010000:2.0:1789130130.726003:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130130.726006:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.726012:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9476 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa04f2cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130130.726122:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604882304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 673us (1129us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130130.726131:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:3.0:1789130130.735927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.736096:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882432 00000100:00100000:0.0:1789130130.736143:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882432 00000100:00100000:0.0:1789130130.736232:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:0.0:1789130130.736253:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:32732:x1876037604882432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.736287:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130130.736325:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce947d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc39 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736373:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736391:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736405:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736534:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce947d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736555:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.736565:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130130.736568:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130130.736573:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb400, rc 0) 00000100:00100000:0.0:1789130130.736684:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:32732:x1876037604882432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 441us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.736693:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789130130.740953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.741943:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882688 00000100:00100000:0.0:1789130130.741981:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882688 00000100:00100000:0.0:1789130130.742106:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130130.742134:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:32732:x1876037604882688:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.742295:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.742319:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.742334:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130130.742950:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].6, 88 off8648 00000004:00080000:0.0:1789130130.742964:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1293840360857ns, next at 1294840357147ns, rc = 0 00000004:00010000:0.0:1789130130.743084:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000023c1f086 reply state 000000007d30d51b transno 30064771213 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130130.743097:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130130.743252:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+30:32732:x1876037604882688:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1132us (2315us total) trans 30064771213 rc 0/0 00000100:00100000:0.0:1789130130.743261:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130130.766614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130130.766689:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882816 00000100:00100000:3.0:1789130130.766703:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882816 00000100:00100000:3.0:1789130130.766785:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:3.0:1789130130.766817:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:32732:x1876037604882816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130130.766852:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130130.766880:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc40 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.766965:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.766983:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130130.767008:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:3.0:1789130130.767011:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130130.767016:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:3.0:1789130130.767091:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+31:32732:x1876037604882816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 276us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130130.767100:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00010000:00010000:1.0:1789130130.771683:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771712:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771721:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771728:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130130.771735:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771744:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771767:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130130.771771:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130130.771777:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.771785:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce948b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130130.778323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.778468:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604882944 00000100:00100000:2.0:1789130130.778484:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604882944 00000100:00100000:2.0:1789130130.778588:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130130.778641:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604882944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789130130.778695:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130130.779137:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604882944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 537us (829us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1789130130.779146:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1789130130.782139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.782341:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604883200 00000100:00100000:1.0:1789130130.782357:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604883200 00000100:00100000:1.0:1789130130.782438:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789130130.782451:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:32732:x1876037604883200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130130.782853:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:32732:x1876037604883200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 402us (728us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1789130130.782861:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789130130.810125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130130.812586:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604883456 00000100:00100000:3.0:1789130130.812644:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604883456 00000100:00100000:3.0:1789130130.812762:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:3.0:1789130130.812776:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:32732:x1876037604883456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130130.812958:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:32732:x1876037604883456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 185us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130130.812967:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:2.0:1789130130.819520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.819672:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604883584 00000100:00100000:1.0:1789130130.819685:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604883584 00000100:00100000:1.0:1789130130.819771:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:1.0:1789130130.819784:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:32732:x1876037604883584:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130130.819816:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130130.819846:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9499 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc47 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.819976:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.819997:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.820014:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130130.820074:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130130.820109:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.820143:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9499 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc47 expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.820167:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc47 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.820178:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130130.820181:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130130.820201:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:1.0:1789130130.820287:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:32732:x1876037604883584:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 506us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130130.820295:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:3.0:1789130130.833900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.833993:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604883712 00000100:00100000:2.0:1789130130.834008:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604883712 00000100:00100000:2.0:1789130130.834093:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789130130.834107:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604883712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130130.834136:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130130.834170:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc4e expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130130.834389:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f592, blocks: 0x1 00010000:00010000:2.0:1789130130.834419:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=1293s v=(0 0) 00010000:00010000:2.0:1789130130.834425:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130130.834438:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.834477:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 7 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130130.834496:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130130.834579:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604883712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 475us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130130.834587:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789130130.846828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.847572:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604883968 00000100:00100000:0.0:1789130130.847587:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604883968 00000100:00100000:0.0:1789130130.847696:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:0.0:1789130130.847710:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:32732:x1876037604883968:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130130.847866:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:32732:x1876037604883968:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 158us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.847900:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:1.0:1789130130.884746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130130.884855:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884096 00000100:00100000:0.0:1789130130.884870:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884096 00000100:00100000:0.0:1789130130.884956:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1789130130.884969:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:32732:x1876037604884096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130130.884996:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130130.885025:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc55 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.885074:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.885085:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130130.885090:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130130.885096:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.885153:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 8 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.885181:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 8 pid: 37273 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130130.885466:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626805120:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130130.885598:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c31540 going to sleep for 11 seconds 00010000:00010000:2.0:1789130130.887106:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130130.896040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.899404:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884224 00000100:00100000:1.0:1789130130.899426:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884224 00010000:00010000:1.0:1789130130.899507:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 9 pid: 37273 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130130.899578:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789130130.899590:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604884224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130130.899699:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130130.899730:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 9 pid: 37273 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.899774:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 9 pid: 37273 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.899809:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130130.899816:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130130.899826:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.899837:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130130.899890:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130130.899908:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626805248:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130130.900052:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10240 going to sleep for 11 seconds 00010000:00010000:0.0:1789130130.901292:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008191a274/0x5c74554e47ce94a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc4e expref: 9 pid: 37273 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130130.901319:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626805120:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130130.901357:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130130.901373:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb800, rc 0) 00000100:00100000:0.0:1789130130.901437:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:32732:x1876037604884096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 16471us (16709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130130.901446:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1789130130.911296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.911555:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884352 00000100:00100000:2.0:1789130130.911568:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884352 00002000:00100000:2.0:1789130130.911688:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff90b382bbb480 x1876037604884352/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:601/0 lens 504/0 e 0 to 0 dl 1789130141 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130130.911703:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbb480 with x1876037604884352 ext(0->15) 00002000:00010000:2.0:1789130130.911711:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bbb480 00000100:00100000:2.0:1789130130.911742:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130130.911753:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604884352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130130.912363:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604884352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 608us (1080us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1789130130.912374:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00002000:00100000:2.0:1789130130.912383:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff90b382bbb480 x1876037604884352/t30064771091(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:601/0 lens 504/448 e 0 to 0 dl 1789130141 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130130.912393:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbb480 with x1876037604884352 ext(0->15) 00002000:00010000:2.0:1789130130.912397:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bbb480 00000100:00100000:1.0:1789130130.915549:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626805248:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130130.915586:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130130.915751:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604884224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 16161us (19724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130130.915767:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130130.925822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130130.926165:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884480 00000100:00100000:1.0:1789130130.926199:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884480 00000100:00100000:1.0:1789130130.926283:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:1.0:1789130130.926318:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:32732:x1876037604884480:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789130130.986848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.996803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.996857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.996890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.996985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130130.997086:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604885120 00000100:00100000:2.0:1789130130.997099:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604885120 00000100:00100000:2.0:1789130130.997171:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884736 00000100:00100000:2.0:1789130130.997175:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884736 00000100:00100000:2.0:1789130130.997195:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884992 00000100:00100000:2.0:1789130130.997197:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884992 00000100:00100000:2.0:1789130130.997220:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130130.997231:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604885120:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130130.997330:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604885120:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130130.997339:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130130.997361:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130130.997367:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604884736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130130.997395:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604884736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130130.997401:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130130.997414:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130130.997421:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604884992:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130130.997448:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604884992:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130130.997454:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00080000:2.0:1789130130.997702:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130130.997709:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130130.997914:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884864 00000100:00100000:1.0:1789130130.997920:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884864 00000100:00100000:1.0:1789130130.997965:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130130.997973:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604884864:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130130.998019:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604884864:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130130.998026:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130131.003843:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604884608 00000100:00100000:3.0:1789130131.003865:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604884608 00000100:00100000:3.0:1789130131.004088:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:3.0:1789130131.004101:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604884608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130131.004222:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604884608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 123us (17387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130131.004230:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000001:00080000:0.0:1789130131.106203:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771213 is committed 00000004:00080000:0.0:1789130131.106224:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789130131.106251:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789130131.106273:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4b5759900 refcount 2 committed 0 result 0 batchid 25769803901 00000020:00080000:0.0:1789130131.106279:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b489075e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5759780 00000020:00080000:0.0:1789130131.106284:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b489075d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b382ba5400 00000001:00080000:0.0:1789130131.106308:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771214 is committed 00000020:00080000:0.0:1789130131.106557:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803901 committed batchid 25769803900 00000020:00080000:0.0:1789130131.106842:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000100:00100000:0.0:1789130131.106867:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626805376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789130131.106968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130131.107041:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626805376 00000100:00100000:1.0:1789130131.107052:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626805376 00000100:00100000:0.0:1789130131.107055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130131.107062:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626805504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789130131.107088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130131.107128:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626805504 00000100:00100000:1.0:1789130131.107132:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626805504 00000100:00100000:1.0:1789130131.107179:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130131.107198:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626805376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789130131.107261:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:32732:x1876037604884480:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 180945us (181455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130131.107271:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:0.0:1789130131.107304:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789130131.107312:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626805504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789130131.107330:0:37273:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:196 count 1 00002000:00010000:0.0:1789130131.107370:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6aa3f591, atime: 0x6aa3f591, ctime: 0x6aa3f591, blocks: 0x1 00002000:00010000:1.0:1789130131.107377:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00010000:00010000:0.0:1789130131.107379:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130131.107380:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1789130130 00002000:00010000:1.0:1789130131.107382:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130131.107384:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb ctime from disk: 1789130130 -> 1789130130 00002000:00010000:1.0:1789130131.107387:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1789130131.107399:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=1294s v=(0 0) 00010000:00010000:0.0:1789130131.107404:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130131.107413:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.107423:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626805376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (456us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1789130131.107429:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1789130131.107433:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.107445:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130131.107446:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130131.107450:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130131.107454:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.107490:0:37273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130131.107723:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130131.107731:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.107752:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130131.107757:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.107768:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.107788:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.107796:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3fd4947/0x5c74554e47ce94b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.107815:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130131.107817:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130131.107818:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130131.108033:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626805504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 721us (943us total) trans 30064771089 rc 0/0 00000100:00100000:0.0:1789130131.108050:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:0.0:1789130131.108103:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4c1964000/2, rc 0, transno 30064771089 00000100:00100000:0.0:1789130131.108110:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626805504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789130131.111048:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4c19670c0/2, rc 0, transno 30064771092 00000100:00100000:0.0:1789130131.111073:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626805376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130131.113577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130131.114029:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604885248 00000100:00100000:1.0:1789130131.114045:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604885248 00000100:00100000:1.0:1789130131.114126:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130131.114150:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604885248:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789130131.244377:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604885248:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 130223us (130793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130131.244397:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000001:00080000:1.0:1789130131.244451:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771092 is committed 00000001:00080000:1.0:1789130131.244465:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771091 is committed 00000100:00100000:1.0:1789130131.252086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130131.252346:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604885504 00000100:00100000:0.0:1789130131.252359:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604885504 00000100:00100000:0.0:1789130131.252454:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:0.0:1789130131.252468:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:32732:x1876037604885504:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00000100:00080000:1.0:1789130131.252499:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130131.252544:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130131.252590:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce94a0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc47 expref: 11 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.252647:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130131.252656:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130131.252758:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.252777:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.252789:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130131.253048:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000014f64076 reply state 000000004642ced3 transno 30064771215 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.253058:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130131.253462:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:32732:x1876037604885504:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 994us (1388us total) trans 30064771215 rc 0/0 00000100:00100000:1.0:1789130131.253471:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1789130131.270695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130131.270738:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270753:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270762:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270769:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130131.270775:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270803:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270825:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130131.270828:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130131.270834:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.270843:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94bc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.270880:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604885632 00000100:00100000:1.0:1789130131.270893:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604885632 00000100:00100000:1.0:1789130131.270966:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130131.270977:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604885632:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789130131.271501:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb size from disk: 16 -> 16 00002000:00010000:1.0:1789130131.271506:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb mtime from disk: 1789130130 -> 1789130129 00002000:00010000:1.0:1789130131.271509:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1789130129 00002000:00010000:1.0:1789130131.271511:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb ctime from disk: 1789130130 -> 1789130129 00002000:00010000:1.0:1789130131.271514:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789130131.271591:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604885632:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 614us (909us total) trans 30064771093 rc 0/0 00000100:00100000:1.0:1789130131.271635:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:0.0:1789130131.283475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130131.285827:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604885888 00000100:00100000:3.0:1789130131.285852:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604885888 00000100:00100000:3.0:1789130131.285959:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:3.0:1789130131.285973:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:32732:x1876037604885888:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789130131.286093:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.286118:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 11 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.286132:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.286188:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 11 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.286205:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 11 pid: 36587 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130131.288735:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bb8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626805632:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130131.288910:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484c51840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130131.301571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130131.306377:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886016 00000100:00100000:2.0:1789130131.306402:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886016 00010000:00010000:2.0:1789130131.306477:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 12 pid: 36587 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.306541:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130131.306552:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037604886016:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130131.306573:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130131.306581:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 12 pid: 36587 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.306598:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 12 pid: 36587 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.306672:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:2.0:1789130131.306678:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.306691:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.306700:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.306730:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130131.306846:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037604886016:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 295us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130131.306878:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:2.0:1789130131.306950:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9484 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc39 expref: 11 pid: 36587 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.306968:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bb8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626805632:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130131.306998:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307009:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307016:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307058:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307066:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307073:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307081:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130131.307086:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307095:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307116:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:2.0:1789130131.307119:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130131.307124:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.307131:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce94c3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.307178:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:32732:x1876037604885888:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 21208us (23720us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130131.307188:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:3.0:1789130131.318443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130131.319007:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886144 00000100:00100000:0.0:1789130131.319022:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886144 00000100:00100000:0.0:1789130131.319104:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130131.319118:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604886144:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789130131.319186:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.319215:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.319263:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789130131.319268:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130131.319273:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.319322:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130131.319339:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 7 pid: 37275 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130131.319357:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839a52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626805760:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130131.319468:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130131.327430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130131.327524:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839a52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626805760:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130131.327566:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130131.327707:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886272 00000100:00100000:3.0:1789130131.327717:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886272 00010000:00010000:3.0:1789130131.327778:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130131.327843:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789130131.327856:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604886272:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130131.327878:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130131.327911:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.327929:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.327961:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007515e4b6/0x5c74554e47ce94ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc55 expref: 8 pid: 37275 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.327978:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130131.327983:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130131.327989:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.328013:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.328047:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130131.328104:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130131.328120:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604886272:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 266us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130131.328129:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00010000:00010000:1.0:1789130131.328300:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328331:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328340:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328349:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328357:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130131.328361:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328370:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328383:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.328391:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945811e0/0x5c74554e47ce94ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.328466:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604886144:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 9352us (10040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130131.328475:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:3.0:1789130131.331776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130131.332024:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886528 00000100:00100000:1.0:1789130131.332040:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886528 00000100:00100000:1.0:1789130131.333594:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789130131.333645:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:32732:x1876037604886528:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130131.333784:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.333810:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.333828:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.335392:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.335416:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 11 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.335423:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.335465:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 11 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.335495:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 11 pid: 38723 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.335510:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626805888:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130131.335662:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130131.340314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130131.341308:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886656 00000100:00100000:2.0:1789130131.341324:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886656 00010000:00010000:2.0:1789130131.341382:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 12 pid: 38723 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.341475:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130131.341488:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604886656:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130131.341506:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130131.341515:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 12 pid: 38723 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.341531:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 12 pid: 38723 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.341573:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:2.0:1789130131.341580:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.341597:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.341631:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.342091:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130131.342172:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604886656:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 684us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130131.342181:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00010000:00010000:1.0:1789130131.342709:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9492 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc40 expref: 11 pid: 38723 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.342731:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626805888:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130131.342761:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.342771:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.342777:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130131.343026:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771216 00000001:00080000:1.0:1789130131.344542:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771217 00000001:00080000:1.0:1789130131.344636:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771218 00000100:00100000:1.0:1789130131.344758:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626806016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130131.344848:0:36588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130131.344894:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4887e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130131.344899:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806016 00000100:00100000:2.0:1789130131.344907:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806016 00000100:00100000:2.0:1789130131.344968:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130131.344979:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36588:x1876037626806016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130131.345077:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36588:x1876037626806016:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130131.345085:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130131.345248:0:36588:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:1.0:1789130131.345255:0:36588:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4c19670c0, transno 30064771092 00000100:00100000:1.0:1789130131.345479:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626806016:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789130131.345980:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771219 00000100:00100000:1.0:1789130131.346040:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626806144:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130131.346086:0:36588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130131.346117:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130131.346132:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806144 00000100:00100000:2.0:1789130131.346137:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806144 00000100:00100000:2.0:1789130131.346175:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130131.346183:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36588:x1876037626806144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130131.346370:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:36588:x1876037626806144:12345-0@lo:1000:mdt00_001.0 Request processed in 187us (281us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1789130131.346379:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130131.348934:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626806144:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789130131.349076:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771220 00010000:00010000:1.0:1789130131.349134:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350591:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350644:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350652:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130131.350658:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350670:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350695:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130131.350699:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130131.350705:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350712:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce94d8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350759:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350775:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350781:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350787:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130131.350790:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350796:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350806:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130131.350808:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130131.350811:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350817:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce93ff lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350845:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350864:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350874:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350926:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.350954:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 15 pid: 36589 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.350974:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626806272:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130131.351104:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130131.357546:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626806272:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130131.357557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130131.357597:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.357786:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604886784 00000100:00100000:2.0:1789130131.357805:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604886784 00010000:00010000:2.0:1789130131.357857:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 16 pid: 36589 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130131.357914:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130131.357927:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:2369:x1876037604886784:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130131.357951:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130131.357962:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 16 pid: 36589 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.357977:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 16 pid: 36589 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.358007:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce941b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc1d expref: 16 pid: 36589 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.358023:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130131.358029:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.358043:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.358051:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130131.358072:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130131.358138:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037604886784:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 213us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130131.358147:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:1.0:1789130131.358363:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358371:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358386:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358393:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358401:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358408:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130131.358413:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358432:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358443:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130131.358447:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130131.358452:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358459:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce94df lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358471:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358478:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358485:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358491:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130131.358494:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358500:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358508:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130131.358510:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130131.358513:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.358529:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94d1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130131.359310:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:32732:x1876037604886528:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 25672us (27540us total) trans 30064771221 rc 0/0 00000100:00100000:1.0:1789130131.359324:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000020:00080000:1.0:1789130131.359329:0:36588:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1789130131.360537:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130131.360547:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130131.360586:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1789130131.360595:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130131.368483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130131.369951:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887040 00000100:00100000:3.0:1789130131.369969:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887040 00000100:00100000:1.0:1789130131.370764:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789130131.370777:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:32732:x1876037604887040:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130131.371762:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130131.371887:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771222 00010000:00010000:1.0:1789130131.371957:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.371980:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.371996:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.372006:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.372013:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.372020:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130131.372053:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130131.372200:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:32732:x1876037604887040:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1421us (3724us total) trans 30064771223 rc 0/0 00000100:00100000:1.0:1789130131.372212:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000020:00080000:1.0:1789130131.372219:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130131.372324:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130131.372333:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.372341:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130131.372346:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.372356:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.372373:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789130131.372383:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130131.372391:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.372397:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce94e6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.372417:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130131.372420:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130131.372421:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130131.667493:0:39002:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130131.667507:0:39002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130131.667586:0:39002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1789130131.667598:0:39002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130131.909029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130131.910492:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887168 00000100:00100000:3.0:1789130131.910511:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887168 00000100:00100000:3.0:1789130131.910634:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:3.0:1789130131.910649:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:32742:x1876037604887168:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130131.910694:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130131.910728:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce94ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc5c expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.910818:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.910837:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.910853:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130131.911149:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789130131.911155:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130131.914086:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.914541:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce94ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc5c expref: 18 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.914568:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc5c expref: 17 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.914579:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130131.914582:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130131.914587:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00010000:00010000:1.0:1789130131.930374:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130131.931791:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:32742:x1876037604887168:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 21128us (22760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130131.931806:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1789130131.947763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130131.947948:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887296 00000100:00100000:3.0:1789130131.947963:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887296 00000100:00100000:3.0:1789130131.948045:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:3.0:1789130131.948058:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:32742:x1876037604887296:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130131.948378:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948401:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948416:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948437:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948444:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948451:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948877:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948887:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948894:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130131.948946:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948960:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948968:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948976:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948982:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130131.948986:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.948994:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949008:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130131.949011:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130131.949017:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949031:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce94fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949046:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949053:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949059:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949063:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130131.949066:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949072:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949080:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b488939000) 00010000:00010000:3.0:1789130131.949083:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130131.949086:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.949092:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953663:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953683:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953711:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953718:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130131.953725:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953735:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953755:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789130131.953758:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130131.953763:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130131.953770:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9509 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130131.954307:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:32742:x1876037604887296:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 6244us (6556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130131.954321:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:3.0:1789130132.035698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130132.035857:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887424 00000100:00100000:0.0:1789130132.035872:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887424 00000100:00100000:0.0:1789130132.036072:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:0.0:1789130132.036085:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:32743:x1876037604887424:12345-192.168.201.39@tcp:101:mmap_cat.0 00010000:00010000:0.0:1789130132.036125:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130132.036154:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc63 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036410:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036429:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036444:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036463:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036471:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036479:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036908:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036918:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.036926:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130132.036967:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1789130132.036973:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130132.037000:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037026:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037036:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037043:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037051:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037058:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130132.037063:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037072:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.037087:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:0.0:1789130132.037090:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130132.040350:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040380:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce9517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040410:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040417:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040443:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040450:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130132.040457:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040465:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040487:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130132.040490:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130132.040496:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040502:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce951e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.040582:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc63 expref: 19 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.041432:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc63 expref: 18 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.041445:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:0.0:1789130132.041448:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130132.041452:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb800, rc 0) 00000100:00100000:0.0:1789130132.041568:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+18:32743:x1876037604887424:12345-192.168.201.39@tcp:101:mmap_cat.0 Request processed in 5483us (5882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130132.041591:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:0.0:1789130132.049473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130132.049582:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887552 00000100:00100000:1.0:1789130132.049623:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887552 00000100:00100000:1.0:1789130132.049723:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:1.0:1789130132.049738:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604887552:12345-192.168.201.39@tcp:101:mmap_cat.0 00010000:00010000:1.0:1789130132.049765:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130132.049796:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089cf7a6c/0x5c74554e47ce952c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc6a expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130132.049835:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6aa3f591, atime: 0x6aa3f591, ctime: 0x6aa3f591, blocks: 0xb 00010000:00010000:1.0:1789130132.049867:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=1295s v=(0 0) 00010000:00010000:1.0:1789130132.049873:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130132.049885:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089cf7a6c/0x5c74554e47ce952c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc6a expref: 7 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130132.049921:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089cf7a6c/0x5c74554e47ce952c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc6a expref: 7 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130132.049940:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:1.0:1789130132.050028:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604887552:12345-192.168.201.39@tcp:101:mmap_cat.0 Request processed in 293us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130132.050037:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00080000:2.0:1789130132.050950:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130132.065523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130132.076590:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887808 00000100:00100000:1.0:1789130132.076645:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887808 00000100:00100000:0.0:1789130132.076864:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:0.0:1789130132.076879:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:32743:x1876037604887808:12345-192.168.201.39@tcp:101:mmap_cat.0 00010000:00010000:0.0:1789130132.076910:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130132.076940:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc71 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.077084:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce953a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.077115:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce953a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.077130:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce953a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130132.077146:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1789130132.077357:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc71 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.077380:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce953a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc71 expref: 20 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130132.077390:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:0.0:1789130132.077394:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789130132.077399:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:0.0:1789130132.077491:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:32743:x1876037604887808:12345-192.168.201.39@tcp:101:mmap_cat.0 Request processed in 615us (11984us total) trans 30064771224 rc 0/0 00000100:00100000:0.0:1789130132.077512:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:1.0:1789130132.082321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130132.082530:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604887936 00000100:00100000:2.0:1789130132.082544:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604887936 00002000:00100000:2.0:1789130132.082652:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc4:0x0] (0->4095) req@ffff90b4876dcb40 x1876037604887936/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:603/0 lens 488/0 e 0 to 0 dl 1789130143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130132.082666:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dcb40 with x1876037604887936 ext(0->4095) 00002000:00010000:2.0:1789130132.082673:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dcb40 00000100:00100000:2.0:1789130132.082713:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789130132.082726:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604887936:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130132.083055:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604887936:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 330us (749us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789130132.083065:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00002000:00100000:2.0:1789130132.083073:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc4:0x0] (0->4095) req@ffff90b4876dcb40 x1876037604887936/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:603/0 lens 488/4536 e 0 to 0 dl 1789130143 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130132.083081:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dcb40 with x1876037604887936 ext(0->4095) 00002000:00010000:2.0:1789130132.083085:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dcb40 00000001:00080000:1.0:1789130132.353406:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771089 is committed 00000001:00080000:1.0:1789130132.353432:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771087 is committed 00010000:00010000:3.0:1789130132.933839:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130133.960715:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130134.790034:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130134.790082:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626806400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130134.790198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130134.790723:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806400 00000100:00100000:3.0:1789130134.790735:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806400 00000100:00100000:3.0:1789130134.790826:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130134.790839:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626806400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130134.790897:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130134.790972:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626806400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130134.790999:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789130134.791186:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:0.0:1789130134.791194:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771088 committed transno 30064771089 00000004:00080000:0.0:1789130134.791229:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4c1964000, transno 30064771089 00000100:00100000:0.0:1789130134.791257:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626806400:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789130134.793942:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130134.794325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626806784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130134.794504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130134.794512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626806656:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130134.794596:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626806528:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130134.794679:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626807040:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130134.794727:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130134.794732:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130134.794788:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806528 00000100:00100000:0.0:1789130134.794809:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806528 00000100:00100000:0.0:1789130134.794872:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789130134.794882:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.794942:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626806528:12345-0@lo:400:kworker.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130134.794951:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789130134.795007:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806784 00000100:00100000:0.0:1789130134.795011:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806784 00000100:00100000:0.0:1789130134.795038:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807040 00000100:00100000:0.0:1789130134.795041:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807040 00000100:00100000:0.0:1789130134.795202:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806912 00000100:00100000:0.0:1789130134.795206:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806912 00000100:00100000:0.0:1789130134.795222:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130134.795228:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626806784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795274:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626806784:12345-0@lo:400:kworker.0 Request processed in 45us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130134.795281:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130134.795294:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130134.795300:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626807040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795327:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626807040:12345-0@lo:400:kworker.0 Request processed in 28us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130134.795333:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130134.795345:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130134.795351:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626806912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795378:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626806912:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130134.795383:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789130134.795415:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130134.795447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626806784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795477:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795486:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626806528:0@lo:400:kworker.0 00000100:00100000:0.0:1789130134.795496:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626807040:0@lo:400:kworker.0 00000100:00100000:1.0:1789130134.799021:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626806656 00000100:00100000:1.0:1789130134.799042:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626806656 00000100:00100000:1.0:1789130134.799159:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130134.799171:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626806656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130134.799314:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626806656:12345-0@lo:400:kworker.0 Request processed in 144us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130134.799322:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130134.799388:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626806656:0@lo:400:kworker.0 00000100:00080000:0.0:1789130134.800980:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130134.983314:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130135.813771:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626807168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130135.813850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130135.814044:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807168 00000100:00100000:0.0:1789130135.814053:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807168 00000100:00100000:0.0:1789130135.814139:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789130135.814149:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626807168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130135.814188:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789130135.814237:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626807168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130135.814244:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789130135.814330:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626807168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130136.008451:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130136.095214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.095263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.095298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.095323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.095370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.095404:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888576 00000100:00100000:0.0:1789130136.095414:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888576 00000100:00100000:0.0:1789130136.095492:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888192 00000100:00100000:0.0:1789130136.095496:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888192 00000100:00100000:0.0:1789130136.095519:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130136.095540:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604888576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130136.095641:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604888576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130136.095648:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130136.095674:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130136.095680:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604888192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130136.095712:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c17f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604888192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130136.095719:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00080000:0.0:1789130136.095737:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130136.095900:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888064 00000100:00100000:3.0:1789130136.095905:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888064 00000100:00100000:3.0:1789130136.095942:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:3.0:1789130136.095949:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604888064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130136.095976:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604888064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130136.095982:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1789130136.096083:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888320 00000100:00100000:1.0:1789130136.096088:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888320 00000100:00100000:1.0:1789130136.096130:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888448 00000100:00100000:1.0:1789130136.096133:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888448 00000100:00100000:1.0:1789130136.096157:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130136.096165:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604888320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130136.096191:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604888320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130136.096208:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130136.096221:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130136.096227:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604888448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130136.096248:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604888448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130136.096254:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00080000:1.0:1789130136.096701:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130136.096705:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130136.105841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130136.105895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130136.106004:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888704 00000100:00100000:0.0:1789130136.106016:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888704 00000100:00100000:0.0:1789130136.106103:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888832 00000100:00100000:0.0:1789130136.106107:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888832 00000100:00100000:0.0:1789130136.106145:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130136.106155:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2366:x1876037604888704:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1789130136.106188:0:37273:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce891d 00000100:00080000:0.0:1789130136.106553:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4c18e4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130136.106592:0:37273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771094 00000100:00100000:0.0:1789130136.106821:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+2:2366:x1876037604888704:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 667us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130136.106829:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130136.106848:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1789130136.106854:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2366:x1876037604888832:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1789130136.106867:0:37273:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8924 00000100:00080000:0.0:1789130136.106873:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b4c18e3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130136.106892:0:37273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771089 00000100:00100000:0.0:1789130136.107031:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec5d7172-884c-4596-96b1-f5256d22e019+2:2366:x1876037604888832:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 176us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130136.107038:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:0.0:1789130136.107112:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130136.108356:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130136.108363:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130136.108372:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130136.402289:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771224 is committed 00000020:00080000:0.0:1789130136.402306:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803901 batchid updated 00000020:00080000:0.0:1789130136.402348:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b485c31240 refcount 2 committed 0 result 0 batchid 25769803902 00000020:00080000:0.0:1789130136.402355:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b49774e3c0 00000020:00080000:0.0:1789130136.402359:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4baf19000 00000020:00080000:2.0:1789130136.402380:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803902 committed batchid 25769803901 00000020:00080000:2.0:1789130136.402589:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803901 00000001:00100000:2.0:1789130136.411017:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec5d7172-884c-4596-96b1-f5256d22e019 00000020:00000080:2.0:1789130136.411028:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4c18e1800/ec5d7172-884c-4596-96b1-f5256d22e019 00000001:00080000:2.0:1789130136.411054:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771093 is committed 00000001:00080000:2.0:1789130136.411063:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771094 is committed 00000020:00000080:2.0:1789130136.411075:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c18e1800/ec5d7172-884c-4596-96b1-f5256d22e019 for lustre-OST0000 00000020:00000080:2.0:1789130136.411119:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c18e4000 for lustre-OST0000 00000040:00080000:3.0:1789130136.517984:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130136.517995:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130136.518036:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1789130136.518044:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789130137.029865:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789130137.433537:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec5d7172-884c-4596-96b1-f5256d22e019 00000020:00000080:1.0:1789130137.433549:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4c18e5800/ec5d7172-884c-4596-96b1-f5256d22e019 00000020:00000080:2.0:1789130137.433657:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c18e5800/ec5d7172-884c-4596-96b1-f5256d22e019 for lustre-OST0001 00000020:00000080:2.0:1789130137.433698:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c18e3000 for lustre-OST0001 00010000:00010000:1.0:1789130138.059559:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130138.788672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130138.789271:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604888960 00000100:00100000:1.0:1789130138.789283:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604888960 00000100:00100000:1.0:1789130138.789363:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1789130138.789376:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:32687:x1876037604888960:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789130138.789519:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:32687:x1876037604888960:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 145us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130138.789527:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00080000:2.0:1789130138.790356:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130138.802303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130138.802405:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889216 00000100:00100000:1.0:1789130138.802414:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889216 00000100:00100000:1.0:1789130138.802495:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130138.802506:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:32687:x1876037604889216:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130138.802963:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:32687:x1876037604889216:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 459us (669us total) trans 30064771225 rc 0/0 00000100:00100000:1.0:1789130138.802969:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:0.0:1789130139.080625:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130139.390713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130139.391004:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889344 00000100:00100000:0.0:1789130139.391025:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889344 00000100:00100000:0.0:1789130139.391118:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:0.0:1789130139.391129:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:33184:x1876037604889344:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130139.391148:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130139.391168:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc78 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391231:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391245:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391257:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130139.391449:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130139.391453:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130139.391544:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391577:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 7 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391594:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 6 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130139.391644:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:0.0:1789130139.391647:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130139.391650:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:0.0:1789130139.391709:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:33184:x1876037604889344:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 582us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130139.391717:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00080000:2.0:1789130139.392087:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130139.910014:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626807296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130139.910094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130139.910284:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807296 00000100:00100000:1.0:1789130139.910292:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807296 00000100:00100000:1.0:1789130139.910358:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789130139.910368:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626807296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130139.910401:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00080000:0.0:1789130139.911017:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130139.913585:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626807296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3209us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130139.913612:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130139.913902:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626807296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130139.923590:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626807680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130139.923622:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626807424:0@lo:400:kworker.0 00000100:00100000:1.0:1789130139.923701:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626807552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.932531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130139.932625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130139.932638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626807808:0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.932681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130139.932761:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807680 00000100:00100000:3.0:1789130139.932769:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807680 00000100:00100000:3.0:1789130139.932815:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807808 00000100:00100000:3.0:1789130139.932818:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807808 00000100:00100000:3.0:1789130139.932851:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130139.932860:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626807680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.932930:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626807680:12345-0@lo:400:kworker.0 Request processed in 71us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130139.932938:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130139.932957:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130139.932963:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626807808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.932990:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626807808:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130139.932995:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789130139.933014:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130139.933043:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626807808:0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.933055:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626807680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130139.935930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130139.935998:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626807936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.937193:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807424 00000100:00100000:3.0:1789130139.937205:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807424 00000100:00100000:3.0:1789130139.937337:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789130139.937347:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626807424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130139.937420:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626807424:12345-0@lo:400:kworker.0 Request processed in 75us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130139.937428:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789130139.938250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130139.938332:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626807424:0@lo:400:kworker.0 00000100:00100000:2.0:1789130139.938481:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807936 00000100:00100000:2.0:1789130139.938488:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807936 00000100:00100000:2.0:1789130139.938545:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789130139.938553:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626807936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130139.938625:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626807936:12345-0@lo:400:kworker.0 Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130139.938632:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789130139.938699:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130139.939302:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626807936:0@lo:400:kworker.0 00000100:00100000:1.0:1789130139.939427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130139.939586:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626807552 00000100:00100000:2.0:1789130139.939592:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626807552 00000100:00100000:2.0:1789130139.939663:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789130139.939671:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626807552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130139.939732:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626807552:12345-0@lo:400:kworker.0 Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130139.939738:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789130139.939922:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130139.943889:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771094 gen 2 00000004:00080000:1.0:1789130139.943902:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771094 00000100:00100000:1.0:1789130139.943931:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626807552:0@lo:400:kworker.0 00010000:00010000:1.0:1789130140.102346:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130140.934954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130140.934974:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130140.935039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130140.935189:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808064 00000100:00100000:2.0:1789130140.935197:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808064 00000100:00100000:2.0:1789130140.935240:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130140.935254:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130140.935285:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130140.935333:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130140.935342:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789130140.935469:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130141.128247:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130141.216745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130141.216864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130141.216908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130141.216941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130141.216966:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889856 00000100:00100000:1.0:1789130141.216977:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889856 00000100:00100000:3.0:1789130141.216988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130141.217030:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889472 00000100:00100000:2.0:1789130141.217035:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889472 00000100:00100000:2.0:1789130141.217083:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789130141.217093:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604889472:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130141.217173:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604889472:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130141.217181:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:1.0:1789130141.217566:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889728 00000100:00100000:1.0:1789130141.217571:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889728 00000100:00100000:1.0:1789130141.217597:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130141.217631:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604889856:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130141.217672:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604889856:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 68us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130141.217691:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130141.217721:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130141.217728:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604889728:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130141.217759:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604889728:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130141.217766:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00080000:1.0:1789130141.217810:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130141.217815:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130141.226002:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889600 00000100:00100000:0.0:1789130141.227720:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889600 00000100:00100000:0.0:1789130141.227828:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604889984 00000100:00100000:0.0:1789130141.227832:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604889984 00000100:00100000:0.0:1789130141.227860:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1789130141.227870:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037604889600:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130141.227967:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037604889600:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 98us (11234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130141.227975:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1789130141.227992:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:0.0:1789130141.227998:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604889984:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130141.228021:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604889984:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (11033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130141.228027:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00080000:3.0:1789130141.228239:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789130141.492910:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771225 is committed 00000020:00080000:3.0:1789130141.493059:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803902 batchid updated 00000020:00080000:2.0:1789130141.493172:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000020:00080000:2.0:1789130141.493182:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00010000:00010000:1.0:1789130142.150171:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130143.173864:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130144.202540:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130145.030143:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808448:0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.030222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130145.030290:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130145.030297:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626808576:0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.030337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130145.030386:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808448 00000100:00100000:3.0:1789130145.030394:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808448 00000100:00100000:3.0:1789130145.030461:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130145.030473:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.030536:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808448:12345-0@lo:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130145.030544:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130145.030570:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808576 00000100:00100000:3.0:1789130145.030574:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808576 00000100:00100000:3.0:1789130145.030619:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130145.030628:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.030662:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626808576:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130145.030669:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789130145.030686:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130145.030723:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626808576:0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.030736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808448:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.030896:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626808192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.030933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130145.030968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383221680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626808704:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.030994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130145.031012:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789130145.031018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383222580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626808320:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130145.031058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626808832:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130145.031105:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808320 00000100:00100000:0.0:1789130145.031122:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808320 00000100:00100000:0.0:1789130145.031158:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130145.031166:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626808320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031205:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626808320:12345-0@lo:400:kworker.0 Request processed in 40us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130145.031212:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130145.031232:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808704 00000100:00100000:0.0:1789130145.031235:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808704 00000100:00100000:0.0:1789130145.031260:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808832 00000100:00100000:0.0:1789130145.031263:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808832 00000100:00100000:0.0:1789130145.031285:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130145.031291:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626808704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031337:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626808704:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130145.031344:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130145.031356:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130145.031444:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626808832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031478:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626808832:12345-0@lo:400:kworker.0 Request processed in 116us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130145.031484:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130145.031521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383222580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626808320:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031531:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626808832:0@lo:400:kworker.0 00000100:00100000:0.0:1789130145.031541:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383221680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626808704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.031665:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808192 00000100:00100000:3.0:1789130145.031670:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808192 00000100:00100000:3.0:1789130145.031705:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789130145.031722:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626808192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130145.031763:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626808192:12345-0@lo:400:kworker.0 Request processed in 42us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130145.031769:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789130145.031796:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130145.031799:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130145.031817:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626808192:0@lo:400:kworker.0 00000100:00100000:2.0:1789130145.032025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130145.032062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130145.032130:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626808960 00000100:00100000:3.0:1789130145.032135:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626808960 00000100:00100000:3.0:1789130145.032162:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130145.032169:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130145.032198:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130145.056009:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626808960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23830us (23935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130145.056025:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130145.056314:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626808960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130145.240305:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130145.292747:0:39203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_6 skipping ALWAYS excluded test 6 00000100:00100000:3.0:1789130146.053889:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626809088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130146.053975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130146.057937:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809088 00000100:00100000:1.0:1789130146.057956:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809088 00000100:00100000:1.0:1789130146.058034:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130146.058045:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626809088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130146.058087:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130146.058198:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626809088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130146.058206:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130146.058337:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626809088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130146.246281:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130146.333533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130146.333590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130146.333659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130146.333692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130146.333743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130146.333776:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890496 00000100:00100000:2.0:1789130146.333786:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890496 00000100:00100000:2.0:1789130146.333853:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890368 00000100:00100000:2.0:1789130146.333857:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890368 00000100:00100000:2.0:1789130146.333877:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:2.0:1789130146.333887:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604890496:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130146.333961:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604890496:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130146.333969:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:2.0:1789130146.333987:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789130146.333994:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604890368:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130146.334021:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604890368:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130146.334027:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:3.0:1789130146.334467:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890112 00000100:00100000:3.0:1789130146.334473:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890112 00000100:00100000:3.0:1789130146.334512:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789130146.334519:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604890112:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130146.334547:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604890112:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130146.334553:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00080000:3.0:1789130146.334589:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130146.334629:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130146.335068:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890240 00000100:00100000:0.0:1789130146.335077:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890240 00000100:00100000:0.0:1789130146.335130:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890624 00000100:00100000:0.0:1789130146.335133:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890624 00000100:00100000:0.0:1789130146.335156:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130146.335163:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037604890240:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130146.335210:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037604890240:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130146.335217:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130146.335231:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:0.0:1789130146.335237:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604890624:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130146.335255:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604890624:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 19us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130146.335260:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00080000:3.0:1789130146.339939:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789130146.759956:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130146.759970:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130146.760012:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1789130146.760020:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789130147.276431:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130147.641937:0:39253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7a skipping ALWAYS excluded test 7a 00010000:00010000:2.0:1789130148.300462:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130149.319427:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130150.151721:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626809472:0@lo:400:kworker.0 00000100:00100000:1.0:1789130150.151795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130150.151858:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130150.151864:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626809600:0@lo:400:kworker.0 00000100:00100000:1.0:1789130150.151916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130150.151952:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809472 00000100:00100000:1.0:1789130150.151959:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809472 00000100:00100000:1.0:1789130150.152013:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130150.152031:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626809472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130150.152084:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626809472:12345-0@lo:400:kworker.0 Request processed in 55us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130150.152093:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789130150.152113:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130150.152157:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626809472:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152456:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626809344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130150.152509:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626809856:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130150.152549:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130150.152555:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626809216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130150.152624:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626809728:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130150.152683:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809600 00000100:00100000:2.0:1789130150.152687:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809600 00000100:00100000:2.0:1789130150.152716:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809856 00000100:00100000:2.0:1789130150.152719:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809856 00000100:00100000:2.0:1789130150.152744:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809728 00000100:00100000:2.0:1789130150.152748:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809728 00000100:00100000:2.0:1789130150.152763:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789130150.152770:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626809600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152810:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626809600:12345-0@lo:400:kworker.0 Request processed in 40us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130150.152816:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789130150.152831:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130150.152837:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626809856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152883:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626809856:12345-0@lo:400:kworker.0 Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130150.152890:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130150.152911:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130150.152919:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626809728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.152946:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626809728:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130150.152953:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130150.152972:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809344 00000100:00100000:2.0:1789130150.152975:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809344 00000100:00100000:2.0:1789130150.153002:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789130150.153010:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.153040:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626809344:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130150.153056:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789130150.153081:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809216 00000100:00100000:2.0:1789130150.153085:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809216 00000100:00100000:2.0:1789130150.153109:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789130150.153532:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130150.153537:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130150.153568:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626809728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130150.153579:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626809344:0@lo:400:kworker.0 00000100:00100000:3.0:1789130150.153588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626809856:0@lo:400:kworker.0 00000100:00100000:3.0:1789130150.153635:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626809600:0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.154198:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626809216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130150.154320:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626809216:12345-0@lo:400:kworker.0 Request processed in 1204us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130150.154329:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789130150.155365:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626809216:0@lo:400:kworker.0 00000100:00100000:1.0:1789130150.156073:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130150.156088:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626809984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130150.156152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130150.156193:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626809984 00000100:00100000:1.0:1789130150.156198:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626809984 00000100:00100000:1.0:1789130150.156249:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130150.156259:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626809984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130150.156304:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130150.156353:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626809984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130150.156361:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130150.156396:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626809984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130150.341796:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130150.517308:0:39301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7b skipping ALWAYS excluded test 7b 00000100:00100000:1.0:1789130151.174896:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626810112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130151.174983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130151.175151:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626810112 00000100:00100000:2.0:1789130151.175159:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626810112 00000100:00100000:2.0:1789130151.175229:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130151.175240:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626810112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130151.175296:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130151.175353:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626810112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130151.175360:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130151.175587:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626810112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130151.366054:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130151.449849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130151.449897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130151.449927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130151.449956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130151.449979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130151.450007:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891136 00000100:00100000:2.0:1789130151.450016:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891136 00000100:00100000:2.0:1789130151.450071:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891008 00000100:00100000:2.0:1789130151.450074:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891008 00000100:00100000:2.0:1789130151.450101:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130151.450139:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604891008:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130151.450216:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2367:x1876037604891008:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130151.450224:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130151.450240:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130151.450246:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+5:2366:x1876037604891136:12345-192.168.201.39@tcp:9:kworker.0 00000100:00100000:0.0:1789130151.450489:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890880 00000100:00100000:0.0:1789130151.450493:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890880 00000100:00100000:0.0:1789130151.450529:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891264 00000100:00100000:0.0:1789130151.450531:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891264 00000100:00100000:0.0:1789130151.450550:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130151.450557:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037604890880:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130151.450586:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037604890880:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130151.450592:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130151.450641:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130151.450649:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604891264:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130151.450674:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604891264:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130151.450680:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000020:00000080:2.0:1789130151.450824:0:37275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce88ec 00000100:00080000:2.0:1789130151.450835:0:37275:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130151.450880:0:37275:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771089 00000100:00100000:2.0:1789130151.451100:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+2:2366:x1876037604891136:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 853us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130151.451227:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604890752 00000100:00100000:3.0:1789130151.451232:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604890752 00000100:00100000:3.0:1789130151.451285:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130151.451293:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604890752:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130151.451321:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604890752:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130151.451328:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00080000:3.0:1789130151.451354:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130151.451359:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130151.451361:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130151.452418:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00010000:00010000:0.0:1789130151.452508:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130152.389902:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789130152.870728:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:3.0:1789130152.870743:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4ba7f0000/587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:3.0:1789130152.870773:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4ba7f0000/587d445f-41ce-47d3-97fe-edc16e866648 for lustre-OST0001 00000020:00000080:3.0:1789130152.870828:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4ba7f5000 for lustre-OST0001 00000001:02000400:3.0:1789130153.130351:0:39351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 08:35:50 (1789130150) 00010000:00010000:0.0:1789130153.414372:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130154.303972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.304081:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891520 00000100:00100000:3.0:1789130154.304092:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891520 00000100:00100000:3.0:1789130154.304176:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:3.0:1789130154.304187:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:33861:x1876037604891520:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130154.304219:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130154.304240:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9556 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc7f expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304314:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304330:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304346:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304363:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304371:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.304378:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130154.306086:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130154.307100:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce956b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.307122:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce956b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.307134:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce956b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130154.309353:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789130154.309736:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.309955:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.309967:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.309973:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130154.309978:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.309987:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310004:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:3.0:1789130154.310008:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130154.310013:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310032:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce955d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310049:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310054:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310060:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310065:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130154.310068:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310074:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310082:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b488939100) 00010000:00010000:3.0:1789130154.310084:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130154.310087:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.310093:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9564 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.311077:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9556 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc7f expref: 13 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.311110:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce956b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc7f expref: 12 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.311119:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130154.311121:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130154.311124:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86800, rc 0) 00000100:00100000:3.0:1789130154.311479:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:33861:x1876037604891520:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 7291us (7519us total) trans 30064771226 rc 0/0 00000100:00100000:3.0:1789130154.311638:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:3.0:1789130154.328056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.328106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.328701:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891776 00000100:00100000:0.0:1789130154.328712:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891776 00000100:00100000:0.0:1789130154.328787:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:0.0:1789130154.328798:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:33861:x1876037604891776:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789130154.328930:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:33861:x1876037604891776:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 133us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130154.328939:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:2.0:1789130154.329520:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604891648 00000100:00100000:2.0:1789130154.329527:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604891648 00000100:00100000:2.0:1789130154.329580:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130154.329589:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604891648:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130154.329633:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130154.329660:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce956b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc7f expref: 12 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.329683:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130154.329690:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130154.329739:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604891648:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 152us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130154.329746:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789130154.436742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.437275:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892032 00000100:00100000:0.0:1789130154.437289:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892032 00000100:00100000:0.0:1789130154.437360:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789130154.437372:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:33632:x1876037604892032:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130154.437397:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130154.437401:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130154.437430:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce94f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc5c expref: 11 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.437451:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:0.0:1789130154.437474:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130154.437494:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9579 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc86 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.438343:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.438364:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 5 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.438385:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.438425:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 5 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.438443:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 5 pid: 36588 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130154.438460:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626810240:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130154.438580:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d103c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130154.438916:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130154.443082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.443331:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892160 00000100:00100000:3.0:1789130154.443343:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892160 00010000:00010000:3.0:1789130154.443403:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 6 pid: 36588 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130154.443445:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130154.443455:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604892160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130154.443469:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130154.443476:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 6 pid: 36588 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.443490:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 6 pid: 36588 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.443532:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130154.443549:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.443559:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.443566:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.443585:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130154.443655:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604892160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130154.443663:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00080000:0.0:1789130154.443895:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130154.443980:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce954f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc78 expref: 5 pid: 36588 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130154.443999:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626810240:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130154.444023:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.444032:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.444039:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.444067:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.444077:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.444095:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130154.445126:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc5:0x0], index 1: 0 00010000:00010000:1.0:1789130154.445385:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445400:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445411:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445447:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445454:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445463:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445469:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130154.445473:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445479:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445491:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939500) 00010000:00010000:1.0:1789130154.445495:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130154.445507:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445514:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce9580 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130154.445527:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000007a5b61f reply state 0000000026766305 transno 30064771227 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130154.445536:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130154.445575:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce9579 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 13 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445597:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 12 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.445641:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130154.445643:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130154.445646:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130154.445720:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:33632:x1876037604892032:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8350us (8989us total) trans 30064771227 rc 0/0 00000100:00100000:1.0:1789130154.445729:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:2.0:1789130154.450364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130154.450456:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450472:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450480:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450518:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130154.450524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450532:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450562:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff90b4909bd500) 00010000:00010000:1.0:1789130154.450565:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130154.450572:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.450579:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9587 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130154.451123:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892288 00000100:00100000:3.0:1789130154.451135:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892288 00000100:00100000:3.0:1789130154.451193:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789130154.451210:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2366:x1876037604892288:12345-192.168.201.39@tcp:8:bash.0 00010000:00080000:3.0:1789130154.451243:0:38727:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp t0 exp 0000000000000000 cur 1317 last 0 00000020:00000080:3.0:1789130154.451285:0:38727:0:(genops.c:1385:class_connect()) connect: client 587d445f-41ce-47d3-97fe-edc16e866648, cookie 0x5c74554e47ce959c 00002000:00100000:3.0:1789130154.451298:0:38727:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 587d445f-41ce-47d3-97fe-edc16e866648/ffff90b381df1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 8519680 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789130154.451323:0:38727:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789130154.451894:0:38727:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789130154.451932:0:38727:0:(import.c:65:import_set_state_nolock()) ffff90b381df4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130154.452017:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2366:x1876037604892288:12345-192.168.201.39@tcp:8:bash.0 Request processed in 805us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130154.452038:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130154.465974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130154.466164:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892416 00000100:00100000:2.0:1789130154.466176:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892416 00000100:00100000:2.0:1789130154.466304:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130154.466317:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:33632:x1876037604892416:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130154.466337:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130154.466360:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc8d expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130154.466388:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130154.466415:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=1317s v=(0 0) 00010000:00010000:2.0:1789130154.466420:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130154.466431:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.466451:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.466466:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:2.0:1789130154.466556:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:33632:x1876037604892416:12345-192.168.201.39@tcp:101:bash.0 Request processed in 242us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130154.466564:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00080000:0.0:1789130154.468167:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130154.471834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.472089:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892672 00000100:00100000:0.0:1789130154.472098:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892672 00000100:00100000:0.0:1789130154.472169:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789130154.472179:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a782a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:33632:x1876037604892672:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789130154.472746:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a782a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:33632:x1876037604892672:12345-192.168.201.39@tcp:35:bash.0 Request processed in 565us (929us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1789130154.472755:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130154.611591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.611801:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604892800 00000100:00100000:0.0:1789130154.611811:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604892800 00000100:00100000:0.0:1789130154.612101:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789130154.612114:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:33875:x1876037604892800:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130154.612155:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130154.612185:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc94 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.612309:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.612327:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.612339:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130154.612427:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789130154.612431:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130154.612455:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.613590:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc94 expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.613639:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc94 expref: 14 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.613649:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130154.613653:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130154.613658:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eaa00, rc 0) 00000100:00100000:0.0:1789130154.613754:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:33875:x1876037604892800:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1643us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130154.613764:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789130154.636333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.636669:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893056 00000100:00100000:3.0:1789130154.636680:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893056 00000100:00100000:3.0:1789130154.636755:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789130154.636767:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:33875:x1876037604893056:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130154.636800:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130154.637040:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce95b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abc9b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.637169:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce95bf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.637185:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce95bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.637209:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce95bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130154.637222:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1789130154.637356:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce95b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc9b expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.637390:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce95bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc9b expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.637399:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:3.0:1789130154.637414:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130154.637419:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86e00, rc 0) 00000100:00100000:3.0:1789130154.637599:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:33875:x1876037604893056:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 833us (1273us total) trans 30064771229 rc 0/0 00000100:00100000:3.0:1789130154.637679:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789130154.660095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.660149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130154.660468:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893312 00000100:00100000:1.0:1789130154.660478:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893312 00000100:00100000:1.0:1789130154.660570:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:1.0:1789130154.660581:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:33875:x1876037604893312:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130154.660643:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130154.660669:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce95cd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abca2 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.660805:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.661154:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.661187:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130154.661214:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:1.0:1789130154.661353:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce95cd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca2 expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.661374:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca2 expref: 18 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.661384:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130154.661386:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130154.661390:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:2.0:1789130154.661573:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893440 00000100:00100000:2.0:1789130154.661579:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893440 00000100:00100000:2.0:1789130154.661647:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130154.661665:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604893440:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130154.661678:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130154.661694:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce95bf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc9b expref: 19 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.661709:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:2.0:1789130154.661712:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130154.662025:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:33875:x1876037604893312:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1444us (1943us total) trans 30064771230 rc 0/0 00000100:00100000:1.0:1789130154.662034:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:2.0:1789130154.670658:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604893440:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 8984us (10496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130154.670675:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130154.683333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130154.683942:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893568 00000100:00100000:1.0:1789130154.683954:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893568 00000100:00100000:1.0:1789130154.684020:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:1.0:1789130154.684030:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604893568:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789130154.684081:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.684103:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.684131:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130154.684136:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130154.684141:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.684177:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.684204:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 7 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130154.684220:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626810368:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130154.684373:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130154.704802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130154.704873:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876ded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626810368:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130154.704906:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130154.705054:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893696 00000100:00100000:0.0:1789130154.705062:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893696 00002000:00100000:0.0:1789130154.705123:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc5:0x0] (0->5) req@ffff90b4876dc3c0 x1876037604893696/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:625/0 lens 496/0 e 0 to 0 dl 1789130165 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130154.705134:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dc3c0 with x1876037604893696 ext(0->5) 00010000:00010000:0.0:1789130154.705143:0:37280:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 8 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.705160:0:37280:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 8 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130154.705186:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b4876dc3c0 00000100:00100000:0.0:1789130154.705240:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789130154.705252:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604893696:12345-192.168.201.39@tcp:4:lfs.0 00000001:00100000:1.0:1789130154.785896:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000100:00100000:2.0:1789130154.787115:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604893696:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 81855us (82314us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1789130154.787130:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:2.0:1789130154.787145:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc5:0x0] (0->5) req@ffff90b4876dc3c0 x1876037604893696/t30064771090(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:625/0 lens 496/448 e 0 to 0 dl 1789130165 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130154.787156:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dc3c0 with x1876037604893696 ext(0->5) 00010000:00010000:2.0:1789130154.787168:0:37280:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.787197:0:37280:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130154.787217:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b4876dc3c0 00000100:00100000:3.0:1789130154.793054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130154.794379:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604893824 00000100:00100000:2.0:1789130154.794394:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604893824 00010000:00010000:2.0:1789130154.794448:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130154.794515:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1789130154.794527:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604893824:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130154.794544:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789130154.794567:0:36572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:2.0:1789130154.794570:0:36572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1789130154 00002000:00010000:2.0:1789130154.794573:0:36572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1789130154 00002000:00010000:2.0:1789130154.794575:0:36572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 0 -> 1789130154 00010000:00010000:2.0:1789130154.794583:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.794599:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.794670:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47ce95a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc8d expref: 9 pid: 37273 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.794690:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130154.794694:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130154.794701:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.794726:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.794768:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130154.795093:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795104:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795134:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795143:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795151:0:37275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795159:0:37275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130154.795164:0:37275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795198:0:37275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795213:0:37275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130154.795220:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce95e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130154.795317:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604893568:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 111288us (111994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130154.795327:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130154.796236:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604893824:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1706us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130154.796248:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130154.804259:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.804344:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894080 00000100:00100000:0.0:1789130154.804354:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894080 00000100:00100000:0.0:1789130154.804414:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789130154.804425:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:33875:x1876037604894080:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789130154.804502:0:36591:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x13:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca2 expref: 17 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130154.804811:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771231 00000001:00080000:0.0:1789130154.804859:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771232 00000001:00080000:0.0:1789130154.806025:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771233 00010000:00010000:0.0:1789130154.806095:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.806112:0:36591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.806122:0:36591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.806163:0:36591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.806180:0:36591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 21 pid: 36589 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130154.806218:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626810496:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130154.806966:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130154.810911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130154.811029:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894208 00000100:00100000:1.0:1789130154.811039:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894208 00010000:00010000:1.0:1789130154.811083:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 22 pid: 36589 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130154.811128:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130154.811140:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:2369:x1876037604894208:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130154.811156:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130154.811164:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 22 pid: 36589 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.811201:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 22 pid: 36589 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.811230:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130154.811236:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.811246:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.811253:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130154.811273:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130154.811346:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:2369:x1876037604894208:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130154.811354:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00010000:00010000:0.0:1789130154.816342:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce958e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abc86 expref: 21 pid: 36589 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130154.816370:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626810496:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130154.816396:0:36591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.816407:0:36591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.816413:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130154.816583:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771234 00000001:00080000:0.0:1789130154.816884:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771235 00000100:00100000:0.0:1789130154.817016:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626810624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130154.817093:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130154.817138:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130154.817299:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626810624 00000100:00100000:2.0:1789130154.817309:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626810624 00000100:00100000:2.0:1789130154.817382:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130154.817393:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626810624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130154.817484:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626810624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130154.817492:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130154.817530:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626810624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130154.818029:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771236 00000100:00100000:2.0:1789130154.818092:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626810752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130154.818152:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130154.818184:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130154.818303:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626810752 00000100:00100000:3.0:1789130154.818310:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626810752 00000100:00100000:3.0:1789130154.818337:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130154.818345:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626810752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130154.818511:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36591:x1876037626810752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (370us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1789130154.818517:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789130154.818707:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130154.819447:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626810752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130154.819518:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771237 00010000:00010000:2.0:1789130154.819567:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819578:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819599:0:36591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819629:0:36591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130154.819633:0:36591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819641:0:36591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819658:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:2.0:1789130154.819662:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130154.819667:0:36591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130154.819673:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95e9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130154.821044:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130154.822379:0:36591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].7, 64 off8688 00000004:00080000:2.0:1789130154.822400:0:36591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1317919797242ns, next at 1318919793415ns, rc = 0 00000001:00080000:2.0:1789130154.822414:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771238 00010000:00010000:2.0:1789130154.822480:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:2.0:1789130154.822483:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130154.822495:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce95d4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca2 expref: 25 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130154.822699:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:33875:x1876037604894080:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 18274us (18449us total) trans 30064771239 rc 0/0 00000100:00100000:2.0:1789130154.822725:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000020:00080000:2.0:1789130154.822732:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789130154.841805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130154.842000:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894336 00000100:00100000:0.0:1789130154.842012:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894336 00000100:00100000:0.0:1789130154.842084:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:0.0:1789130154.842094:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:33875:x1876037604894336:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130154.842134:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130154.842178:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce95f0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abca9 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.842254:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce95f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca9 expref: 25 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.842268:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce95f0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca9 expref: 25 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130154.842286:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:0.0:1789130154.842290:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130154.842294:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb400, rc 0) 00000100:00100000:0.0:1789130154.842359:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:33875:x1876037604894336:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 266us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130154.842366:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:1.0:1789130154.861965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130154.862109:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894592 00000100:00100000:3.0:1789130154.862121:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894592 00000100:00100000:3.0:1789130154.862197:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:3.0:1789130154.862208:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:33875:x1876037604894592:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130154.862778:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:33875:x1876037604894592:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 569us (822us total) trans 30064771240 rc 0/0 00000100:00100000:3.0:1789130154.862788:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000040:00080000:1.0:1789130154.949970:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130154.949981:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130154.950021:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1789130154.950031:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130155.029513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130155.029709:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894720 00000100:00100000:0.0:1789130155.029720:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894720 00000100:00100000:0.0:1789130155.029787:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:0.0:1789130155.029799:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:33885:x1876037604894720:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130155.029886:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.029904:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.029917:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.029933:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.029954:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.029961:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030062:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030070:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030077:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130155.030130:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030151:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030157:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030171:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030177:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130155.030180:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030196:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030215:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130155.030218:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130155.030224:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030230:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce95f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030243:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030248:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030253:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030258:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbddc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130155.030261:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030266:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030272:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130155.030274:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130155.030277:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030282:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce95fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030310:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030315:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030321:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030326:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130155.030329:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030335:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030343:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:0.0:1789130155.030346:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130155.030467:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.030476:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9605 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130155.030559:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:33885:x1876037604894720:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 761us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130155.030567:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:0.0:1789130155.171841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130155.171941:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604894976 00000100:00100000:1.0:1789130155.171952:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604894976 00000100:00100000:1.0:1789130155.172013:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:1.0:1789130155.172023:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:33892:x1876037604894976:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130155.172046:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130155.172081:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce960c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcb0 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172177:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172201:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172213:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172229:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172238:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172244:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172580:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9621 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172590:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9621 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172598:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9621 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130155.172649:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:1.0:1789130155.172754:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172773:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172779:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172785:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130155.172789:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172797:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172809:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130155.172813:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130155.172818:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172825:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9613 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172839:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172845:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172850:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172855:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130155.172864:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172871:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172879:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff90b4909bd500) 00010000:00010000:1.0:1789130155.172882:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130155.172885:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172890:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce961a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172955:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce960c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb0 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172970:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9621 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb0 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.172978:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:1.0:1789130155.172980:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130155.172983:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00100000:1.0:1789130155.173055:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:33892:x1876037604894976:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1032us (1223us total) trans 30064771241 rc 0/0 00000100:00100000:1.0:1789130155.173062:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:1.0:1789130155.187023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130155.187114:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604895232 00000100:00100000:2.0:1789130155.187127:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604895232 00000100:00100000:2.0:1789130155.187201:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130155.187212:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:33892:x1876037604895232:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1789130155.187464:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:33892:x1876037604895232:12345-192.168.201.39@tcp:35:cat.0 Request processed in 253us (455us total) trans 30064771242 rc 0/0 00000100:00100000:2.0:1789130155.187473:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130155.269920:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130155.269950:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626810880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130155.270043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130155.270363:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626810880 00000100:00100000:1.0:1789130155.270373:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626810880 00000100:00100000:1.0:1789130155.270437:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789130155.270465:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626810880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130155.270492:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130155.270551:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626810880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130155.270558:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130155.270717:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626810880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130155.273255:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626811264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130155.273255:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626811136:0@lo:400:kworker.0 00000100:00100000:0.0:1789130155.273327:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626811008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130155.273390:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626811392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.275630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130155.275723:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811264 00000100:00100000:3.0:1789130155.275732:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811264 00000100:00100000:3.0:1789130155.275802:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130155.275819:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626811264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.275879:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626811264:12345-0@lo:400:kworker.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130155.275887:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130155.275927:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626811264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130155.282140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130155.282444:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811136 00000100:00100000:3.0:1789130155.282455:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811136 00000100:00100000:3.0:1789130155.282535:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130155.282545:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626811136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.282632:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626811136:12345-0@lo:400:kworker.0 Request processed in 88us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130155.282640:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789130155.282713:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130155.282759:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626811136:0@lo:400:kworker.0 00000100:00100000:0.0:1789130155.283633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130155.283674:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626811520:0@lo:400:kworker.0 00000100:00100000:0.0:1789130155.283709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130155.283790:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811520 00000100:00100000:3.0:1789130155.283797:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811520 00000100:00100000:3.0:1789130155.283860:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130155.283869:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626811520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.283946:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626811520:12345-0@lo:400:kworker.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130155.283954:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789130155.284087:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130155.284128:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626811520:0@lo:400:kworker.0 00000100:00100000:1.0:1789130155.286321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130155.286698:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811008 00000100:00100000:2.0:1789130155.286708:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811008 00000100:00100000:2.0:1789130155.286777:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789130155.286788:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626811008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130155.286862:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626811008:12345-0@lo:400:kworker.0 Request processed in 76us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130155.286869:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789130155.287306:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811392 00000100:00100000:3.0:1789130155.287313:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811392 00000100:00100000:3.0:1789130155.287375:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130155.287383:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626811392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.287433:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626811392:12345-0@lo:400:kworker.0 Request processed in 51us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130155.287441:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789130155.287501:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130155.287818:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626811008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130155.287855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626811392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130155.421865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130155.421998:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604895488 00000100:00100000:0.0:1789130155.422009:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604895488 00000100:00100000:0.0:1789130155.422083:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:0.0:1789130155.422093:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:33904:x1876037604895488:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130155.422128:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130155.422131:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130155.422159:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce95b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc94 expref: 29 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422189:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130155.422202:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130155.422220:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce962f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcb7 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422329:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9636 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422343:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9636 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422373:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9636 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130155.422387:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1789130155.422517:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce962f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb7 expref: 31 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422549:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9636 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb7 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.422558:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:0.0:1789130155.422561:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130155.422564:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd400, rc 0) 00000100:00100000:0.0:1789130155.422683:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:33904:x1876037604895488:12345-192.168.201.39@tcp:101:bash.0 Request processed in 590us (829us total) trans 30064771243 rc 0/0 00000100:00100000:0.0:1789130155.422692:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:0.0:1789130155.428847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130155.428928:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604895744 00000100:00100000:3.0:1789130155.428940:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604895744 00000100:00100000:3.0:1789130155.429014:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:3.0:1789130155.429027:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+30:33904:x1876037604895744:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:3.0:1789130155.429084:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130155.429109:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9636 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb7 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.429141:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9621 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcb0 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.429155:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:3.0:1789130155.429161:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130155.429679:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.429714:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.429726:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130155.429785:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771244 00000004:00010000:3.0:1789130155.429819:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000683128b4 reply state 00000000a3c579ee transno 30064771245 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130155.429828:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130155.429930:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:33904:x1876037604895744:12345-192.168.201.39@tcp:36:bash.0 Request processed in 904us (1094us total) trans 30064771245 rc 0/0 00000100:00100000:3.0:1789130155.429938:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00000020:00080000:3.0:1789130155.429944:0:36589:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130155.431855:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431872:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431880:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431886:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130155.431891:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431899:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431914:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:1.0:1789130155.431917:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130155.431922:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.431941:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9644 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130155.437022:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130155.437143:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604895872 00000100:00100000:2.0:1789130155.437168:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604895872 00000100:00100000:2.0:1789130155.437246:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:2.0:1789130155.437257:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:33904:x1876037604895872:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130155.437283:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130155.437305:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce964b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcbe expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437754:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437770:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437784:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130155.437834:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:2.0:1789130155.437839:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130155.437861:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437888:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce964b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcbe expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437903:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcbe expref: 31 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130155.437911:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130155.437914:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130155.437918:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130155.437988:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:33904:x1876037604895872:12345-192.168.201.39@tcp:101:bash.0 Request processed in 732us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130155.437997:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:2.0:1789130155.447593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130155.447847:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896128 00000100:00100000:1.0:1789130155.447858:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896128 00000100:00100000:1.0:1789130155.447929:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789130155.447939:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+31:33904:x1876037604896128:12345-192.168.201.39@tcp:103:bash.0 00010000:00010000:1.0:1789130155.447957:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130155.447983:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9652 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcbe expref: 31 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.448007:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce95f0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abca9 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130155.448019:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:1.0:1789130155.448032:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130155.448154:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:33904:x1876037604896128:12345-192.168.201.39@tcp:103:bash.0 Request processed in 215us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130155.448161:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130155.456175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130155.456334:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896256 00000100:00100000:3.0:1789130155.456353:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896256 00000100:00100000:3.0:1789130155.456421:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789130155.456432:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:33904:x1876037604896256:12345-192.168.201.39@tcp:58:bash.0 00010000:00010000:3.0:1789130155.456550:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.456568:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130155.456579:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130155.457395:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].6, 136 off9008 00000100:00100000:2.0:1789130155.458204:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:33904:x1876037604896256:12345-192.168.201.39@tcp:58:bash.0 Request processed in 1767us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130155.458228:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00010000:00010000:2.0:1789130155.462293:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130155.462958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130155.463065:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896384 00000100:00100000:3.0:1789130155.463085:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896384 00000100:00100000:0.0:1789130155.463299:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:0.0:1789130155.463312:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:33904:x1876037604896384:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130155.463333:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130155.463451:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcc5 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463587:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463632:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463655:0:38734:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463746:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463763:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130155.463767:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130155.463771:0:38734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130155.463779:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd000, rc 0) 00000100:00100000:0.0:1789130155.464016:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:33904:x1876037604896384:12345-192.168.201.39@tcp:101:bash.0 Request processed in 708us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130155.464025:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000040:00080000:1.0:1789130155.974237:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130155.974247:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130155.974299:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:1.0:1789130155.974310:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130155.974477:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dc780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626811648:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130155.974589:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130155.989070:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dc780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626811648:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130155.989364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130155.990455:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896512 00000100:00100000:2.0:1789130155.990467:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896512 00000100:00100000:2.0:1789130155.990583:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:2.0:1789130155.990595:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:33905:x1876037604896512:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130155.990661:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130155.990787:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:33905:x1876037604896512:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 194us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130155.990795:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:2.0:1789130156.000922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.001010:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896640 00000100:00100000:0.0:1789130156.001021:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896640 00000100:00100000:0.0:1789130156.001101:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:0.0:1789130156.001110:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:33905:x1876037604896640:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789130156.001200:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001218:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001248:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001268:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001275:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001283:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001309:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001316:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001322:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130156.001366:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:0.0:1789130156.001371:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130156.001383:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001393:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001399:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001416:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001422:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130156.001426:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001432:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001444:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130156.001564:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130156.001570:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001576:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9667 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001589:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001594:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.001599:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003615:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbddc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130156.003622:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003662:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003689:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb4468db5 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130156.003692:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130156.003696:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003703:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce966e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003726:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003732:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003738:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003743:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130156.003746:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003813:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003822:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130156.003824:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130156.003827:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.003844:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce9675 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130156.003945:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:33905:x1876037604896640:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 2833us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130156.003954:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00080000:2.0:1789130156.004225:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130156.013398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.013498:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604896896 00000100:00100000:0.0:1789130156.013510:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604896896 00000100:00100000:0.0:1789130156.013657:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:0.0:1789130156.013669:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:33905:x1876037604896896:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130156.013690:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130156.013714:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce967c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abccc expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013825:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013840:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013852:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130156.013863:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1789130156.013958:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013965:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013988:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.013994:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130156.013997:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014005:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014015:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130156.014018:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130156.014022:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014028:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9683 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014067:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce967c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abccc expref: 32 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014077:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130156.014079:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130156.014096:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce967c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abccc expref: 32 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.014108:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd800, rc 0) 00000100:00100000:0.0:1789130156.014180:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:33905:x1876037604896896:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 514us (791us total) trans 30064771246 rc 301/301 00000100:00100000:0.0:1789130156.014196:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:3.0:1789130156.023358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.023462:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897024 00000100:00100000:2.0:1789130156.023472:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897024 00000100:00100000:2.0:1789130156.023534:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789130156.023544:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:33905:x1876037604897024:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130156.023580:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130156.023736:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:33905:x1876037604897024:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 192us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.023770:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789130156.032408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.033468:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897152 00000100:00100000:0.0:1789130156.033481:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897152 00000100:00100000:0.0:1789130156.033550:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789130156.033561:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:33905:x1876037604897152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130156.033582:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130156.033644:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcd3 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.033727:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.033742:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.034037:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130156.034161:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789130156.034193:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130156.034221:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.034249:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcd3 expref: 33 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.034269:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcd3 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.034277:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:2.0:1789130156.034280:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130156.034284:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:2.0:1789130156.034351:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:33905:x1876037604897152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 792us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.034359:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789130156.051032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.054662:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897408 00000100:00100000:3.0:1789130156.054681:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897408 00000100:00100000:2.0:1789130156.055042:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:2.0:1789130156.055055:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:33905:x1876037604897408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130156.055081:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130156.055084:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130156.055113:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9698 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcd3 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.055144:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:2.0:1789130156.055287:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130156.055308:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce969f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcda expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130156.056336:0:38734:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc5:0x0], index 0: 0 00010000:00010000:2.0:1789130156.056561:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96a6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.056579:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.056591:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.056929:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce969f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcda expref: 34 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.056955:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96a6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcda expref: 33 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.057093:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130156.057097:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130156.057100:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130156.057265:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:33905:x1876037604897408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2211us (6242us total) trans 30064771247 rc 0/0 00000100:00100000:2.0:1789130156.057280:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:3.0:1789130156.062350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.062436:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897536 00000100:00100000:1.0:1789130156.062446:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897536 00000100:00100000:1.0:1789130156.062510:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:1.0:1789130156.063852:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:33905:x1876037604897536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130156.063883:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130156.063911:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce96b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abce1 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.063976:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.063990:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.064002:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130156.064063:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789130156.064067:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130156.064089:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.064113:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce96b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce1 expref: 35 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.064209:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce1 expref: 34 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.064218:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130156.064237:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130156.064241:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:1.0:1789130156.064303:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:33905:x1876037604897536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1783us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130156.064311:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:1.0:1789130156.072000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.072098:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897792 00000100:00100000:2.0:1789130156.072107:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897792 00000100:00100000:2.0:1789130156.072182:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:2.0:1789130156.072193:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:33905:x1876037604897792:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130156.072259:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130156.072286:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96a6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcda expref: 34 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072302:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130156.072316:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce96bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce1 expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072325:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130156.072330:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130156.072354:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072366:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072374:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072385:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072392:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072398:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072469:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072487:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072493:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072499:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130156.072504:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072511:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072520:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130156.072523:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130156.072526:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072533:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072544:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072550:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072557:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072563:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130156.072570:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072576:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072584:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1741216f (ffff90b48a1fd900) 00010000:00010000:2.0:1789130156.072586:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130156.072589:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.072594:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96c9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1741216f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130156.072710:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:33905:x1876037604897792:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 518us (718us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130156.072717:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789130156.088996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.097815:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604897920 00000100:00100000:2.0:1789130156.097831:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604897920 00000100:00100000:2.0:1789130156.097908:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1789130156.097920:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:33905:x1876037604897920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130156.097942:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130156.097976:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96d0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abce8 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098016:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96d7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098032:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098062:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098403:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce96d0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce8 expref: 34 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098420:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96d7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce8 expref: 33 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.098429:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130156.098432:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130156.098435:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:2.0:1789130156.099109:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:33905:x1876037604897920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 595us (9528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.099181:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:0.0:1789130156.101768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.101915:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604898176 00000100:00100000:1.0:1789130156.101924:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604898176 00000100:00100000:1.0:1789130156.101993:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:1.0:1789130156.102004:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:33905:x1876037604898176:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130156.102084:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.102101:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.102114:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130156.102568:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].7, 88 off8736 00000004:00080000:1.0:1789130156.102580:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1319199977552ns, next at 1320199974463ns, rc = 0 00000004:00010000:1.0:1789130156.102709:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a1aadb17 reply state 0000000092862b36 transno 30064771248 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.102720:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130156.102823:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+35:33905:x1876037604898176:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 821us (1073us total) trans 30064771248 rc 0/0 00000100:00100000:1.0:1789130156.102831:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:1.0:1789130156.110787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.111045:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604898304 00000100:00100000:3.0:1789130156.111055:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604898304 00000100:00100000:3.0:1789130156.111123:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:3.0:1789130156.111133:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:33905:x1876037604898304:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130156.111161:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130156.111193:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcef expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.111258:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 36 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.111272:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 36 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.111292:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130156.111295:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130156.111298:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86200, rc 0) 00000100:00100000:3.0:1789130156.111365:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:33905:x1876037604898304:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 233us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.111373:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00010000:00010000:0.0:1789130156.111952:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.111971:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.111979:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.112001:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130156.112005:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.112013:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.112027:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:0.0:1789130156.112029:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130156.112033:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.112039:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce96de lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130156.120090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.120241:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604898432 00000100:00100000:2.0:1789130156.120251:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604898432 00000100:00100000:2.0:1789130156.120332:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:2.0:1789130156.120343:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604898432:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789130156.120740:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604898432:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 397us (658us total) trans 30064771095 rc 0/0 00000100:00100000:2.0:1789130156.120748:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00080000:0.0:1789130156.121044:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130156.137740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.137941:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604898688 00000100:00100000:0.0:1789130156.137954:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604898688 00000100:00100000:0.0:1789130156.138033:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1789130156.138045:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+35:33905:x1876037604898688:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130156.138344:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:33905:x1876037604898688:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 300us (614us total) trans 30064771249 rc 0/0 00000100:00100000:0.0:1789130156.138353:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130156.146376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.146474:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604898944 00000100:00100000:2.0:1789130156.146484:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604898944 00000100:00100000:2.0:1789130156.146553:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1789130156.146577:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:33905:x1876037604898944:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130156.146733:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:33905:x1876037604898944:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.146741:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:1.0:1789130156.151076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.151286:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899072 00000100:00100000:2.0:1789130156.151297:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899072 00000100:00100000:2.0:1789130156.151367:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:2.0:1789130156.151378:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:33905:x1876037604899072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130156.151405:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130156.151429:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96ec lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcf6 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151499:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151525:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151538:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130156.151576:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130156.151594:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151661:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce96ec lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcf6 expref: 38 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151680:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcf6 expref: 37 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.151704:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130156.151707:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789130156.151712:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:2.0:1789130156.151778:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:33905:x1876037604899072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 402us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.151787:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:0.0:1789130156.155905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.156001:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899200 00000100:00100000:3.0:1789130156.156011:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899200 00000100:00100000:3.0:1789130156.156094:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130156.156106:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604899200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130156.156133:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130156.156159:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abcfd expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130156.156203:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f5ab, blocks: 0x1 00010000:00010000:3.0:1789130156.156225:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=1319s v=(0 0) 00010000:00010000:3.0:1789130156.156229:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130156.156240:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 8 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.156261:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 8 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.156277:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:3.0:1789130156.156392:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604899200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 289us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.156399:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:1.0:1789130156.185021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.185263:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899456 00000100:00100000:3.0:1789130156.185273:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899456 00000100:00100000:3.0:1789130156.185334:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:3.0:1789130156.185344:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:33905:x1876037604899456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130156.185451:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:33905:x1876037604899456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.185459:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:0.0:1789130156.191567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.195061:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899584 00000100:00100000:2.0:1789130156.195077:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899584 00000100:00100000:2.0:1789130156.195158:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789130156.195179:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:33905:x1876037604899584:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789130156.294003:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130156.294026:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626811776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130156.294099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130156.294281:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811776 00000100:00100000:1.0:1789130156.294291:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811776 00000100:00100000:1.0:1789130156.294355:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130156.294368:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626811776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130156.294421:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130156.294497:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626811776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130156.294506:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130156.295000:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626811776:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789130156.312907:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771249 is committed 00000004:00080000:1.0:1789130156.312956:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1789130156.312999:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789130156.313017:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b484c510c0 refcount 2 committed 0 result 0 batchid 25769803903 00000020:00080000:1.0:1789130156.313023:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483ebcf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b484c51840 00000020:00080000:1.0:1789130156.313027:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483ebc200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b382de7c00 00000100:00100000:3.0:1789130156.313057:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:33905:x1876037604899584:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 117884us (121495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.313069:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:1.0:1789130156.313297:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130156.313314:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626811904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789130156.313449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130156.313519:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626811904 00000100:00100000:1.0:1789130156.313528:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626811904 00000100:00080000:0.0:1789130156.313587:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130156.313593:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130156.313628:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626811904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789130156.313662:0:37658:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:197 count 1 00002000:00010000:1.0:1789130156.313709:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 6, mtime: 0x6aa3f5aa, atime: 0x6aa3f5aa, ctime: 0x6aa3f5aa, blocks: 0x1 00010000:00010000:1.0:1789130156.313718:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.313743:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=1319s v=(0 0) 00010000:00010000:1.0:1789130156.315926:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130156.315940:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.315966:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.315980:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.315989:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.316018:0:37658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1789130156.317023:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803903 committed batchid 25769803902 00000100:00100000:0.0:1789130156.317046:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626812032:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789130156.317205:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000100:00100000:0.0:1789130156.317220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130156.317248:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626812032 00000100:00100000:2.0:1789130156.317256:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626812032 00000100:00100000:2.0:1789130156.317302:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130156.317312:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626812032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130156.317457:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789130156.317461:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789130156.317463:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130156.317465:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 1789130155 -> 1789130155 00002000:00010000:2.0:1789130156.317467:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130156.317513:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626812032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (293us total) trans 30064771096 rc 0/0 00000100:00100000:2.0:1789130156.317529:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1789130156.317556:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384b14000/2, rc 0, transno 30064771096 00000100:00100000:0.0:1789130156.317565:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626812032:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789130156.317850:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130156.317859:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.317870:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130156.317874:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.317884:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.317903:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.317910:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002363ee97/0x5c74554e47ce9701 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.317931:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130156.317933:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130156.317935:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130156.320140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.321069:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899712 00000100:00100000:3.0:1789130156.321081:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899712 00000100:00100000:3.0:1789130156.321266:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130156.321281:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604899712:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789130156.321433:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604899712:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 148us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.321441:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130156.323470:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626811904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9859us (10010us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1789130156.323483:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1789130156.323689:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4c19670c0/2, rc 0, transno 30064771092 00000100:00100000:0.0:1789130156.323698:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c19670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626811904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789130156.335512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.335623:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604899968 00000100:00100000:3.0:1789130156.335634:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604899968 00000100:00100000:3.0:1789130156.335698:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:3.0:1789130156.335708:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:33905:x1876037604899968:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130156.335777:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130156.335814:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce96f3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcf6 expref: 13 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.335838:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130156.335844:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130156.335876:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.335889:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.335899:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130156.341111:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002c4a49a0 reply state 00000000630e6f03 transno 30064771250 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130156.341134:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130156.342455:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:33905:x1876037604899968:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 6736us (6942us total) trans 30064771250 rc 0/0 00000100:00100000:3.0:1789130156.342489:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00010000:00010000:1.0:1789130156.358098:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358123:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358131:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358155:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.358169:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358178:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358196:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:1.0:1789130156.358198:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130156.358203:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.358209:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9708 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.367075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.367152:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900096 00000100:00100000:0.0:1789130156.367173:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900096 00000100:00100000:0.0:1789130156.367243:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130156.367253:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:33905:x1876037604900096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130156.367277:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130156.367300:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd04 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.367348:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 9 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.367358:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130156.367363:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130156.367368:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.367406:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 9 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.367437:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 9 pid: 37275 timeout: 1419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130156.367452:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626812160:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130156.367567:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10240 going to sleep for 11 seconds 00000100:00100000:0.0:1789130156.372382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.372487:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900224 00000100:00100000:1.0:1789130156.372495:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900224 00000100:00100000:3.0:1789130156.372506:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626812160:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130156.372543:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 10 pid: 37275 timeout: 1419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.372544:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.372576:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:1.0:1789130156.372633:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130156.372644:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604900224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130156.372658:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789130156.372662:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:33905:x1876037604900096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5409us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.372671:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:1.0:1789130156.372684:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 10 pid: 37275 timeout: 1419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.372700:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 9 pid: 37275 timeout: 1419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.372738:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55fafd2/0x5c74554e47ce96fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcfd expref: 9 pid: 37275 timeout: 1419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.372752:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130156.372756:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130156.372763:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.372773:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.372807:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.372821:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492794000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626812288:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130156.372878:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130156.379062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.379226:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492794000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:36573:1876037626812288:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130156.379249:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130156.379314:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604900224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6670us (6941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.379325:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130156.379694:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900352 00000100:00100000:2.0:1789130156.379703:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900352 00000100:00100000:2.0:1789130156.379761:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130156.379773:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604900352:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130156.379982:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789130156.379985:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1789130155 00002000:00010000:2.0:1789130156.379988:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1789130154 00002000:00010000:2.0:1789130156.379990:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 1789130155 -> 1789130155 00002000:00010000:2.0:1789130156.379993:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130156.380024:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604900352:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 254us (974us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1789130156.380032:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130156.386671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.386811:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900480 00000100:00100000:1.0:1789130156.386822:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900480 00000100:00100000:1.0:1789130156.386925:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130156.386938:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2367:x1876037604900480:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789130156.386987:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.387026:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.387035:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130156.387039:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130156.387044:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.387081:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.387096:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 9 pid: 37275 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.387123:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626812416:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130156.387224:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130156.392659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.392893:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900608 00000100:00100000:2.0:1789130156.392902:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900608 00010000:00010000:2.0:1789130156.392944:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 10 pid: 37275 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.392946:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626812416:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130156.392977:0:37658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130156.393009:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789130156.393021:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604900608:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130156.393037:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130156.393062:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 10 pid: 37275 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.393076:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 10 pid: 37275 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.393131:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a2d0b3/0x5c74554e47ce970f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd04 expref: 10 pid: 37275 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.393149:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130156.393155:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130156.393169:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.393180:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.393207:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130156.393232:0:37658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393243:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130156.393273:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604900608:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 252us (622us total) trans 0 rc 0/0 00010000:00010000:1.0:1789130156.393276:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130156.393284:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00010000:00010000:1.0:1789130156.393293:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393302:0:37658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393310:0:37658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130156.393315:0:37658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393324:0:37658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393336:0:37658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.393344:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077708524/0x5c74554e47ce9716 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.393389:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604900480:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 6454us (6730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130156.393405:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130156.396253:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.396320:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900864 00000100:00100000:1.0:1789130156.396329:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900864 00000100:00100000:1.0:1789130156.396380:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:1.0:1789130156.396389:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:33905:x1876037604900864:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130156.396469:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.396486:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.396498:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.396762:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.396773:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.396781:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.397089:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.397105:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 14 pid: 36587 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.397139:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626812544:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130156.397248:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130156.402727:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626812544:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130156.402757:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130156.409664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.409751:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604900992 00000100:00100000:2.0:1789130156.409763:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604900992 00010000:00010000:2.0:1789130156.409810:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 15 pid: 36587 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130156.409850:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789130156.409861:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037604900992:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130156.409880:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130156.409887:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 15 pid: 36587 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.409926:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 15 pid: 36587 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.409953:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce96e5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abcef expref: 15 pid: 36587 timeout: 1419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.409971:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130156.409977:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.409988:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.409997:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130156.410021:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130156.410102:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604900992:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 231us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.410115:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00010000:00010000:1.0:1789130156.410127:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.410138:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130156.410344:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771251 00000001:00080000:1.0:1789130156.410498:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771252 00000001:00080000:1.0:1789130156.410549:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771253 00000100:00100000:1.0:1789130156.410712:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626812672:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789130156.410767:0:36589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130156.411008:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626812672 00000100:00100000:3.0:1789130156.411015:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626812672 00000100:00100000:3.0:1789130156.411061:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130156.411070:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36589:x1876037626812672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789130156.411143:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36589:x1876037626812672:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.411151:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130156.411244:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130156.411282:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626812672:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789130156.412486:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771254 00000100:00100000:1.0:1789130156.412571:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626812800:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789130156.416461:0:36589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130156.416561:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130156.418308:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626812800 00000100:00100000:3.0:1789130156.418321:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626812800 00000100:00100000:0.0:1789130156.418479:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130156.418491:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36589:x1876037626812800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789130156.419257:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:36589:x1876037626812800:12345-0@lo:1000:mdt00_002.0 Request processed in 766us (2801us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1789130156.419268:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130156.419372:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:36589:1876037626812800:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789130156.419419:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419443:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419450:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419456:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.419460:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419468:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419486:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:1.0:1789130156.419489:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130156.419495:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419500:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce9724 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419526:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419532:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419539:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419543:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.419553:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419559:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419567:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130156.419569:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130156.419577:0:36589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419588:0:36589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419597:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.419689:0:36589:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.419704:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626812928:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130156.419782:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130156.425665:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626812928:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130156.425715:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425726:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9659 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425779:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425804:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425816:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425827:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425832:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425838:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425844:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.425848:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425855:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425868:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130156.425871:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130156.425875:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425880:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce972b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425898:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425903:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425909:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425913:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.425915:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425920:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425927:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130156.425929:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130156.425932:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.425938:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce971d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.426220:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:33905:x1876037604900864:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 29830us (29973us total) trans 30064771255 rc 0/0 00000100:00100000:1.0:1789130156.426230:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000020:00080000:1.0:1789130156.426236:0:36589:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789130156.426520:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130156.426525:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130156.426579:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:3.0:1789130156.426584:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130156.431031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.431379:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604901120 00000100:00100000:2.0:1789130156.431389:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604901120 00000100:00100000:2.0:1789130156.431453:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789130156.431466:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a782b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:33904:x1876037604901120:12345-192.168.201.39@tcp:49:bash.0 00000100:00100000:2.0:1789130156.431643:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a782b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:33904:x1876037604901120:12345-192.168.201.39@tcp:49:bash.0 Request processed in 179us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.431651:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1789130156.436330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.436400:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604901376 00000100:00100000:1.0:1789130156.436411:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604901376 00000100:00100000:1.0:1789130156.436485:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789130156.436495:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:33905:x1876037604901376:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130156.437285:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130156.437390:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771256 00010000:00010000:1.0:1789130156.437436:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437453:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437464:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437472:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437479:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437485:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.437502:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130156.437635:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:33905:x1876037604901376:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1139us (1313us total) trans 30064771257 rc 0/0 00000100:00100000:1.0:1789130156.437645:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000020:00080000:1.0:1789130156.437650:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130156.442531:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130156.442547:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.442559:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130156.442563:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.442600:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.442643:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:0.0:1789130156.442647:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130156.442653:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.442659:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9732 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130156.442680:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130156.442682:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130156.442684:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130156.442992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.446581:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604901504 00000100:00100000:1.0:1789130156.446645:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604901504 00000100:00100000:1.0:1789130156.446732:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1789130156.446743:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:33904:x1876037604901504:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130156.446782:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130156.446805:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b424d23/0x5c74554e47ce9739 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd0b expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130156.446840:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 0, mtime: 0x6aa3f5ab, atime: 0x6aa3f5aa, ctime: 0x6aa3f5ab, blocks: 0x1 00010000:00010000:1.0:1789130156.446865:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=1319s v=(0 0) 00010000:00010000:1.0:1789130156.446870:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130156.446881:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b424d23/0x5c74554e47ce9739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd0b expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.446898:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b424d23/0x5c74554e47ce9739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd0b expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.446911:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363800, rc 0) 00000100:00100000:1.0:1789130156.446975:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:33904:x1876037604901504:12345-192.168.201.39@tcp:101:bash.0 Request processed in 234us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130156.446983:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:0.0:1789130156.454916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.455210:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604901760 00000100:00100000:1.0:1789130156.455220:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604901760 00000100:00100000:1.0:1789130156.455285:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130156.455295:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:33904:x1876037604901760:12345-192.168.201.39@tcp:35:bash.0 00000001:00080000:1.0:1789130156.455571:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771258 00000001:00080000:1.0:1789130156.455661:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771259 00000100:00100000:1.0:1789130156.455767:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:33904:x1876037604901760:12345-192.168.201.39@tcp:35:bash.0 Request processed in 472us (863us total) trans 30064771260 rc 0/0 00000100:00100000:1.0:1789130156.455775:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000020:00080000:1.0:1789130156.455792:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789130156.489032:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130156.583087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.583242:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604901888 00000100:00100000:3.0:1789130156.583255:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604901888 00000100:00100000:3.0:1789130156.583322:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789130156.583332:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604901888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130156.583412:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604901888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.583421:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:0.0:1789130156.586191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130156.586297:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902016 00000100:00100000:2.0:1789130156.586308:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902016 00000100:00100000:2.0:1789130156.586383:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:2.0:1789130156.586394:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604902016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130156.586481:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604902016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.586489:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00080000:0.0:1789130156.586779:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130156.598409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130156.598451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.598535:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902144 00000100:00100000:3.0:1789130156.598546:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902144 00000100:00100000:3.0:1789130156.598659:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902272 00000100:00100000:3.0:1789130156.598663:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902272 00000100:00100000:2.0:1789130156.598771:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:2.0:1789130156.598784:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604902144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130156.598872:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604902144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 91us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130156.598881:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789130156.599365:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1789130156.599373:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:33915:x1876037604902272:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130156.599390:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130156.599417:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd12 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.599481:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.599495:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.599507:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130156.599948:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789130156.599953:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130156.600032:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.600065:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd12 expref: 24 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.600083:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd12 expref: 23 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.600092:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130156.600095:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130156.600099:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87800, rc 0) 00000100:00080000:0.0:1789130156.600323:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130156.600390:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:33915:x1876037604902272:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1018us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130156.600398:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:0.0:1789130156.604153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.604568:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902400 00000100:00100000:1.0:1789130156.604579:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902400 00000100:00100000:1.0:1789130156.604683:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:1.0:1789130156.604694:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:33915:x1876037604902400:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130156.604780:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.604811:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.604839:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.604856:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.604864:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.604870:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605199:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605209:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605216:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130156.605258:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605279:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605286:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605293:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605301:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.605305:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605313:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605326:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130156.605329:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130156.605335:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605341:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce974e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605353:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605359:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605364:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605374:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.605377:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605383:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605392:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff90b4909bd000) 00010000:00010000:1.0:1789130156.605394:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130156.605396:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605403:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605418:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605425:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605430:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605434:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130156.605437:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605442:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605461:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130156.605464:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130156.605467:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130156.605472:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce975c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130156.605565:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:33915:x1876037604902400:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 872us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130156.605574:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:1.0:1789130156.716965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130156.717058:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902656 00000100:00100000:3.0:1789130156.717068:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902656 00000100:00100000:3.0:1789130156.717137:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1789130156.717148:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:33922:x1876037604902656:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789130156.717179:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130156.717203:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd19 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717274:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717307:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717319:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717337:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717343:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717349:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717705:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9778 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717715:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9778 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717722:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9778 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130156.717732:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 12 00010000:00010000:3.0:1789130156.717820:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717828:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717834:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717847:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130156.717851:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717859:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717871:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130156.717874:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130156.717879:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717885:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce976a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717903:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717908:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717914:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717918:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130156.717921:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717926:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717942:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff90b488939c00) 00010000:00010000:3.0:1789130156.717944:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130156.717947:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717952:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.717998:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd19 expref: 26 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.718011:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9778 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd19 expref: 25 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130156.718018:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130156.718021:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130156.718023:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87e00, rc 0) 00000100:00100000:3.0:1789130156.718092:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:33922:x1876037604902656:12345-192.168.201.39@tcp:101:cat.0 Request processed in 946us (1138us total) trans 30064771261 rc 0/0 00000100:00100000:3.0:1789130156.718099:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:0.0:1789130156.726152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130156.726254:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604902912 00000100:00100000:1.0:1789130156.726264:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604902912 00000100:00100000:1.0:1789130156.726321:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789130156.726332:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:33922:x1876037604902912:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:1.0:1789130156.726585:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:33922:x1876037604902912:12345-192.168.201.39@tcp:35:cat.0 Request processed in 254us (441us total) trans 30064771262 rc 0/0 00000100:00100000:1.0:1789130156.726592:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000001:00080000:1.0:1789130156.882132:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771098 is committed 00000001:00080000:1.0:1789130156.882163:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771097 is committed 00010000:00010000:0.0:1789130157.510900:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130158.535861:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130159.567270:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130160.096389:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771092 is committed 00000001:00080000:1.0:1789130160.096408:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771090 is committed 00000100:00100000:0.0:1789130160.390881:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130160.390906:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626813056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130160.391014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.395585:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626813184:0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.395677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.395725:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626813696:0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.395752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.395802:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130160.395807:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626813312:0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.395853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.395884:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626813568:0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.395911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.395927:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130160.395945:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626813440:0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.395980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130160.396001:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813696 00000100:00100000:2.0:1789130160.396007:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813696 00000100:00100000:2.0:1789130160.396073:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813568 00000100:00100000:2.0:1789130160.396077:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813568 00000100:00100000:2.0:1789130160.396108:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813440 00000100:00100000:2.0:1789130160.396111:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813440 00000100:00100000:2.0:1789130160.396133:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130160.396144:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626813696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130160.396175:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813184 00000100:00100000:1.0:1789130160.396179:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813184 00000100:00100000:2.0:1789130160.396199:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626813696:12345-0@lo:400:kworker.0 Request processed in 56us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130160.396206:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789130160.396207:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789130160.396213:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626813184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.396222:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130160.396228:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626813568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.396254:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626813568:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130160.396260:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130160.396272:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789130160.396277:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626813440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.396302:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626813440:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130160.396307:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789130160.396327:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130160.396335:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626813184:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130160.396343:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130160.396364:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626813440:0@lo:400:kworker.0 00000100:00100000:1.0:1789130160.396373:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813312 00000100:00100000:2.0:1789130160.396375:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626813568:0@lo:400:kworker.0 00000100:00100000:1.0:1789130160.396376:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813312 00000100:00100000:2.0:1789130160.396403:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626813184:0@lo:400:kworker.0 00000100:00100000:1.0:1789130160.396409:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130160.396416:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626813312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130160.396421:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626813696:0@lo:400:kworker.0 00000100:00100000:1.0:1789130160.396450:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626813312:12345-0@lo:400:kworker.0 Request processed in 35us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130160.396456:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130160.396479:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771098 gen 2 00000004:00080000:1.0:1789130160.396485:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384b14000, transno 30064771096 00000004:00080000:1.0:1789130160.396495:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771098 committed transno 30064771098 00000100:00100000:1.0:1789130160.396512:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626813312:0@lo:400:kworker.0 00000100:00080000:2.0:1789130160.396581:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130160.396628:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813056 00000100:00100000:2.0:1789130160.396634:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813056 00000100:00100000:2.0:1789130160.396665:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130160.396672:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626813056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130160.396702:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130160.396737:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626813056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (5723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130160.396743:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789130160.396759:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130160.397452:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:0.0:1789130160.397460:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771091 committed transno 30064771092 00000004:00080000:0.0:1789130160.397484:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4c19670c0, transno 30064771092 00000100:00100000:0.0:1789130160.397510:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626813056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130160.583920:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130161.414276:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130161.414299:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626813824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130161.414364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130161.414408:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813824 00000100:00100000:2.0:1789130161.414417:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813824 00000100:00100000:2.0:1789130161.414474:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130161.414484:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626813824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130161.414519:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130161.414574:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626813824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130161.414581:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130161.414735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626813824:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789130161.490404:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771262 is committed 00000020:00080000:1.0:1789130161.490434:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b48607dc00 refcount 2 committed 0 result 0 batchid 25769803904 00000020:00080000:1.0:1789130161.490439:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b48607d9c0 00000020:00080000:1.0:1789130161.490443:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b382d82000 00000020:00080000:2.0:1789130161.490480:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803904 committed batchid 25769803902 00000020:00080000:2.0:1789130161.490701:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000020:00080000:1.0:1789130161.490873:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803903 batchid updated 00010000:00010000:0.0:1789130161.606004:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130161.696669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130161.696849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130161.696920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130161.696941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130161.696964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130161.697029:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903296 00000100:00100000:3.0:1789130161.697039:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903296 00000100:00100000:3.0:1789130161.697114:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903424 00000100:00100000:3.0:1789130161.697117:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903424 00000100:00100000:3.0:1789130161.697143:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130161.697153:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604903296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130161.697251:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604903296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 98us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130161.697274:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130161.697292:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:3.0:1789130161.697299:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604903424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130161.697326:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2369:x1876037604903424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130161.697332:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1789130161.697637:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903040 00000100:00100000:2.0:1789130161.697642:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903040 00000100:00100000:2.0:1789130161.697779:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:2.0:1789130161.697789:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604903040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130161.697835:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604903040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 47us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130161.697842:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:2.0:1789130161.697871:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903552 00000100:00100000:2.0:1789130161.697875:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903552 00000100:00100000:2.0:1789130161.697901:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903168 00000100:00100000:2.0:1789130161.697904:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903168 00000100:00100000:2.0:1789130161.697924:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130161.697931:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604903552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130161.697959:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604903552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130161.697967:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130161.697978:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1789130161.697985:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604903168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130161.698082:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604903168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 96us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130161.698089:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00080000:0.0:1789130161.698302:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130161.698308:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130161.698310:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130162.633897:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130163.438515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130163.438672:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903680 00000100:00100000:2.0:1789130163.438682:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903680 00000100:00100000:2.0:1789130163.438828:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:2.0:1789130163.438840:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:33861:x1876037604903680:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789130163.438958:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:33861:x1876037604903680:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 120us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130163.438967:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00080000:0.0:1789130163.445833:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130163.448125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130163.448290:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604903936 00000100:00100000:0.0:1789130163.448301:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604903936 00000100:00100000:0.0:1789130163.448502:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130163.448514:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:33861:x1876037604903936:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130163.449131:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:33861:x1876037604903936:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 617us (1013us total) trans 30064771263 rc 0/0 00000100:00100000:0.0:1789130163.449141:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00010000:00010000:0.0:1789130163.655000:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130163.871726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130163.871828:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904064 00000100:00100000:2.0:1789130163.871838:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904064 00000100:00100000:2.0:1789130163.871941:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:2.0:1789130163.871952:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:34363:x1876037604904064:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1789130163.871978:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130163.872015:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce9786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd20 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872110:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872129:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872146:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130163.872206:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789130163.872467:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789130163.872473:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130163.872575:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872637:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce9786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 7 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872658:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 6 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130163.872667:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:2.0:1789130163.872670:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130163.872682:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:2.0:1789130163.872780:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:34363:x1876037604904064:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 829us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130163.872788:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00010000:00010000:0.0:1789130164.677842:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130165.510506:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130165.510596:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626813952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130165.510727:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626814208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130165.510746:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626814336:0@lo:400:kworker.0 00000100:00100000:0.0:1789130165.510763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130165.510807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130165.510818:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626814720:0@lo:400:kworker.0 00000100:00100000:1.0:1789130165.510852:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814208 00000100:00100000:0.0:1789130165.510855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130165.510860:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814208 00000100:00100000:0.0:1789130165.510883:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814720 00000100:00100000:0.0:1789130165.510887:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814720 00000100:00100000:1.0:1789130165.510913:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814336 00000100:00100000:1.0:1789130165.510917:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814336 00000100:00100000:0.0:1789130165.510917:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789130165.510925:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626814720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130165.510937:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789130165.510943:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626814208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130165.510974:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626814720:12345-0@lo:400:kworker.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130165.510982:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130165.511010:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626814464:0@lo:400:kworker.0 00000100:00100000:2.0:1789130165.511039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130165.511051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130165.511058:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789130165.511064:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626814080:0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511082:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130165.511089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130165.511090:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626814336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130165.511109:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626814592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511124:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626814336:12345-0@lo:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130165.511129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130165.511131:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130165.511151:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814080 00000100:00100000:2.0:1789130165.511154:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814080 00000100:00100000:3.0:1789130165.511169:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814464 00000100:00100000:3.0:1789130165.511172:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814464 00000100:00100000:2.0:1789130165.511180:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789130165.511187:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626814080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511208:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814592 00000100:00100000:3.0:1789130165.511211:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814592 00000100:00100000:2.0:1789130165.511219:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626814080:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130165.511225:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789130165.511231:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130165.511236:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626814464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130165.511269:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626814080:0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511271:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626814464:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130165.511277:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130165.511282:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626814464:0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511289:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130165.511295:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626814592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130165.511327:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626814336:0@lo:400:kworker.0 00000100:00100000:3.0:1789130165.511334:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626814592:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130165.511340:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789130165.511354:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626814592:0@lo:400:kworker.0 00000100:00080000:3.0:1789130165.511363:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130165.511368:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130165.511370:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130165.511380:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626813952 00000100:00100000:2.0:1789130165.511383:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626813952 00000100:00100000:2.0:1789130165.511425:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130165.511432:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626813952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130165.511460:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130165.511495:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626813952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130165.511501:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130165.511581:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626813952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130165.513335:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626814208:12345-0@lo:400:kworker.0 Request processed in 2385us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130165.513342:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626814208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130165.513347:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130165.513354:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626814720:0@lo:400:kworker.0 00010000:00010000:0.0:1789130165.701863:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130166.545236:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626814848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130166.545393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130166.570167:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814848 00000100:00100000:3.0:1789130166.570195:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814848 00000100:00100000:3.0:1789130166.570288:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130166.570313:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626814848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130166.570376:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130166.570530:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626814848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (25148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130166.570548:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130166.570750:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626814848:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789130166.645170:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771263 is committed 00000020:00080000:3.0:1789130166.645192:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803904 batchid updated 00000020:00080000:0.0:1789130166.645307:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000020:00080000:0.0:1789130166.645324:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000040:00080000:1.0:1789130166.662255:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130166.662265:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130166.662307:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:1.0:1789130166.662317:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789130166.727431:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130166.809876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130166.809936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130166.809984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130166.810022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130166.810066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130166.810095:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904704 00000100:00100000:0.0:1789130166.810105:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904704 00000100:00100000:0.0:1789130166.810172:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904320 00000100:00100000:0.0:1789130166.810176:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904320 00000100:00100000:0.0:1789130166.810206:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1789130166.810217:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604904704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130166.810379:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130166.810391:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604904320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130166.810464:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904448 00000100:00100000:2.0:1789130166.810469:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904448 00000100:00100000:2.0:1789130166.810500:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904576 00000100:00100000:2.0:1789130166.810503:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904576 00000100:00100000:2.0:1789130166.810524:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789130166.810531:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604904448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130166.810645:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904192 00000100:00100000:3.0:1789130166.810650:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904192 00000100:00100000:3.0:1789130166.810683:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:3.0:1789130166.810690:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604904192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130166.810880:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604904704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 663us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130166.810899:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:1.0:1789130166.815876:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604904320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 5469us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130166.815895:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00080000:1.0:1789130166.821171:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130166.821182:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130166.821186:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130166.821216:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789130166.821241:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604904576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130166.821350:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604904576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 121us (11282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130166.821358:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130166.821854:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604904448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 11321us (11927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130166.821864:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130166.823804:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604904192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 13101us (13927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130166.823820:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00010000:00010000:0.0:1789130167.749950:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130168.774266:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789130169.182223:0:39556:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 08:36:07 (1789130167) 00010000:00010000:0.0:1789130169.797825:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130170.629990:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626815104:0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.629992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626814976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130170.630026:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626815360:0@lo:400:kworker.0 00000100:00100000:0.0:1789130170.630087:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.631638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130170.631728:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626815488:0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.631772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130170.631848:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626814976 00000100:00100000:1.0:1789130170.631858:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626814976 00000100:00100000:1.0:1789130170.631935:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789130170.631945:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626814976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130170.631987:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789130170.632035:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626814976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130170.632043:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789130170.632065:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130170.632101:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626814976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130170.632139:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815488 00000100:00100000:1.0:1789130170.632143:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815488 00000100:00100000:1.0:1789130170.632174:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789130170.632181:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626815488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.632217:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626815488:12345-0@lo:400:kworker.0 Request processed in 37us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130170.632240:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789130170.632265:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626815488:0@lo:400:kworker.0 00000100:00100000:2.0:1789130170.647241:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130170.647488:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815360 00000100:00100000:1.0:1789130170.647500:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815360 00000100:00100000:1.0:1789130170.647884:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789130170.647897:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626815360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.647983:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626815360:12345-0@lo:400:kworker.0 Request processed in 90us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130170.647990:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130170.648865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130170.655348:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815232 00000100:00100000:2.0:1789130170.655365:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815232 00000100:00100000:0.0:1789130170.655413:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626815744:0@lo:400:kworker.0 00000100:00100000:2.0:1789130170.655455:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130170.655467:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626815232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130170.655486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130170.655525:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815744 00000100:00100000:0.0:1789130170.655530:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815744 00000100:00100000:2.0:1789130170.655536:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626815232:12345-0@lo:400:kworker.0 Request processed in 71us (6672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130170.655546:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789130170.655570:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789130170.655581:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626815744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130170.655636:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626815360:0@lo:400:kworker.0 00000100:00100000:0.0:1789130170.655656:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626815744:12345-0@lo:400:kworker.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130170.655664:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789130170.655702:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130170.655722:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130170.657021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130170.657090:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626815616:0@lo:400:kworker.0 00000100:00100000:3.0:1789130170.657144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130170.657217:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815616 00000100:00100000:1.0:1789130170.657226:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815616 00000100:00100000:0.0:1789130170.657273:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626815744:0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.657297:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789130170.657307:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626815616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130170.657315:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789130170.657369:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626815616:12345-0@lo:400:kworker.0 Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130170.657380:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130170.657387:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626815616:0@lo:400:kworker.0 00000100:00080000:3.0:1789130170.657450:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130170.660080:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626815104 00000100:00100000:2.0:1789130170.660096:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626815104 00000100:00100000:2.0:1789130170.660162:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130170.660174:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626815104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130170.660280:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626815104:12345-0@lo:400:kworker.0 Request processed in 107us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130170.660288:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789130170.664215:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626815104:0@lo:400:kworker.0 00010000:00010000:0.0:1789130170.822093:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130170.922097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130170.922248:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604904960 00000100:00100000:0.0:1789130170.922261:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604904960 00000100:00100000:0.0:1789130170.922365:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:0.0:1789130170.922376:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:34621:x1876037604904960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130170.922421:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130170.922452:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd27 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922780:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922870:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922889:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922917:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922925:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.922933:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.923432:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce97a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.923443:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.923452:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130170.923464:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:3.0:1789130170.923824:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130170.924877:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924892:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924916:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924924:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130170.924930:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924939:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924959:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130170.924963:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130170.924970:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924977:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce979b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.924994:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925000:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925006:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925025:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130170.925028:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925035:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925044:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130170.925046:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130170.925049:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925055:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce97a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925952:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd27 expref: 16 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925975:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce97a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd27 expref: 15 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130170.925984:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130170.925987:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130170.925989:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd400, rc 0) 00000100:00100000:0.0:1789130170.926092:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:34621:x1876037604904960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3717us (4010us total) trans 30064771264 rc 0/0 00000100:00100000:0.0:1789130170.926102:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:0.0:1789130170.938054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130170.938138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130170.938255:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905088 00000100:00100000:1.0:1789130170.938268:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905088 00000100:00100000:1.0:1789130170.938360:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130170.938375:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604905088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130170.938405:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130170.938444:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce97a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd27 expref: 15 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130170.938471:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130170.938486:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130170.938566:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2367:x1876037604905088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 195us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130170.938576:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130170.938795:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905216 00000100:00100000:2.0:1789130170.938800:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905216 00000100:00100000:2.0:1789130170.938847:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1789130170.938855:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:34621:x1876037604905216:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130170.938957:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:34621:x1876037604905216:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 103us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130170.938964:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1789130171.066412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130171.066594:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905472 00000100:00100000:1.0:1789130171.066712:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905472 00000100:00100000:1.0:1789130171.067164:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:1.0:1789130171.067180:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:34636:x1876037604905472:12345-192.168.201.39@tcp:101:touch.0 00010000:00010000:1.0:1789130171.067213:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130171.067217:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130171.067255:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd12 expref: 14 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.067284:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130171.067291:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130171.067309:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd2e expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.067933:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.067955:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.067965:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.068009:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.068041:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 5 pid: 36587 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.068059:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626815872:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130171.068193:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130171.076242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.076435:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905600 00000100:00100000:2.0:1789130171.076445:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905600 00010000:00010000:2.0:1789130171.076498:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 6 pid: 36587 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.076531:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1789130171.076542:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604905600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130171.076556:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130171.076563:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 6 pid: 36587 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.076596:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 6 pid: 36587 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.076647:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:2.0:1789130171.076652:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.076661:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.076668:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.076686:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130171.076737:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604905600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 198us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.076745:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00080000:3.0:1789130171.077153:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130171.078996:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce978d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd20 expref: 5 pid: 36587 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.079021:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626815872:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130171.079046:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.079056:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.079061:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.079123:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.079137:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.079147:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130171.080993:0:38723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc6:0x0], index 1: 0 00010000:00010000:1.0:1789130171.081472:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce97cc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081490:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce97cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081502:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce97cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081546:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081553:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081559:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081564:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130171.081569:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081577:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.081589:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130171.081592:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130171.081598:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.082494:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce97be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130171.082529:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ee733bd4 reply state 000000000bd52377 transno 30064771265 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.082539:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130171.082594:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd2e expref: 16 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.083428:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce97cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd2e expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.083441:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:1.0:1789130171.083443:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130171.083448:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:1.0:1789130171.083620:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+16:34636:x1876037604905472:12345-192.168.201.39@tcp:101:touch.0 Request processed in 16423us (17197us total) trans 30064771265 rc 0/0 00000100:00100000:1.0:1789130171.083716:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:0.0:1789130171.100240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130171.100478:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100493:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100502:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100508:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130171.100513:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100544:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100564:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b4909bd000) 00010000:00010000:1.0:1789130171.100567:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130171.100572:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.100579:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce97c5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.103246:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905856 00000100:00100000:2.0:1789130171.103266:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905856 00000100:00100000:2.0:1789130171.103355:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:2.0:1789130171.103367:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:34636:x1876037604905856:12345-192.168.201.39@tcp:36:touch.0 00010000:00010000:2.0:1789130171.103442:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130171.103471:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce97cc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd2e expref: 15 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.103492:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:2.0:1789130171.103503:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130171.103561:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.103574:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.103583:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130171.103763:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000057be6d02 reply state 0000000091a9eb8e transno 30064771266 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.103773:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130171.113425:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:34636:x1876037604905856:12345-192.168.201.39@tcp:36:touch.0 Request processed in 10048us (13184us total) trans 30064771266 rc 0/0 00000100:00100000:0.0:1789130171.113438:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00010000:00010000:1.0:1789130171.115595:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115650:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115658:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115665:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130171.115670:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115677:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115694:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:1.0:1789130171.115697:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130171.115702:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.115726:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce97da lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130171.118504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130171.118934:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604905984 00000100:00100000:1.0:1789130171.118946:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604905984 00000100:00100000:1.0:1789130171.119002:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:1.0:1789130171.119014:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:34636:x1876037604905984:12345-192.168.201.39@tcp:101:touch.0 00010000:00010000:1.0:1789130171.119043:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130171.119067:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd35 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.119126:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.119139:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.119157:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130171.119160:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130171.119164:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:1.0:1789130171.119226:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:34636:x1876037604905984:12345-192.168.201.39@tcp:101:touch.0 Request processed in 214us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130171.119233:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:2.0:1789130171.126748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.127558:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604906112 00000100:00100000:3.0:1789130171.127571:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604906112 00000100:00100000:3.0:1789130171.127686:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130171.127696:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2370:x1876037604906112:12345-192.168.201.39@tcp:2:touch.0 00000100:00100000:3.0:1789130171.128079:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604906112:12345-192.168.201.39@tcp:2:touch.0 Request processed in 383us (1339us total) trans 30064771093 rc 0/0 00000100:00100000:3.0:1789130171.128087:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00080000:0.0:1789130171.128746:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130171.131267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130171.131358:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604906368 00000100:00100000:0.0:1789130171.131368:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604906368 00000100:00100000:0.0:1789130171.131428:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130171.131438:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:34636:x1876037604906368:12345-192.168.201.39@tcp:35:touch.0 00000100:00100000:0.0:1789130171.131873:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:34636:x1876037604906368:12345-192.168.201.39@tcp:35:touch.0 Request processed in 435us (614us total) trans 30064771267 rc 0/0 00000100:00100000:0.0:1789130171.131881:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789130171.220243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.220444:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604906496 00000100:00100000:3.0:1789130171.220459:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604906496 00000100:00100000:3.0:1789130171.220554:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1789130171.220568:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:34642:x1876037604906496:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130171.220647:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130171.220681:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce97e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd3c expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.220769:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.220798:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.220814:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130171.220942:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789130171.220947:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130171.220978:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.221013:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce97e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd3c expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.221035:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd3c expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.221046:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939c00) 00010000:00010000:3.0:1789130171.221050:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130171.221055:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86a00, rc 0) 00000100:00100000:3.0:1789130171.221999:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:34642:x1876037604906496:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1427us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.222010:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:0.0:1789130171.245229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.249668:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604906624 00000100:00100000:2.0:1789130171.249693:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604906624 00000100:00100000:2.0:1789130171.249789:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:2.0:1789130171.249808:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+18:34642:x1876037604906624:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130171.249843:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130171.258028:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce97f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd43 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258151:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258170:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258185:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258234:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258242:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258250:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258392:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258402:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258409:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130171.258451:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1789130171.258457:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130171.258480:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258494:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258503:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258511:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258534:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258541:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130171.258546:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258554:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258569:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130171.258573:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130171.258579:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258586:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce97fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258649:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258656:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258663:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258668:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130171.258671:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258689:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258699:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b48a1fd800) 00010000:00010000:2.0:1789130171.258701:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130171.258704:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258710:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9804 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258756:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47ce97f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 20 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258773:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 19 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.258781:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:2.0:1789130171.258783:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130171.258786:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130171.258891:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:34642:x1876037604906624:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 9090us (13675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.258921:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:3.0:1789130171.263375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.264364:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604906752 00000100:00100000:2.0:1789130171.264394:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604906752 00000100:00100000:2.0:1789130171.264545:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130171.264559:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604906752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130171.264628:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130171.264665:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd4a expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130171.264704:0:38727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6aa3f5ba, atime: 0x6aa3f5ba, ctime: 0x6aa3f5ba, blocks: 0x1 00010000:00010000:2.0:1789130171.264732:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:2.0:1789130171.264738:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130171.264750:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 7 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.264772:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 7 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.264791:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130171.264893:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604906752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 337us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.264912:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789130171.270892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130171.270960:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907008 00000100:00100000:0.0:1789130171.270973:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907008 00000100:00100000:0.0:1789130171.271041:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1789130171.271053:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:34642:x1876037604907008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130171.271083:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130171.271112:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd51 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.271250:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9820 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.271290:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9820 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.271305:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9820 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130171.271320:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1789130171.271659:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce9819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd51 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.271684:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9820 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd51 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.271694:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130171.271697:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130171.271701:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:0.0:1789130171.271773:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+21:34642:x1876037604907008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 722us (897us total) trans 30064771268 rc 0/0 00000100:00100000:0.0:1789130171.271782:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1789130171.279800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130171.279855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130171.279977:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907264 00000100:00100000:1.0:1789130171.279991:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907264 00000100:00100000:1.0:1789130171.280086:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:1.0:1789130171.280119:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:34642:x1876037604907264:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130171.280155:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130171.280182:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce982e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd58 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.280313:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.280334:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.280348:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130171.280363:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:1.0:1789130171.280525:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce982e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd58 expref: 24 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.280548:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd58 expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.280559:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130171.280562:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130171.280567:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:1.0:1789130171.280679:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:34642:x1876037604907264:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 562us (895us total) trans 30064771269 rc 0/0 00000100:00100000:1.0:1789130171.280688:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:3.0:1789130171.281910:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907392 00000100:00100000:3.0:1789130171.281926:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907392 00000100:00100000:3.0:1789130171.282009:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789130171.282020:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604907392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130171.282041:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130171.282080:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9820 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd51 expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.282101:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130171.282122:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130171.282195:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+22:2369:x1876037604907392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 176us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.282205:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130171.298141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.298330:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907520 00000100:00100000:3.0:1789130171.298351:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907520 00002000:00100000:3.0:1789130171.298440:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (0->4095) req@ffff90b3839e2580 x1876037604907520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:642/0 lens 488/0 e 0 to 0 dl 1789130182 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130171.298455:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e2580 with x1876037604907520 ext(0->4095) 00002000:00010000:3.0:1789130171.298463:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839e2580 00000100:00100000:3.0:1789130171.298510:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130171.298593:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604907520:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130171.306399:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604907520:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 7865us (8259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.306416:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00002000:00100000:3.0:1789130171.306430:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (0->4095) req@ffff90b3839e2580 x1876037604907520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:642/0 lens 488/440 e 0 to 0 dl 1789130182 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130171.306442:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e2580 with x1876037604907520 ext(0->4095) 00002000:00010000:3.0:1789130171.306452:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839e2580 00000100:00100000:0.0:1789130171.322790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130171.323025:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907648 00000100:00100000:1.0:1789130171.323037:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907648 00000100:00100000:1.0:1789130171.323112:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:1.0:1789130171.323123:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604907648:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789130171.323169:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.323191:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 7 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.323200:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130171.323205:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130171.323210:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.323249:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 7 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.323265:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 7 pid: 38727 timeout: 1434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.323280:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492794000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626816000:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130171.323370:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130171.330465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.330593:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492794000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626816000:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130171.330661:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130171.330734:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604907776 00000100:00100000:3.0:1789130171.330750:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604907776 00010000:00010000:3.0:1789130171.330789:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 8 pid: 38727 timeout: 1434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130171.330821:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789130171.330831:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604907776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130171.330859:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130171.330884:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 8 pid: 38727 timeout: 1434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.330907:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 8 pid: 38727 timeout: 1434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.330936:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9812 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd4a expref: 8 pid: 38727 timeout: 1434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.330955:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130171.330960:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130171.330966:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.330977:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.331010:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130171.331065:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604907776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 235us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.331073:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:2.0:1789130171.331191:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331200:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331232:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331240:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331248:0:37275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331254:0:37275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130171.331258:0:37275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331266:0:37275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331277:0:37275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.331283:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce9843 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.331331:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604907648:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 8210us (8552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.331339:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130171.334209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130171.334299:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908032 00000100:00100000:0.0:1789130171.334311:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908032 00000100:00100000:0.0:1789130171.334372:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789130171.334391:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a782a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:34642:x1876037604908032:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789130171.334480:0:36591:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x16:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd58 expref: 22 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130171.339762:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771270 00000001:00080000:1.0:1789130171.339863:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771271 00000001:00080000:1.0:1789130171.340418:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771272 00010000:00010000:1.0:1789130171.340482:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.340527:0:36591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 26 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.340538:0:36591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.340547:0:36591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.340589:0:36591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.340628:0:36591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 26 pid: 36588 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.340642:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626816128:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130171.341132:0:36591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 26 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.341145:0:36591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 26 pid: 38734 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.341155:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626816256:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130171.341184:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130171.346683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130171.346789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.346961:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908288 00000100:00100000:3.0:1789130171.346971:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908288 00010000:00010000:3.0:1789130171.347015:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 27 pid: 38734 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130171.347067:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908160 00000100:00100000:3.0:1789130171.347070:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908160 00010000:00010000:3.0:1789130171.347087:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 28 pid: 36588 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130171.347109:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130171.347119:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:2370:x1876037604908288:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130171.347195:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130171.347203:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 28 pid: 38734 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347215:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 28 pid: 38734 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347238:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130171.347243:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347251:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347257:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130171.347310:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:2370:x1876037604908288:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.347319:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130171.347337:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:3.0:1789130171.347351:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:2370:x1876037604908160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130171.347360:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130171.347366:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 27 pid: 36588 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347376:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 27 pid: 36588 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347387:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:3.0:1789130171.347391:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347397:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347404:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.347422:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130171.347442:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:2370:x1876037604908160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 93us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.347448:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00010000:00010000:2.0:1789130171.348046:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce980b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd43 expref: 26 pid: 36588 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.348066:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492797840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626816128:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130171.348082:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce97e1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd35 expref: 25 pid: 38734 timeout: 1434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.348092:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626816256:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130171.348118:0:36591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.348128:0:36591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.348133:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130171.348275:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771273 00000001:00080000:2.0:1789130171.348480:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771274 00000100:00100000:2.0:1789130171.350001:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626816384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130171.350074:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130171.350352:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789130171.356796:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626816384 00000100:00100000:3.0:1789130171.356812:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626816384 00000100:00100000:3.0:1789130171.356936:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130171.356946:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626816384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130171.357121:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626816384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 177us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.357143:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789130171.363035:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626816384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130171.363594:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771275 00000100:00100000:1.0:1789130171.364877:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626816512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130171.364962:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130171.376822:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130171.378300:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626816512 00000100:00100000:2.0:1789130171.378315:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626816512 00000100:00100000:2.0:1789130171.378375:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130171.378383:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626816512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130171.378823:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36591:x1876037626816512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 439us (13860us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1789130171.378844:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789130171.379261:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626816512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130171.379340:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771276 00010000:00010000:1.0:1789130171.379387:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379398:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379405:0:36591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379411:0:36591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130171.379415:0:36591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379423:0:36591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379437:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130171.379440:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789130171.379444:0:36591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130171.379450:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce984a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130171.382314:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789130171.382446:0:36591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].8, 64 off8752 00000004:00080000:1.0:1789130171.382459:0:36591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1334479856518ns, next at 1335479853173ns, rc = 0 00000001:00080000:1.0:1789130171.382468:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771277 00010000:00010000:1.0:1789130171.382531:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130171.382535:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130171.382547:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9835 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd58 expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130171.382845:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a782a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:34642:x1876037604908032:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 48463us (48645us total) trans 30064771278 rc 0/0 00000100:00100000:1.0:1789130171.382855:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000020:00080000:1.0:1789130171.382861:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789130171.388069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.388238:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908416 00000100:00100000:2.0:1789130171.388248:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908416 00000100:00100000:2.0:1789130171.388311:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1789130171.388322:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+28:34642:x1876037604908416:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130171.388350:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130171.388378:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9851 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd5f expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.388445:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9851 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd5f expref: 29 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.388460:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9851 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd5f expref: 29 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.388479:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130171.388482:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130171.388486:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:2.0:1789130171.388588:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:34642:x1876037604908416:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 267us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.388596:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1789130171.413977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.415973:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908672 00000100:00100000:3.0:1789130171.415989:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908672 00000100:00100000:3.0:1789130171.416064:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1789130171.416075:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:34642:x1876037604908672:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130171.416353:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:34642:x1876037604908672:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 278us (2387us total) trans 30064771279 rc 0/0 00000100:00100000:3.0:1789130171.416361:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789130171.558363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.559999:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604908800 00000100:00100000:3.0:1789130171.560021:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604908800 00000100:00100000:3.0:1789130171.560127:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:3.0:1789130171.560140:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:34652:x1876037604908800:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130171.560264:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560286:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560300:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560317:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560324:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560331:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560488:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560497:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560504:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130171.560560:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560575:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560582:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560589:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560597:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130171.560638:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560649:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560662:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939c00) 00010000:00010000:3.0:1789130171.560666:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130171.560672:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560690:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560708:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560714:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560720:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560725:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130171.560728:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560735:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560743:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b488939600) 00010000:00010000:3.0:1789130171.560746:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130171.560749:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560755:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce985f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560772:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560779:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560805:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560811:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130171.560814:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560822:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560830:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:3.0:1789130171.560833:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130171.560836:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.560842:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9866 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130171.562646:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:34652:x1876037604908800:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2466us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.562665:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:0.0:1789130171.654565:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626816640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130171.654696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130171.656090:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626816640 00000100:00100000:3.0:1789130171.656105:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626816640 00000100:00100000:3.0:1789130171.656175:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130171.656186:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626816640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130171.656238:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130171.656335:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626816640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.656343:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130171.658935:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626816640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130171.681010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130171.682004:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909056 00000100:00100000:0.0:1789130171.682024:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909056 00000100:00100000:0.0:1789130171.682117:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:0.0:1789130171.682131:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:34658:x1876037604909056:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130171.682160:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130171.682165:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130171.682206:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce97ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd3c expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682234:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130171.682251:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130171.682277:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce986d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd66 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682836:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682853:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682879:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682911:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682918:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.682926:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683171:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9882 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683183:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9882 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683192:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9882 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130171.683204:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1789130171.683431:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683441:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683448:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683455:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdc200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130171.683468:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683477:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683492:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130171.683496:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130171.683500:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683507:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47ce9874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683525:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683533:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683541:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683547:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130171.683550:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683557:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683565:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b4a2a08400) 00010000:00010000:0.0:1789130171.683567:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130171.683578:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683585:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47ce987b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683700:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47ce986d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd66 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683726:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9882 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd66 expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.683734:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130171.683738:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130171.683740:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbddc00, rc 0) 00000100:00100000:0.0:1789130171.683832:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:34658:x1876037604909056:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1704us (2840us total) trans 30064771280 rc 0/0 00000100:00100000:0.0:1789130171.683843:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:2.0:1789130171.700284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.700341:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909312 00000100:00100000:2.0:1789130171.700350:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909312 00000100:00100000:2.0:1789130171.700408:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:2.0:1789130171.700429:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:34658:x1876037604909312:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:2.0:1789130171.700523:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130171.700550:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47ce9882 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd66 expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.700570:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130171.700575:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130171.700824:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.700851:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130171.700862:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130171.700921:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771281 00000004:00010000:2.0:1789130171.700944:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002638e1d9 reply state 0000000083c4b658 transno 30064771282 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130171.700953:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130171.701057:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:34658:x1876037604909312:12345-192.168.201.39@tcp:36:dd.0 Request processed in 637us (792us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1789130171.701065:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000020:00080000:2.0:1789130171.701070:0:36589:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130171.714487:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714504:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714513:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714520:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130171.714526:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714553:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714571:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130171.714574:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130171.714580:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.714587:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9890 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130171.782050:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130171.782060:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130171.782118:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:2.0:1789130171.782124:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000001:00080000:3.0:1789130171.809689:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771270 is committed 00000001:00080000:3.0:1789130171.812868:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771278 is committed 00000004:00080000:3.0:1789130171.812884:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789130171.812919:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4c1911e40 refcount 2 committed 0 result 0 batchid 25769803905 00000020:00080000:3.0:1789130171.812924:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610ae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4c1911180 00000020:00080000:3.0:1789130171.812928:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b482b4fc00 00000001:00080000:3.0:1789130171.812978:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771279 is committed 00000020:00080000:3.0:1789130171.812995:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803905 committed batchid 25769803904 00000020:00080000:3.0:1789130171.813183:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:0.0:1789130171.813370:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130171.813392:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626816768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789130171.813474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130171.814876:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626816768 00000100:00100000:3.0:1789130171.814896:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626816768 00000100:00100000:3.0:1789130171.814957:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130171.814977:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626816768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789130171.815011:0:37276:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:198 count 1 00002000:00010000:3.0:1789130171.815050:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6aa3f5ba, atime: 0x6aa3f5ba, ctime: 0x6aa3f5ba, blocks: 0x1 00010000:00010000:3.0:1789130171.815058:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.815076:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:3.0:1789130171.815081:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130171.815087:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.815103:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.815114:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.815765:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130171.815782:0:37276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130171.816989:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626816768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2020us (3511us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1789130171.817001:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000004:00080000:1.0:1789130171.817186:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3839b5e00/2, rc 0, transno 30064771095 00000100:00100000:1.0:1789130171.817194:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626816768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789130171.818129:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130171.818141:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.818154:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130171.818159:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.818171:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.818193:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.818223:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a764d0/0x5c74554e47ce9897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130171.818247:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130171.818249:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130171.818251:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130171.847238:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130171.942952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.943009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.943069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130171.943151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130171.943327:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909440 00000100:00100000:3.0:1789130171.943344:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909440 00000100:00100000:3.0:1789130171.943401:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:3.0:1789130171.943411:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604909440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130171.943488:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604909440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.943497:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:3.0:1789130171.943527:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909824 00000100:00100000:3.0:1789130171.943531:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909824 00000100:00100000:3.0:1789130171.943560:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789130171.943566:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604909824:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130171.943595:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604909824:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130171.943642:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:0.0:1789130171.951021:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909696 00000100:00100000:0.0:1789130171.951039:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909696 00000100:00100000:0.0:1789130171.951111:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604909568 00000100:00100000:0.0:1789130171.951115:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604909568 00000100:00100000:0.0:1789130171.951183:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130171.951194:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604909696:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130171.951485:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130171.951495:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604909568:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130171.951538:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604909568:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (8468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130171.951546:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00080000:3.0:1789130171.952113:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130171.952371:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604909696:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1177us (9359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130171.952380:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789130172.864093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130172.864194:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910080 00000100:00100000:1.0:1789130172.864204:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910080 00000100:00100000:1.0:1789130172.864303:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789130172.864316:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+16:34658:x1876037604910080:12345-192.168.201.39@tcp:103:dd.0 00010000:00010000:1.0:1789130172.864332:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130172.864369:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9851 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd5f expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.864390:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130172.864417:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130172.864485:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:34658:x1876037604910080:12345-192.168.201.39@tcp:103:dd.0 Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130172.864493:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00080000:3.0:1789130172.866227:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130172.871284:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130172.879844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130172.880089:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910208 00000100:00100000:0.0:1789130172.880100:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910208 00000100:00100000:0.0:1789130172.880174:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:0.0:1789130172.880184:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:34658:x1876037604910208:12345-192.168.201.39@tcp:58:dd.0 00010000:00010000:0.0:1789130172.880496:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130172.880514:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130172.880546:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130172.880906:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].7, 136 off9144 00000100:00100000:0.0:1789130172.881045:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:34658:x1876037604910208:12345-192.168.201.39@tcp:58:dd.0 Request processed in 860us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130172.881054:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:2.0:1789130172.895765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130172.895919:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910336 00000100:00100000:1.0:1789130172.895930:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910336 00000100:00100000:1.0:1789130172.895998:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:1.0:1789130172.896008:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:34658:x1876037604910336:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130172.896035:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130172.896059:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd6d expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896117:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896128:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 16 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896147:0:36587:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896229:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 16 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896244:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130172.896255:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130172.896260:0:36587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 16 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130172.896287:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362600, rc 0) 00000100:00100000:1.0:1789130172.896585:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:34658:x1876037604910336:12345-192.168.201.39@tcp:101:dd.0 Request processed in 577us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130172.896593:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00000040:00080000:2.0:1789130173.830323:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130173.830334:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130173.830575:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:2.0:1789130173.830800:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130173.830941:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626816896:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130173.831042:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130173.839568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130173.839868:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626816896:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130173.840099:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910464 00000100:00100000:3.0:1789130173.840123:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910464 00000100:00100000:3.0:1789130173.840178:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:3.0:1789130173.840189:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604910464:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130173.840220:0:36588:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130173.840325:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604910464:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 137us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130173.840333:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:2.0:1789130173.845336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130173.845679:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910592 00000100:00100000:0.0:1789130173.845690:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910592 00000100:00100000:0.0:1789130173.845895:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:0.0:1789130173.845908:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604910592:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789130173.845986:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846005:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846021:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846042:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846049:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846054:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846087:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846096:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.846102:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130173.847505:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:0.0:1789130173.847515:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130173.847535:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847551:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847558:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847566:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847572:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130173.847576:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847583:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847598:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130173.847627:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130173.847633:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847640:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce98ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847657:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847663:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847669:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847674:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130173.847677:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847683:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847690:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1989a751 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130173.847693:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130173.847696:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847702:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce98b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847719:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847732:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847737:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847742:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130173.847744:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847750:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847760:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:0.0:1789130173.847762:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130173.847764:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.847771:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce98ba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130173.847888:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604910592:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1980us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130173.847897:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:3.0:1789130173.851371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130173.864216:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910848 00000100:00100000:1.0:1789130173.864232:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910848 00000100:00100000:1.0:1789130173.864327:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:1.0:1789130173.864340:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604910848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130173.864361:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130173.864553:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce98c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd74 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864694:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864710:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864734:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130173.864748:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:1.0:1789130173.864871:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864880:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864907:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864913:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130173.864918:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864926:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864940:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130173.864943:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130173.864949:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.864955:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98c8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.865000:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce98c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd74 expref: 18 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.865010:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130173.865012:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130173.865016:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce98c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd74 expref: 18 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.865026:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130173.865106:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:34659:x1876037604910848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 769us (13745us total) trans 30064771283 rc 301/301 00000100:00100000:1.0:1789130173.865228:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:1.0:1789130173.872274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130173.872513:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604910976 00000100:00100000:0.0:1789130173.872522:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604910976 00000100:00100000:0.0:1789130173.872577:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 246 00000100:00100000:0.0:1789130173.872625:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:34659:x1876037604910976:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130173.872662:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130173.872782:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:34659:x1876037604910976:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 196us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130173.872790:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 246 00000100:00100000:3.0:1789130173.880208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130173.891743:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604911104 00000100:00100000:1.0:1789130173.891768:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604911104 00000100:00100000:1.0:1789130173.891857:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:1.0:1789130173.891870:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:34659:x1876037604911104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130173.891893:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130173.891918:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce98d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd7b expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.891985:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.891999:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.892011:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130173.892539:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130173.892544:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130173.892673:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.892701:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce98d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd7b expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.892717:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd7b expref: 18 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.892740:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130173.892743:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130173.892758:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:1.0:1789130173.892844:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+18:34659:x1876037604911104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 975us (12645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130173.892862:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 247 00010000:00010000:2.0:1789130173.894481:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130173.898272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130173.904081:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604911360 00000100:00100000:0.0:1789130173.904100:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604911360 00000100:00100000:2.0:1789130173.904282:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:2.0:1789130173.904554:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+18:34659:x1876037604911360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130173.904576:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130173.904579:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130173.904634:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce98dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd7b expref: 18 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.904653:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:2.0:1789130173.904679:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130173.904696:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce98e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd82 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130173.906972:0:38734:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc6:0x0], index 0: 0 00010000:00010000:2.0:1789130173.909203:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce98eb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.909225:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce98eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.909237:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce98eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.909507:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce98e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd82 expref: 20 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.909532:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce98eb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd82 expref: 19 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.909542:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130173.909545:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130173.909548:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:2.0:1789130173.910046:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604911360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5494us (11782us total) trans 30064771284 rc 0/0 00000100:00100000:2.0:1789130173.914244:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:2.0:1789130173.918993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.919180:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604911488 00000100:00100000:3.0:1789130173.919190:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604911488 00000100:00100000:3.0:1789130173.919250:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 249 00000100:00100000:3.0:1789130173.919261:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604911488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130173.919568:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130173.919708:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce98f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd89 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.919859:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.919873:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.919886:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130173.920101:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130173.920105:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130173.920268:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.920712:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce98f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd89 expref: 21 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.920797:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd89 expref: 20 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.920805:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939800) 00010000:00010000:3.0:1789130173.920808:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130173.920811:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87000, rc 0) 00000100:00100000:3.0:1789130173.920884:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:34659:x1876037604911488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1624us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130173.920893:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 249 00000100:00100000:0.0:1789130173.926871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130173.926952:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604911744 00000100:00100000:2.0:1789130173.926962:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604911744 00000100:00100000:2.0:1789130173.927037:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 250 00000100:00100000:2.0:1789130173.927047:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:34659:x1876037604911744:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130173.927098:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130173.927123:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce98eb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd82 expref: 20 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927141:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130173.927156:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9900 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd89 expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927165:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939800) 00010000:00010000:2.0:1789130173.927172:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130173.927194:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927206:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927216:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927228:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927234:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927239:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927514:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927523:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927530:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927537:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130173.927540:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927548:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927556:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd100) 00010000:00010000:2.0:1789130173.927559:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130173.927563:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927569:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9907 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927580:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927586:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927591:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927645:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130173.927649:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927655:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927664:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7151bad3 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130173.927666:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130173.927669:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.927675:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce990e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7151bad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130173.927750:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:34659:x1876037604911744:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 704us (887us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130173.927758:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 250 00000100:00100000:1.0:1789130173.930129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130173.930402:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604911872 00000100:00100000:2.0:1789130173.930411:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604911872 00000100:00100000:2.0:1789130173.930467:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 251 00000100:00100000:2.0:1789130173.930488:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+18:34659:x1876037604911872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130173.930509:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130173.930531:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9915 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd90 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930569:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930621:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930634:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930727:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9915 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 20 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930744:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 19 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130173.930753:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130173.930756:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130173.930760:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:2.0:1789130173.930967:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604911872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 489us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130173.930974:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 251 00000100:00100000:0.0:1789130173.939300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.939991:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604912128 00000100:00100000:3.0:1789130173.940001:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604912128 00000100:00100000:3.0:1789130173.940083:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:3.0:1789130173.940091:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604912128:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130173.940180:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.940195:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.940205:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130173.940582:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].8, 88 off8824 00000004:00080000:3.0:1789130173.940592:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1337037989231ns, next at 1338037986458ns, rc = 0 00000004:00010000:3.0:1789130173.940700:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000189c9b7a reply state 00000000560fb8f0 transno 30064771285 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130173.940708:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130173.940818:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:34659:x1876037604912128:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 727us (1530us total) trans 30064771285 rc 0/0 00000100:00100000:3.0:1789130173.940826:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 252 00010000:00010000:1.0:1789130173.943333:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943349:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943358:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943364:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130173.943370:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943378:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943397:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:1.0:1789130173.943400:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130173.943405:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.943431:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9923 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130173.945546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.945641:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604912256 00000100:00100000:3.0:1789130173.945651:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604912256 00000100:00100000:3.0:1789130173.945704:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:3.0:1789130173.945715:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:34659:x1876037604912256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130173.945737:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130173.945768:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd97 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.945835:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 21 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.945859:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 21 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.945880:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:3.0:1789130173.945884:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130173.945887:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:3.0:1789130173.945947:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:34659:x1876037604912256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 233us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130173.945954:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:0.0:1789130173.952569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.952728:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604912384 00000100:00100000:3.0:1789130173.952738:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604912384 00000100:00100000:3.0:1789130173.953134:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130173.953146:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604912384:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789130173.953504:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2368:x1876037604912384:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 359us (944us total) trans 30064771099 rc 0/0 00000100:00100000:3.0:1789130173.953513:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00080000:1.0:1789130173.956248:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130173.959635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.959724:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604912640 00000100:00100000:3.0:1789130173.959732:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604912640 00000100:00100000:3.0:1789130173.959974:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789130173.959989:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:34659:x1876037604912640:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130173.960237:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:34659:x1876037604912640:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 252us (611us total) trans 30064771286 rc 0/0 00000100:00100000:0.0:1789130173.963007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130173.963132:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604912896 00000100:00100000:2.0:1789130173.963142:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604912896 00000100:00100000:2.0:1789130173.963234:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 254 00000100:00100000:2.0:1789130173.963245:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604912896:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130173.963352:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604912896:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130173.963360:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 254 00000100:00100000:3.0:1789130173.968003:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:0.0:1789130173.968341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130173.968541:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913024 00000100:00100000:3.0:1789130173.968553:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913024 00000100:00100000:3.0:1789130173.968659:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 255 00000100:00100000:3.0:1789130173.968670:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+22:34659:x1876037604913024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130173.968692:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130173.968874:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9931 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abd9e expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.968949:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.968964:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.968991:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130173.969032:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130173.969052:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.969080:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9931 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd9e expref: 24 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.969098:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd9e expref: 23 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130173.969107:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:3.0:1789130173.969109:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130173.969113:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87600, rc 0) 00000100:00100000:3.0:1789130173.969179:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604913024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 511us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130173.969187:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 255 00000100:00100000:2.0:1789130173.972958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130173.973055:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913152 00000100:00100000:1.0:1789130173.973064:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913152 00000100:00100000:1.0:1789130173.973112:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130173.973122:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2369:x1876037604913152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130173.973145:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130173.973166:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abda5 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130173.973192:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f5bd, blocks: 0x1 00010000:00010000:1.0:1789130173.973210:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=1337s v=(0 0) 00010000:00010000:1.0:1789130173.973213:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130173.973221:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 9 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.973235:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 9 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.973246:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:1.0:1789130173.973299:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604913152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 178us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130173.973306:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130173.977542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130173.977639:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913408 00000100:00100000:1.0:1789130173.977666:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913408 00000100:00100000:1.0:1789130173.977727:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:1.0:1789130173.977739:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604913408:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130173.977950:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604913408:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 213us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130173.977956:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:3.0:1789130173.989389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130173.989483:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913536 00000100:00100000:1.0:1789130173.989494:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913536 00000100:00100000:1.0:1789130173.989554:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789130173.989565:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+9:34659:x1876037604913536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130173.989592:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130173.989650:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdac expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.989683:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.989693:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130173.989697:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130173.989701:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.989745:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.989760:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 1437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130173.989792:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d84f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626817024:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130173.990063:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130173.993135:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d84f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626817024:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130173.993170:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130173.993191:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:1.0:1789130173.993936:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:34659:x1876037604913536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4369us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130173.993948:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789130173.995962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130173.996024:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913664 00000100:00100000:0.0:1789130173.996036:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913664 00010000:00010000:0.0:1789130173.996082:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 1437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130173.996178:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130173.996190:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604913664:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130173.996205:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130173.996229:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 1437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.996243:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 1437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.996265:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbe1a567/0x5c74554e47ce993f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abda5 expref: 10 pid: 37658 timeout: 1437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.996304:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130173.996309:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130173.996318:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.996329:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130173.996366:0:36572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130173.996381:0:36572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626817152:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130173.996461:0:36572:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130174.000997:0:36572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832212c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626817152:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130174.001026:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130174.001126:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604913664:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4938us (5166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130174.001139:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:2.0:1789130174.021793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.021935:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913792 00000100:00100000:0.0:1789130174.021945:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913792 00002000:00100000:0.0:1789130174.021999:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (0->1048575) req@ffff90b38685e940 x1876037604913792/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.022011:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e940 with x1876037604913792 ext(0->1048575) 00002000:00010000:0.0:1789130174.022018:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685e940 00000100:00100000:0.0:1789130174.022076:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1789130174.022087:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604913792:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.069120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.070063:0:37279:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789130174.070078:0:37279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789130174.073342:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604913920 00000100:00100000:0.0:1789130174.073356:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604913920 00002000:00100000:0.0:1789130174.073417:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (1048576->2097151) req@ffff90b3832212c0 x1876037604913920/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.073429:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832212c0 with x1876037604913920 ext(1048576->2097151) 00002000:00010000:0.0:1789130174.073435:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832212c0 00000100:00100000:1.0:1789130174.074494:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130174.074511:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604913920:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.095032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.104166:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604913792:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 82067us (82370us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1789130174.104184:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00002000:00100000:0.0:1789130174.104201:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (0->1048575) req@ffff90b38685e940 x1876037604913792/t30064771100(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.104212:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e940 with x1876037604913792 ext(0->1048575) 00002000:00010000:0.0:1789130174.104219:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685e940 00000100:00100000:0.0:1789130174.104254:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914048 00000100:00100000:0.0:1789130174.104262:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914048 00002000:00100000:0.0:1789130174.104303:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (2097152->3145727) req@ffff90b382d84f00 x1876037604914048/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.104311:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d84f00 with x1876037604914048 ext(2097152->3145727) 00002000:00010000:0.0:1789130174.104314:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d84f00 00000100:00100000:0.0:1789130174.104344:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789130174.104353:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037604914048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130174.116382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130174.116583:0:37281:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789130174.116658:0:37281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789130174.117502:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914176 00000100:00100000:1.0:1789130174.117513:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914176 00002000:00100000:1.0:1789130174.117555:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (3145728->4194303) req@ffff90b384a07480 x1876037604914176/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.117564:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07480 with x1876037604914176 ext(3145728->4194303) 00002000:00010000:1.0:1789130174.117569:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a07480 00000100:00100000:2.0:1789130174.119333:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789130174.119350:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604914176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.126888:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604913920:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 52368us (57765us total) trans 30064771101 rc 0/0 00000100:00100000:0.0:1789130174.126903:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00002000:00100000:0.0:1789130174.126918:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (1048576->2097151) req@ffff90b3832212c0 x1876037604913920/t30064771101(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.126930:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832212c0 with x1876037604913920 ext(1048576->2097151) 00002000:00010000:0.0:1789130174.126938:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832212c0 00000100:00100000:0.0:1789130174.135511:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604914048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 31146us (40498us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1789130174.135526:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00002000:00100000:0.0:1789130174.135540:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (2097152->3145727) req@ffff90b382d84f00 x1876037604914048/t30064771102(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.135552:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d84f00 with x1876037604914048 ext(2097152->3145727) 00002000:00010000:0.0:1789130174.135560:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d84f00 00000100:00100000:0.0:1789130174.137951:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604914176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 18595us (21567us total) trans 30064771103 rc 0/0 00000100:00100000:0.0:1789130174.137966:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00002000:00100000:0.0:1789130174.137978:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (3145728->4194303) req@ffff90b384a07480 x1876037604914176/t30064771103(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.137989:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07480 with x1876037604914176 ext(3145728->4194303) 00002000:00010000:0.0:1789130174.137996:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a07480 00000100:00100000:2.0:1789130174.148736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.149217:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914304 00000100:00100000:1.0:1789130174.149228:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914304 00002000:00100000:1.0:1789130174.149299:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (4194304->5242879) req@ffff90b38685f480 x1876037604914304/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.149312:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685f480 with x1876037604914304 ext(4194304->5242879) 00002000:00010000:1.0:1789130174.149319:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685f480 00000100:00100000:1.0:1789130174.149355:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789130174.149445:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604914304:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.165570:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604914304:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 16115us (16833us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1789130174.165584:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00002000:00100000:1.0:1789130174.165598:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (4194304->5242879) req@ffff90b38685f480 x1876037604914304/t30064771104(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.165634:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685f480 with x1876037604914304 ext(4194304->5242879) 00002000:00010000:1.0:1789130174.165642:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685f480 00000100:00100000:2.0:1789130174.176777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.178275:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914432 00000100:00100000:0.0:1789130174.178287:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914432 00002000:00100000:0.0:1789130174.178347:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (5242880->6291455) req@ffff90b38685da40 x1876037604914432/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.178356:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685da40 with x1876037604914432 ext(5242880->6291455) 00002000:00010000:0.0:1789130174.178371:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685da40 00000100:00100000:0.0:1789130174.178409:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789130174.178420:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604914432:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.193226:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2369:x1876037604914432:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 14797us (16448us total) trans 30064771105 rc 0/0 00000100:00100000:0.0:1789130174.193240:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00002000:00100000:0.0:1789130174.193255:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (5242880->6291455) req@ffff90b38685da40 x1876037604914432/t30064771105(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.193279:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685da40 with x1876037604914432 ext(5242880->6291455) 00002000:00010000:0.0:1789130174.193287:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685da40 00000100:00100000:2.0:1789130174.214861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.214953:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914560 00000100:00100000:1.0:1789130174.214963:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914560 00002000:00100000:1.0:1789130174.215016:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (6291456->7340031) req@ffff90b38685de00 x1876037604914560/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.215029:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685de00 with x1876037604914560 ext(6291456->7340031) 00002000:00010000:1.0:1789130174.215037:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685de00 00000100:00100000:1.0:1789130174.215069:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:1.0:1789130174.215079:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604914560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.232508:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037604914560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 17417us (17652us total) trans 30064771106 rc 0/0 00000100:00100000:1.0:1789130174.232549:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00002000:00100000:1.0:1789130174.232564:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (6291456->7340031) req@ffff90b38685de00 x1876037604914560/t30064771106(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.232584:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685de00 with x1876037604914560 ext(6291456->7340031) 00002000:00010000:1.0:1789130174.232592:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685de00 00000100:00100000:2.0:1789130174.253831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.253962:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914688 00000100:00100000:1.0:1789130174.253972:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914688 00002000:00100000:1.0:1789130174.254022:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (7340032->8388607) req@ffff90b38685ed00 x1876037604914688/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.254035:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685ed00 with x1876037604914688 ext(7340032->8388607) 00002000:00010000:1.0:1789130174.254043:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685ed00 00000100:00100000:1.0:1789130174.254076:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1789130174.254086:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604914688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130174.301772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.306205:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914816 00000100:00100000:1.0:1789130174.306221:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914816 00002000:00100000:1.0:1789130174.306289:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (8388608->9437183) req@ffff90b38685cf00 x1876037604914816/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.306303:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685cf00 with x1876037604914816 ext(8388608->9437183) 00002000:00010000:1.0:1789130174.306310:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685cf00 00000100:00100000:1.0:1789130174.306339:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130174.306349:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:2370:x1876037604914816:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.324757:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604914688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 70662us (70926us total) trans 30064771107 rc 0/0 00000100:00100000:1.0:1789130174.324783:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00002000:00100000:1.0:1789130174.324798:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (7340032->8388607) req@ffff90b38685ed00 x1876037604914688/t30064771107(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.324810:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685ed00 with x1876037604914688 ext(7340032->8388607) 00002000:00010000:1.0:1789130174.324817:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685ed00 00000100:00100000:3.0:1789130174.330758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.331454:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604914944 00000100:00100000:1.0:1789130174.331466:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604914944 00002000:00100000:1.0:1789130174.331526:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (9437184->10485759) req@ffff90b384a05a40 x1876037604914944/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.331539:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05a40 with x1876037604914944 ext(9437184->10485759) 00002000:00010000:1.0:1789130174.331545:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a05a40 00000100:00100000:1.0:1789130174.331584:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130174.331594:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604914944:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.346039:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037604914816:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 39675us (44262us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1789130174.346058:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00002000:00100000:1.0:1789130174.346076:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (8388608->9437183) req@ffff90b38685cf00 x1876037604914816/t30064771108(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.346087:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685cf00 with x1876037604914816 ext(8388608->9437183) 00002000:00010000:1.0:1789130174.346095:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685cf00 00000100:00100000:2.0:1789130174.365229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.365328:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915072 00000100:00100000:1.0:1789130174.365338:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915072 00002000:00100000:1.0:1789130174.365509:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (10485760->11534335) req@ffff90b38685c780 x1876037604915072/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.365532:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685c780 with x1876037604915072 ext(10485760->11534335) 00002000:00010000:1.0:1789130174.365540:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685c780 00000100:00100000:1.0:1789130174.365587:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1789130174.365598:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604915072:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.381060:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:2368:x1876037604914944:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 49454us (50299us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1789130174.381077:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00002000:00100000:0.0:1789130174.381093:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (9437184->10485759) req@ffff90b384a05a40 x1876037604914944/t30064771109(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.381104:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05a40 with x1876037604914944 ext(9437184->10485759) 00002000:00010000:0.0:1789130174.381833:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a05a40 00000100:00100000:2.0:1789130174.388383:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604915072:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 22768us (23145us total) trans 30064771110 rc 0/0 00000100:00100000:2.0:1789130174.388398:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00002000:00100000:2.0:1789130174.388412:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (10485760->11534335) req@ffff90b38685c780 x1876037604915072/t30064771110(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130174.388423:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685c780 with x1876037604915072 ext(10485760->11534335) 00002000:00010000:2.0:1789130174.388430:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685c780 00000100:00100000:2.0:1789130174.429909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130174.430060:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915200 00000100:00100000:3.0:1789130174.430070:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915200 00002000:00100000:3.0:1789130174.430126:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (11534336->12582911) req@ffff90b38685d680 x1876037604915200/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130174.430138:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685d680 with x1876037604915200 ext(11534336->12582911) 00002000:00010000:3.0:1789130174.430159:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685d680 00000100:00100000:3.0:1789130174.430197:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:3.0:1789130174.430207:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604915200:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.449786:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:2369:x1876037604915200:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 19570us (19877us total) trans 30064771111 rc 0/0 00000100:00100000:1.0:1789130174.449810:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00002000:00100000:1.0:1789130174.449823:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (11534336->12582911) req@ffff90b38685d680 x1876037604915200/t30064771111(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.449834:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685d680 with x1876037604915200 ext(11534336->12582911) 00002000:00010000:1.0:1789130174.449850:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685d680 00000100:00100000:2.0:1789130174.465042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.465150:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915328 00000100:00100000:1.0:1789130174.465160:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915328 00002000:00100000:1.0:1789130174.465211:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (12582912->13631487) req@ffff90b38685c3c0 x1876037604915328/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.465223:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685c3c0 with x1876037604915328 ext(12582912->13631487) 00002000:00010000:1.0:1789130174.465229:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685c3c0 00000100:00100000:1.0:1789130174.465309:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130174.465320:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604915328:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130174.495831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.496668:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915456 00000100:00100000:1.0:1789130174.496681:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915456 00002000:00100000:1.0:1789130174.496739:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (13631488->14680063) req@ffff90b384a05e00 x1876037604915456/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.496778:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05e00 with x1876037604915456 ext(13631488->14680063) 00002000:00010000:1.0:1789130174.496784:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a05e00 00000100:00100000:1.0:1789130174.496895:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130174.496906:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:2367:x1876037604915456:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130174.530990:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:2367:x1876037604915328:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 65658us (65949us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1789130174.531006:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00002000:00100000:1.0:1789130174.531025:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (12582912->13631487) req@ffff90b38685c3c0 x1876037604915328/t30064771112(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.531038:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685c3c0 with x1876037604915328 ext(12582912->13631487) 00002000:00010000:1.0:1789130174.531046:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685c3c0 00000100:00100000:1.0:1789130174.531470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130174.532725:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915584 00000100:00100000:3.0:1789130174.532735:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915584 00002000:00100000:3.0:1789130174.532803:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (14680064->15728639) req@ffff90b382d85680 x1876037604915584/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130174.532814:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d85680 with x1876037604915584 ext(14680064->15728639) 00002000:00010000:3.0:1789130174.532819:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d85680 00000100:00100000:3.0:1789130174.532859:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130174.532869:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:2370:x1876037604915584:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130174.558275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.559490:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915712 00000100:00100000:1.0:1789130174.559501:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915712 00002000:00100000:1.0:1789130174.559551:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (15728640->16777215) req@ffff90b38685fc00 x1876037604915712/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.559562:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685fc00 with x1876037604915712 ext(15728640->16777215) 00002000:00010000:1.0:1789130174.559567:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685fc00 00000100:00100000:1.0:1789130174.559631:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789130174.559641:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037604915712:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130174.570558:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:2367:x1876037604915456:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 73640us (74725us total) trans 30064771113 rc 0/0 00000100:00100000:3.0:1789130174.570576:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00002000:00100000:3.0:1789130174.570592:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (13631488->14680063) req@ffff90b384a05e00 x1876037604915456/t30064771113(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130174.571330:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05e00 with x1876037604915456 ext(13631488->14680063) 00002000:00010000:3.0:1789130174.571339:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a05e00 00000100:00100000:2.0:1789130174.576074:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604915584:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 43195us (44712us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1789130174.576107:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00002000:00100000:2.0:1789130174.576120:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (14680064->15728639) req@ffff90b382d85680 x1876037604915584/t30064771114(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130174.576131:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d85680 with x1876037604915584 ext(14680064->15728639) 00002000:00010000:2.0:1789130174.576138:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d85680 00000100:00100000:0.0:1789130174.583573:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604915712:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 23923us (25297us total) trans 30064771115 rc 0/0 00000100:00100000:0.0:1789130174.583587:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00002000:00100000:0.0:1789130174.583644:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (15728640->16777215) req@ffff90b38685fc00 x1876037604915712/t30064771115(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.583656:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685fc00 with x1876037604915712 ext(15728640->16777215) 00002000:00010000:0.0:1789130174.583663:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685fc00 00000100:00100000:2.0:1789130174.593220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.596198:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915840 00000100:00100000:1.0:1789130174.596214:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915840 00002000:00100000:1.0:1789130174.596291:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (16777216->17825791) req@ffff90b38685cb40 x1876037604915840/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130174.596304:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685cb40 with x1876037604915840 ext(16777216->17825791) 00002000:00010000:1.0:1789130174.596310:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685cb40 00000100:00100000:1.0:1789130174.596467:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1789130174.596478:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604915840:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.622885:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:2368:x1876037604915840:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 26397us (29665us total) trans 30064771116 rc 0/0 00000100:00100000:0.0:1789130174.622898:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00002000:00100000:0.0:1789130174.622912:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (16777216->17825791) req@ffff90b38685cb40 x1876037604915840/t30064771116(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.622923:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685cb40 with x1876037604915840 ext(16777216->17825791) 00002000:00010000:0.0:1789130174.622930:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38685cb40 00000100:00100000:1.0:1789130174.634587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130174.634828:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604915968 00000100:00100000:2.0:1789130174.634847:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604915968 00002000:00100000:2.0:1789130174.634908:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (17825792->18874367) req@ffff90b382d87c00 x1876037604915968/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130174.634920:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87c00 with x1876037604915968 ext(17825792->18874367) 00002000:00010000:2.0:1789130174.634926:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d87c00 00000100:00100000:2.0:1789130174.635497:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130174.635514:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:2369:x1876037604915968:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.650003:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:2369:x1876037604915968:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 14477us (15408us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1789130174.650017:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00002000:00100000:0.0:1789130174.650034:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (17825792->18874367) req@ffff90b382d87c00 x1876037604915968/t30064771117(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.650046:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87c00 with x1876037604915968 ext(17825792->18874367) 00002000:00010000:0.0:1789130174.650053:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d87c00 00000100:00100000:1.0:1789130174.680711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.680819:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916096 00000100:00100000:0.0:1789130174.680830:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916096 00002000:00100000:0.0:1789130174.680884:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (18874368->19922943) req@ffff90b382d87480 x1876037604916096/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.680897:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87480 with x1876037604916096 ext(18874368->19922943) 00002000:00010000:0.0:1789130174.680902:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d87480 00000100:00100000:0.0:1789130174.680949:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130174.680958:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:2368:x1876037604916096:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.704524:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+47:2368:x1876037604916096:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 23555us (23812us total) trans 30064771118 rc 0/0 00000100:00100000:0.0:1789130174.704538:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00002000:00100000:0.0:1789130174.704551:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (18874368->19922943) req@ffff90b382d87480 x1876037604916096/t30064771118(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.704561:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87480 with x1876037604916096 ext(18874368->19922943) 00002000:00010000:0.0:1789130174.704569:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d87480 00000100:00100000:3.0:1789130174.720817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.720886:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916224 00000100:00100000:0.0:1789130174.720897:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916224 00002000:00100000:0.0:1789130174.720952:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (19922944->20971519) req@ffff90b384a07840 x1876037604916224/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.720964:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07840 with x1876037604916224 ext(19922944->20971519) 00002000:00010000:0.0:1789130174.720970:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a07840 00000100:00100000:0.0:1789130174.721126:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130174.721137:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:2367:x1876037604916224:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.736297:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:2367:x1876037604916224:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 15148us (15474us total) trans 30064771119 rc 0/0 00000100:00100000:0.0:1789130174.736314:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00002000:00100000:0.0:1789130174.736329:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (19922944->20971519) req@ffff90b384a07840 x1876037604916224/t30064771119(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.736342:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07840 with x1876037604916224 ext(19922944->20971519) 00002000:00010000:0.0:1789130174.737256:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a07840 00000100:00100000:2.0:1789130174.759846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.759985:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916352 00000100:00100000:0.0:1789130174.759995:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916352 00002000:00100000:0.0:1789130174.760056:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (20971520->22020095) req@ffff90b3879f9680 x1876037604916352/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.760068:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9680 with x1876037604916352 ext(20971520->22020095) 00002000:00010000:0.0:1789130174.760076:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9680 00000100:00100000:0.0:1789130174.760113:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1789130174.760123:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:2370:x1876037604916352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.797029:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:2370:x1876037604916352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 36892us (37187us total) trans 30064771120 rc 0/0 00000100:00100000:0.0:1789130174.797047:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00002000:00100000:0.0:1789130174.797063:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (20971520->22020095) req@ffff90b3879f9680 x1876037604916352/t30064771120(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.797076:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9680 with x1876037604916352 ext(20971520->22020095) 00002000:00010000:0.0:1789130174.797084:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9680 00000100:00100000:1.0:1789130174.808493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.809647:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916480 00000100:00100000:0.0:1789130174.809658:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916480 00002000:00100000:0.0:1789130174.809711:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (22020096->23068671) req@ffff90b4bd9a4780 x1876037604916480/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.809723:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4780 with x1876037604916480 ext(22020096->23068671) 00002000:00010000:0.0:1789130174.809730:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a4780 00000100:00100000:0.0:1789130174.809765:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789130174.809776:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:2369:x1876037604916480:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130174.829710:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.829919:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916608 00000100:00100000:0.0:1789130174.829930:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916608 00002000:00100000:0.0:1789130174.829976:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (23068672->24117247) req@ffff90b384a06d00 x1876037604916608/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.829986:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a06d00 with x1876037604916608 ext(23068672->24117247) 00002000:00010000:0.0:1789130174.829992:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a06d00 00000100:00100000:0.0:1789130174.830032:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789130174.830042:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+53:2368:x1876037604916608:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130174.881421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130174.881530:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916736 00000100:00100000:0.0:1789130174.881541:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916736 00002000:00100000:0.0:1789130174.881635:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (24117248->25165823) req@ffff90b3879f83c0 x1876037604916736/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.881647:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f83c0 with x1876037604916736 ext(24117248->25165823) 00002000:00010000:0.0:1789130174.881653:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f83c0 00000100:00100000:0.0:1789130174.881684:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:0.0:1789130174.881695:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:2370:x1876037604916736:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130174.910237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130174.911084:0:37281:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789130174.911098:0:37281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00010000:00010000:0.0:1789130174.923202:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130174.936428:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916864 00000100:00100000:2.0:1789130174.936441:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916864 00002000:00100000:2.0:1789130174.936501:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (25165824->26214399) req@ffff90b486f403c0 x1876037604916864/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130174.936514:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f403c0 with x1876037604916864 ext(25165824->26214399) 00002000:00010000:2.0:1789130174.936521:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f403c0 00000100:00100000:1.0:1789130174.937888:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:1.0:1789130174.937904:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+57:2369:x1876037604916864:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130174.985467:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+59:2369:x1876037604916480:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 175675us (176967us total) trans 30064771121 rc 0/0 00000100:00100000:0.0:1789130174.985482:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00002000:00100000:0.0:1789130174.985496:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (22020096->23068671) req@ffff90b4bd9a4780 x1876037604916480/t30064771121(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130174.985506:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4780 with x1876037604916480 ext(22020096->23068671) 00002000:00010000:0.0:1789130174.985526:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a4780 00000100:00100000:3.0:1789130174.988705:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+59:2368:x1876037604916608:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 158654us (158995us total) trans 30064771122 rc 0/0 00000100:00100000:3.0:1789130174.988738:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00002000:00100000:3.0:1789130174.988752:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (23068672->24117247) req@ffff90b384a06d00 x1876037604916608/t30064771122(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130174.988764:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a06d00 with x1876037604916608 ext(23068672->24117247) 00002000:00010000:3.0:1789130174.988770:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a06d00 00000100:00100000:3.0:1789130174.991995:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:2370:x1876037604916736:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 110291us (110572us total) trans 30064771123 rc 0/0 00000100:00100000:3.0:1789130174.992009:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00002000:00100000:3.0:1789130174.992020:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (24117248->25165823) req@ffff90b3879f83c0 x1876037604916736/t30064771123(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130174.992032:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f83c0 with x1876037604916736 ext(24117248->25165823) 00002000:00010000:3.0:1789130174.992038:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f83c0 00000100:00100000:0.0:1789130174.996343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130174.997145:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604916992 00000100:00100000:2.0:1789130174.997168:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604916992 00002000:00100000:2.0:1789130174.997220:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (26214400->27262975) req@ffff90b38866e1c0 x1876037604916992/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/0 e 0 to 0 dl 1789130185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130174.997232:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e1c0 with x1876037604916992 ext(26214400->27262975) 00002000:00010000:2.0:1789130174.997238:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e1c0 00000100:00100000:2.0:1789130174.997273:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1789130174.997283:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+59:2370:x1876037604916992:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130175.036385:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+61:2369:x1876037604916864:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 98475us (126146us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1789130175.036400:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00002000:00100000:2.0:1789130175.036413:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (25165824->26214399) req@ffff90b486f403c0 x1876037604916864/t30064771124(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.036424:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f403c0 with x1876037604916864 ext(25165824->26214399) 00002000:00010000:2.0:1789130175.036431:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f403c0 00000100:00100000:3.0:1789130175.050385:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+61:2370:x1876037604916992:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 53091us (54042us total) trans 30064771125 rc 0/0 00000100:00100000:3.0:1789130175.050401:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00002000:00100000:3.0:1789130175.050414:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (26214400->27262975) req@ffff90b38866e1c0 x1876037604916992/t30064771125(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:645/0 lens 488/448 e 0 to 0 dl 1789130185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.050426:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e1c0 with x1876037604916992 ext(26214400->27262975) 00002000:00010000:3.0:1789130175.050433:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e1c0 00000100:00100000:1.0:1789130175.069968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130175.070929:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917120 00000100:00100000:0.0:1789130175.070941:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917120 00002000:00100000:0.0:1789130175.071017:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (27262976->28311551) req@ffff90b4bd9a61c0 x1876037604917120/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.071031:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a61c0 with x1876037604917120 ext(27262976->28311551) 00002000:00010000:0.0:1789130175.071038:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a61c0 00000100:00100000:0.0:1789130175.071073:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130175.071084:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+61:2369:x1876037604917120:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1789130175.075959:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130175.084946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.085792:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+63:2369:x1876037604917120:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 14706us (15831us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1789130175.085805:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00002000:00100000:3.0:1789130175.085844:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (27262976->28311551) req@ffff90b4bd9a61c0 x1876037604917120/t30064771126(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.085855:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a61c0 with x1876037604917120 ext(27262976->28311551) 00002000:00010000:3.0:1789130175.085862:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a61c0 00000100:00100000:3.0:1789130175.085889:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917248 00000100:00100000:3.0:1789130175.085896:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917248 00002000:00100000:3.0:1789130175.085930:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (28311552->29360127) req@ffff90b3879fbc00 x1876037604917248/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.085939:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fbc00 with x1876037604917248 ext(28311552->29360127) 00002000:00010000:3.0:1789130175.085942:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fbc00 00000100:00100000:3.0:1789130175.085974:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1789130175.085984:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+63:2367:x1876037604917248:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130175.106110:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+65:2367:x1876037604917248:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20115us (21160us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1789130175.106124:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00002000:00100000:2.0:1789130175.106138:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (28311552->29360127) req@ffff90b3879fbc00 x1876037604917248/t30064771127(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.106149:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fbc00 with x1876037604917248 ext(28311552->29360127) 00002000:00010000:2.0:1789130175.106156:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fbc00 00000100:00100000:1.0:1789130175.130380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130175.130492:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917376 00000100:00100000:2.0:1789130175.130516:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917376 00002000:00100000:2.0:1789130175.130860:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (29360128->30408703) req@ffff90b4bd9a6d00 x1876037604917376/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.130874:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a6d00 with x1876037604917376 ext(29360128->30408703) 00002000:00010000:2.0:1789130175.130880:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a6d00 00000100:00100000:2.0:1789130175.130968:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1789130175.130979:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+65:2369:x1876037604917376:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130175.162591:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+67:2369:x1876037604917376:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 31603us (32208us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1789130175.162631:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00002000:00100000:2.0:1789130175.162644:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (29360128->30408703) req@ffff90b4bd9a6d00 x1876037604917376/t30064771128(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.162655:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a6d00 with x1876037604917376 ext(29360128->30408703) 00002000:00010000:2.0:1789130175.162661:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a6d00 00000100:00100000:1.0:1789130175.183301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.183985:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917504 00000100:00100000:3.0:1789130175.183995:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917504 00002000:00100000:3.0:1789130175.184050:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (30408704->31457279) req@ffff90b4bd9a5680 x1876037604917504/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.184062:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a5680 with x1876037604917504 ext(30408704->31457279) 00002000:00010000:3.0:1789130175.184068:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a5680 00000100:00100000:3.0:1789130175.184103:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130175.184113:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+67:2369:x1876037604917504:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130175.209975:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+69:2369:x1876037604917504:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 25852us (26671us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1789130175.209990:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00002000:00100000:2.0:1789130175.210004:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (30408704->31457279) req@ffff90b4bd9a5680 x1876037604917504/t30064771129(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.210015:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a5680 with x1876037604917504 ext(30408704->31457279) 00002000:00010000:2.0:1789130175.210024:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bd9a5680 00000100:00100000:1.0:1789130175.230519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.230650:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917632 00000100:00100000:3.0:1789130175.230661:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917632 00002000:00100000:3.0:1789130175.230723:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (31457280->32505855) req@ffff90b382e42d00 x1876037604917632/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.230766:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e42d00 with x1876037604917632 ext(31457280->32505855) 00002000:00010000:3.0:1789130175.230773:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382e42d00 00000100:00100000:3.0:1789130175.230817:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130175.230838:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:2370:x1876037604917632:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130175.281171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.281252:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917760 00000100:00100000:3.0:1789130175.281264:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917760 00002000:00100000:3.0:1789130175.281319:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (32505856->33554431) req@ffff90b38866e580 x1876037604917760/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.281332:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e580 with x1876037604917760 ext(32505856->33554431) 00002000:00010000:3.0:1789130175.281338:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e580 00000100:00100000:3.0:1789130175.281363:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130175.281372:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+71:2368:x1876037604917760:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130175.300728:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+73:2370:x1876037604917632:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 69888us (70204us total) trans 30064771130 rc 0/0 00000100:00100000:3.0:1789130175.300746:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00002000:00100000:3.0:1789130175.300771:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (31457280->32505855) req@ffff90b382e42d00 x1876037604917632/t30064771130(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.300782:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e42d00 with x1876037604917632 ext(31457280->32505855) 00002000:00010000:3.0:1789130175.300789:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382e42d00 00000100:00100000:0.0:1789130175.321451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.322580:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604917888 00000100:00100000:3.0:1789130175.322591:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604917888 00002000:00100000:3.0:1789130175.322678:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (33554432->34603007) req@ffff90b38866d2c0 x1876037604917888/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.322710:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866d2c0 with x1876037604917888 ext(33554432->34603007) 00002000:00010000:3.0:1789130175.322716:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866d2c0 00000100:00100000:3.0:1789130175.322760:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130175.322770:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+73:2368:x1876037604917888:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130175.324439:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:2368:x1876037604917760:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 43060us (43271us total) trans 30064771131 rc 0/0 00000100:00100000:3.0:1789130175.324452:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00002000:00100000:3.0:1789130175.324462:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (32505856->33554431) req@ffff90b38866e580 x1876037604917760/t30064771131(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.324473:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e580 with x1876037604917760 ext(32505856->33554431) 00002000:00010000:3.0:1789130175.324479:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e580 00000001:00080000:1.0:1789130175.352003:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771094 is committed 00000001:00080000:1.0:1789130175.352017:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771095 is committed 00000001:00080000:1.0:1789130175.352024:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771093 is committed 00000100:00100000:2.0:1789130175.356637:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+75:2368:x1876037604917888:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 33854us (35182us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1789130175.356676:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00002000:00100000:2.0:1789130175.356691:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (33554432->34603007) req@ffff90b38866d2c0 x1876037604917888/t30064771132(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.356702:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866d2c0 with x1876037604917888 ext(33554432->34603007) 00002000:00010000:2.0:1789130175.356710:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866d2c0 00000100:00100000:2.0:1789130175.365838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130175.365941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.366444:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918016 00000100:00100000:3.0:1789130175.366465:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918016 00002000:00100000:3.0:1789130175.366521:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (34603008->35651583) req@ffff90b3879f8b40 x1876037604918016/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.366533:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8b40 with x1876037604918016 ext(34603008->35651583) 00002000:00010000:3.0:1789130175.366539:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8b40 00000100:00100000:3.0:1789130175.366575:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918144 00000100:00100000:3.0:1789130175.366579:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918144 00002000:00100000:3.0:1789130175.366595:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (35651584->36700159) req@ffff90b3879fb0c0 x1876037604918144/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.366627:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb0c0 with x1876037604918144 ext(35651584->36700159) 00002000:00010000:3.0:1789130175.366631:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb0c0 00000100:00100000:3.0:1789130175.366678:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:3.0:1789130175.366688:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+76:2369:x1876037604918016:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130175.366707:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789130175.366717:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+76:2370:x1876037604918144:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130175.390571:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+79:2369:x1876037604918016:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 23864us (24731us total) trans 30064771133 rc 0/0 00000100:00100000:3.0:1789130175.390585:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00002000:00100000:3.0:1789130175.390598:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (34603008->35651583) req@ffff90b3879f8b40 x1876037604918016/t30064771133(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.390635:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8b40 with x1876037604918016 ext(34603008->35651583) 00002000:00010000:3.0:1789130175.390641:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8b40 00000100:00100000:0.0:1789130175.399734:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+79:2370:x1876037604918144:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 33008us (33781us total) trans 30064771134 rc 0/0 00000100:00100000:0.0:1789130175.399749:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00002000:00100000:0.0:1789130175.399764:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (35651584->36700159) req@ffff90b3879fb0c0 x1876037604918144/t30064771134(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.399781:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb0c0 with x1876037604918144 ext(35651584->36700159) 00002000:00010000:0.0:1789130175.399788:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb0c0 00000100:00100000:1.0:1789130175.410557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.410658:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918272 00000100:00100000:3.0:1789130175.410669:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918272 00002000:00100000:3.0:1789130175.410728:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (36700160->37748735) req@ffff90b382e43c00 x1876037604918272/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.410741:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e43c00 with x1876037604918272 ext(36700160->37748735) 00002000:00010000:3.0:1789130175.410748:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382e43c00 00000100:00100000:3.0:1789130175.410787:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789130175.410798:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+79:2368:x1876037604918272:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130175.429804:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+81:2368:x1876037604918272:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 18997us (19245us total) trans 30064771135 rc 0/0 00000100:00100000:3.0:1789130175.429819:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00002000:00100000:3.0:1789130175.429842:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (36700160->37748735) req@ffff90b382e43c00 x1876037604918272/t30064771135(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.429853:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e43c00 with x1876037604918272 ext(36700160->37748735) 00002000:00010000:3.0:1789130175.429873:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382e43c00 00000100:00100000:0.0:1789130175.442670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.443115:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918400 00000100:00100000:3.0:1789130175.443125:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918400 00002000:00100000:3.0:1789130175.443175:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (37748736->38797311) req@ffff90b38866e940 x1876037604918400/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.443186:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e940 with x1876037604918400 ext(37748736->38797311) 00002000:00010000:3.0:1789130175.443192:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e940 00000100:00100000:3.0:1789130175.443225:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789130175.443235:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+81:2369:x1876037604918400:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130175.472398:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+83:2369:x1876037604918400:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 29153us (29726us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1789130175.472429:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00002000:00100000:0.0:1789130175.472444:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (37748736->38797311) req@ffff90b38866e940 x1876037604918400/t30064771136(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.475710:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866e940 with x1876037604918400 ext(37748736->38797311) 00002000:00010000:0.0:1789130175.475718:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866e940 00000100:00100000:2.0:1789130175.493219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.494879:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918528 00000100:00100000:3.0:1789130175.494892:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918528 00002000:00100000:3.0:1789130175.494948:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (38797312->39845887) req@ffff90b3879f8000 x1876037604918528/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.494960:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8000 with x1876037604918528 ext(38797312->39845887) 00002000:00010000:3.0:1789130175.494968:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8000 00000100:00100000:3.0:1789130175.495005:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789130175.495016:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+83:2370:x1876037604918528:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130175.526612:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+85:2370:x1876037604918528:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 31573us (33378us total) trans 30064771137 rc 0/0 00000100:00100000:0.0:1789130175.526638:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00002000:00100000:0.0:1789130175.526652:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (38797312->39845887) req@ffff90b3879f8000 x1876037604918528/t30064771137(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.526663:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8000 with x1876037604918528 ext(38797312->39845887) 00002000:00010000:0.0:1789130175.526669:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8000 00000100:00100000:2.0:1789130175.566915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130175.567072:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918656 00000100:00100000:3.0:1789130175.567082:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918656 00002000:00100000:3.0:1789130175.567129:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (39845888->40894463) req@ffff90b3879fb840 x1876037604918656/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130175.567140:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb840 with x1876037604918656 ext(39845888->40894463) 00002000:00010000:3.0:1789130175.567146:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb840 00000100:00100000:3.0:1789130175.567179:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789130175.567200:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+85:2369:x1876037604918656:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130175.598089:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+87:2369:x1876037604918656:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 30878us (31171us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1789130175.598105:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00002000:00100000:0.0:1789130175.598118:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (39845888->40894463) req@ffff90b3879fb840 x1876037604918656/t30064771138(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.598128:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb840 with x1876037604918656 ext(39845888->40894463) 00002000:00010000:0.0:1789130175.598135:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb840 00000100:00100000:1.0:1789130175.619318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130175.621581:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918784 00000100:00100000:0.0:1789130175.621596:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918784 00002000:00100000:0.0:1789130175.621743:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (40894464->41943039) req@ffff90b498b22580 x1876037604918784/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.621786:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b22580 with x1876037604918784 ext(40894464->41943039) 00002000:00010000:0.0:1789130175.621794:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498b22580 00000100:00100000:0.0:1789130175.621836:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789130175.621847:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+87:2367:x1876037604918784:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130175.658020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130175.658091:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604918912 00000100:00100000:0.0:1789130175.658101:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604918912 00002000:00100000:0.0:1789130175.658154:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (41943040->42811391) req@ffff90b381fdb0c0 x1876037604918912/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/0 e 0 to 0 dl 1789130186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.658167:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdb0c0 with x1876037604918912 ext(41943040->42811391) 00002000:00010000:0.0:1789130175.658174:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fdb0c0 00000100:00100000:0.0:1789130175.658205:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1789130175.658215:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+89:2369:x1876037604918912:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130175.667294:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+91:2367:x1876037604918784:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 45432us (47969us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1789130175.667312:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00002000:00100000:2.0:1789130175.667327:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (40894464->41943039) req@ffff90b498b22580 x1876037604918784/t30064771139(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130175.667339:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b22580 with x1876037604918784 ext(40894464->41943039) 00002000:00010000:2.0:1789130175.667346:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498b22580 00000100:00100000:0.0:1789130175.679083:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+91:2369:x1876037604918912:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20857us (21062us total) trans 30064771140 rc 0/0 00000100:00100000:0.0:1789130175.679100:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00002000:00100000:0.0:1789130175.679114:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (41943040->42811391) req@ffff90b381fdb0c0 x1876037604918912/t30064771140(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:646/0 lens 488/448 e 0 to 0 dl 1789130186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130175.679125:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381fdb0c0 with x1876037604918912 ext(41943040->42811391) 00002000:00010000:0.0:1789130175.679133:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381fdb0c0 00000100:00100000:1.0:1789130175.682850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130175.682948:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919040 00000100:00100000:2.0:1789130175.682957:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919040 00000100:00100000:2.0:1789130175.683038:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:2.0:1789130175.683051:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:34659:x1876037604919040:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1789130175.683245:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130175.759501:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626817664:0@lo:400:kworker.0 00000100:00100000:1.0:1789130175.759501:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626817280:0@lo:400:kworker.0 00000100:00100000:1.0:1789130175.764262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130175.764339:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626817792:0@lo:400:kworker.0 00000100:00100000:1.0:1789130175.764516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626817408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.768429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768464:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626817920:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.768489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768523:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130175.768530:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626817536:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.768552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768571:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38866f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130175.768592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130175.768656:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817792 00000100:00100000:3.0:1789130175.768664:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817792 00000100:00100000:3.0:1789130175.768720:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817664 00000100:00100000:3.0:1789130175.768724:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817664 00000100:00100000:3.0:1789130175.768736:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817920 00000100:00100000:3.0:1789130175.768739:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817920 00000100:00100000:3.0:1789130175.768757:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789130175.768946:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817408 00000100:00100000:0.0:1789130175.768948:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789130175.768951:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817408 00000100:00100000:0.0:1789130175.768958:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626817664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130175.768980:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817536 00000100:00100000:1.0:1789130175.768983:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817536 00000100:00100000:1.0:1789130175.769003:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789130175.769009:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130175.769012:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626817664:12345-0@lo:400:kworker.0 Request processed in 58us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130175.769028:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789130175.769048:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626817408:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130175.769049:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130175.769055:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789130175.769055:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626817920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130175.769065:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789130175.769070:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626817536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130175.769081:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626817920:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130175.769087:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130175.769092:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626817536:12345-0@lo:400:kworker.0 Request processed in 22us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130175.769097:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130175.769139:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626817792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.769186:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626817792:12345-0@lo:400:kworker.0 Request processed in 421us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130175.769192:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130175.769219:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626818048 00000100:00100000:3.0:1789130175.769223:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626818048 00000100:00100000:3.0:1789130175.769248:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789130175.769261:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626818048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130175.769288:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130175.769317:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626818048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130175.769323:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789130175.769338:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130175.769343:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130175.769346:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130175.769374:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771095 gen 2 00000004:00080000:3.0:1789130175.769380:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771095 00000004:00080000:3.0:1789130175.769399:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3839b5e00, transno 30064771095 00000100:00100000:0.0:1789130175.769780:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626817792:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.769896:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626817536:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.769918:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38866f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130175.769929:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626817408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.769939:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626817920:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.769994:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626817664:0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.770040:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626817280 00000100:00100000:3.0:1789130175.770044:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626817280 00000100:00100000:3.0:1789130175.770073:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789130175.770080:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626817280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130175.770123:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626817280:12345-0@lo:400:kworker.0 Request processed in 44us (5869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130175.770130:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789130175.770164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626817280:0@lo:400:kworker.0 00000001:00080000:2.0:1789130175.789720:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771280 is committed 00000001:00080000:2.0:1789130175.789740:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771283 is committed 00000001:00080000:2.0:1789130175.789746:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771284 is committed 00000001:00080000:2.0:1789130175.789756:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771286 is committed 00000004:00080000:2.0:1789130175.789787:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789130175.789809:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803905 batchid updated 00000020:00080000:3.0:1789130175.790149:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803905 00000020:00080000:3.0:1789130175.790161:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803905 00000100:00100000:3.0:1789130175.790171:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130175.790193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38866da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626818176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789130175.790266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130175.790370:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626818176 00000100:00100000:0.0:1789130175.790377:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626818176 00000100:00100000:0.0:1789130175.790431:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789130175.790440:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626818176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789130175.790637:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb size from disk: 0 -> 42811392 00002000:00010000:0.0:1789130175.790641:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb mtime from disk: 0 -> 1789130175 00002000:00010000:0.0:1789130175.790644:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130175.790646:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb ctime from disk: 1789130173 -> 1789130175 00002000:00010000:0.0:1789130175.790648:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130175.790694:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626818176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (427us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1789130175.790702:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000004:00080000:3.0:1789130175.790908:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b38866da40/2, rc 0, transno 30064771141 00000100:00100000:3.0:1789130175.790914:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38866da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626818176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130175.795294:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604919040:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 112235us (112442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130175.795309:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:3.0:1789130175.810939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130175.811337:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919168 00000100:00100000:1.0:1789130175.811347:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919168 00000100:00100000:1.0:1789130175.811405:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130175.811416:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+91:2370:x1876037604919168:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789130175.942078:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130176.002960:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+91:2370:x1876037604919168:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 191533us (192018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130176.002975:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000001:00080000:0.0:1789130176.003122:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771141 is committed 00000001:00080000:0.0:1789130176.003132:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771140 is committed 00000100:00100000:3.0:1789130176.007063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.007165:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919424 00000100:00100000:0.0:1789130176.007176:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919424 00000100:00100000:0.0:1789130176.007239:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:0.0:1789130176.007249:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604919424:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130176.007313:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130176.007340:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9938 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd9e expref: 16 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.007359:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:0.0:1789130176.007375:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130176.007404:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.007418:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.007428:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130176.007771:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003d5d9cf1 reply state 000000000fb41035 transno 30064771287 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130176.007782:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130176.008012:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:34659:x1876037604919424:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 764us (959us total) trans 30064771287 rc 0/0 00000100:00100000:0.0:1789130176.008020:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:0.0:1789130176.012627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130176.012808:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012831:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012839:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012845:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130176.012849:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012857:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012873:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130176.012876:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130176.012881:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.012886:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce994d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.013131:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919552 00000100:00100000:3.0:1789130176.013141:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919552 00000100:00100000:3.0:1789130176.013230:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130176.013241:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604919552:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789130176.013518:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb size from disk: 42811392 -> 42811392 00002000:00010000:3.0:1789130176.013522:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb mtime from disk: 1789130175 -> 1789130171 00002000:00010000:3.0:1789130176.013525:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb atime from disk: 0 -> 1789130171 00002000:00010000:3.0:1789130176.013527:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb ctime from disk: 1789130175 -> 1789130171 00002000:00010000:3.0:1789130176.013529:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 83975 00000100:00100000:3.0:1789130176.013998:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2367:x1876037604919552:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 756us (1398us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1789130176.014007:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130176.018677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.018804:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919808 00000100:00100000:3.0:1789130176.018824:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919808 00000100:00100000:3.0:1789130176.018875:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 259 00000100:00100000:3.0:1789130176.018884:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:34659:x1876037604919808:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789130176.018961:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.018978:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.018988:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.019021:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 16 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.019035:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 16 pid: 38734 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.019049:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626818304:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130176.019135:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881ce780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130176.023588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130176.023723:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604919936 00000100:00100000:2.0:1789130176.023732:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604919936 00010000:00010000:2.0:1789130176.023805:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 17 pid: 38734 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130176.023857:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789130176.023867:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604919936:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130176.023883:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130176.023890:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 17 pid: 38734 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.023905:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 17 pid: 38734 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.023928:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130176.023933:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.023943:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.023950:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.023968:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130176.024017:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604919936:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 152us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130176.024025:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00010000:00010000:3.0:1789130176.024867:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce991c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd90 expref: 16 pid: 38734 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.024887:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626818304:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130176.024909:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024917:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024924:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024964:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024971:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024978:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024984:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130176.024990:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.024996:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.025009:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:3.0:1789130176.025012:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130176.025016:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.025023:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9954 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.025092:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:34659:x1876037604919808:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 6208us (6423us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130176.025100:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 259 00000100:00100000:1.0:1789130176.035048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.035134:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920064 00000100:00100000:3.0:1789130176.035144:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920064 00000100:00100000:3.0:1789130176.035204:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:3.0:1789130176.035231:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604920064:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789130176.035277:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.035296:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.035305:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc6:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789130176.035310:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130176.035315:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.035351:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.035378:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 9 pid: 38727 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.035393:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626818432:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130176.035474:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881ce780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130176.044139:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626818432:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130176.044169:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130176.213954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.214081:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920192 00000100:00100000:3.0:1789130176.214104:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920192 00010000:00010000:3.0:1789130176.214151:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130176.214212:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1789130176.214223:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604920192:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130176.214243:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130176.214275:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.214293:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.214316:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdac expref: 10 pid: 38727 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.214334:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130176.214338:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130176.214344:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.214355:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130176.214391:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130176.214455:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604920192:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 232us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130176.214473:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00010000:00010000:1.0:1789130176.214641:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214652:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214677:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214687:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214695:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214702:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130176.214707:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214715:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214728:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.214748:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d7e51d1/0x5c74554e47ce995b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130176.214822:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2368:x1876037604920064:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 179593us (179784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130176.214830:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:1.0:1789130176.225269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130176.225419:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920448 00000100:00100000:2.0:1789130176.225430:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920448 00000100:00100000:2.0:1789130176.225509:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:2.0:1789130176.225540:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:34659:x1876037604920448:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130176.225658:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.225678:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.225691:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.226117:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.226130:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 16 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.226139:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.226178:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 16 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.226202:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 16 pid: 36588 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130176.226216:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879fa580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626818560:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130176.226315:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130176.234485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130176.234591:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920576 00000100:00100000:2.0:1789130176.234631:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920576 00010000:00010000:2.0:1789130176.234695:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 17 pid: 36588 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130176.234732:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789130176.234742:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604920576:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130176.234774:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130176.234782:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 17 pid: 36588 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.234796:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 17 pid: 36588 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.234831:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130176.234837:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.234847:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.234854:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130176.234875:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130176.234935:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604920576:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130176.234945:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:1.0:1789130176.236832:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce992a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abd97 expref: 16 pid: 36588 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130176.236859:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879fa580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626818560:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130176.236886:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.236895:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.236901:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130176.237150:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771288 00000001:00080000:1.0:1789130176.237477:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771289 00000001:00080000:1.0:1789130176.237538:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771290 00000100:00100000:1.0:1789130176.237673:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626818688:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130176.237744:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130176.238006:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482bd6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130176.241251:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626818688 00000100:00100000:0.0:1789130176.241267:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626818688 00000100:00100000:0.0:1789130176.241340:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130176.241350:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626818688:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789130176.241534:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626818688:12345-0@lo:1000:mdt00_004.0 Request processed in 185us (3789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130176.241567:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130176.241762:0:38734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771141 gen 2 00000004:00080000:1.0:1789130176.241771:0:38734:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b38866da40, transno 30064771141 00000100:00100000:1.0:1789130176.241782:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626818688:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789130176.242519:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771291 00000100:00100000:1.0:1789130176.242659:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626818816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130176.242715:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130176.242745:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130176.242894:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626818816 00000100:00100000:3.0:1789130176.242900:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626818816 00000100:00100000:3.0:1789130176.242936:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130176.242943:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626818816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789130176.243174:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38734:x1876037626818816:12345-0@lo:1000:mdt00_004.0 Request processed in 231us (458us total) trans 30064771143 rc 0/0 00000100:00100000:3.0:1789130176.243181:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130176.243427:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626818816:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789130176.243526:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243538:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243547:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243554:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130176.243559:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243567:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243583:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:1.0:1789130176.243586:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130176.243592:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243598:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9969 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243679:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243686:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243692:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243697:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130176.243700:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243706:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243714:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130176.243717:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130176.243724:0:38734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243735:0:38734:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.243745:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.244012:0:38734:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 19 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130176.244040:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626818944:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130176.244213:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482bd66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130176.253056:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626818944:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130176.253092:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253103:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce989e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253137:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253153:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253165:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253175:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253456:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253466:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253473:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130176.253477:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253502:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253515:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130176.253518:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130176.253522:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253528:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9970 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253539:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253545:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253551:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253555:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130176.253558:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253564:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253572:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130176.253574:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130176.253577:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.253593:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9962 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130176.254178:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604920448:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 28635us (28914us total) trans 30064771292 rc 0/0 00000100:00100000:1.0:1789130176.254202:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 260 00000020:00080000:1.0:1789130176.254209:0:38734:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789130176.258518:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130176.258528:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789130176.259220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130176.259305:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920704 00000100:00100000:1.0:1789130176.259315:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920704 00000100:00100000:1.0:1789130176.259367:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130176.259378:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:34658:x1876037604920704:12345-192.168.201.39@tcp:49:dd.0 00000100:00100000:1.0:1789130176.259534:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:34658:x1876037604920704:12345-192.168.201.39@tcp:49:dd.0 Request processed in 156us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130176.259543:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000040:00080000:0.0:1789130176.260596:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 4 00000040:00080000:0.0:1789130176.260623:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130176.264567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130176.264694:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604920960 00000100:00100000:1.0:1789130176.264706:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604920960 00000100:00100000:1.0:1789130176.264766:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130176.264776:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:34659:x1876037604920960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130176.267482:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130176.267648:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771293 00010000:00010000:1.0:1789130176.267716:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267733:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267745:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267778:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267785:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267791:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.267815:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130176.267933:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:34659:x1876037604920960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3154us (3376us total) trans 30064771294 rc 0/0 00000100:00100000:1.0:1789130176.267944:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000020:00080000:1.0:1789130176.267951:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130176.271452:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130176.271467:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.271480:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130176.271484:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.271495:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.271517:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130176.271520:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130176.271525:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.271531:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9977 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130176.271556:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130176.271558:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130176.271559:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130176.272405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130176.273330:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921088 00000100:00100000:1.0:1789130176.273342:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921088 00000100:00100000:1.0:1789130176.273410:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130176.273421:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:34658:x1876037604921088:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130176.273452:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130176.273474:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abccc73/0x5c74554e47ce997e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdb3 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130176.273500:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 42811392, mtime: 0x6aa3f5bb, atime: 0x6aa3f5bb, ctime: 0x6aa3f5bb, blocks: 0x14807 00010000:00010000:1.0:1789130176.273523:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=1339s v=(0 0) 00010000:00010000:1.0:1789130176.273527:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130176.273538:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abccc73/0x5c74554e47ce997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdb3 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.273570:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abccc73/0x5c74554e47ce997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdb3 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130176.273583:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:1.0:1789130176.273673:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:34658:x1876037604921088:12345-192.168.201.39@tcp:101:dd.0 Request processed in 254us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130176.273681:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130176.329412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.329522:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921216 00000100:00100000:0.0:1789130176.329539:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921216 00002000:00100000:0.0:1789130176.329660:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (42991616->44040191) req@ffff90b3879f9a40 x1876037604921216/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.329696:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9a40 with x1876037604921216 ext(42991616->44040191) 00002000:00010000:0.0:1789130176.329704:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9a40 00000100:00100000:0.0:1789130176.329766:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789130176.329783:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604921216:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.361163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.364408:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921344 00000100:00100000:3.0:1789130176.364422:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921344 00002000:00100000:3.0:1789130176.364480:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (44040192->45088767) req@ffff90b3879f9e00 x1876037604921344/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.364492:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9e00 with x1876037604921344 ext(44040192->45088767) 00002000:00010000:3.0:1789130176.364499:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9e00 00000100:00100000:3.0:1789130176.364547:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130176.364557:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604921344:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130176.379663:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604921216:12345-192.168.201.39@tcp:4:dd.0 Request processed in 49873us (50252us total) trans 30064771144 rc 0/0 00000100:00100000:3.0:1789130176.379679:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00002000:00100000:3.0:1789130176.379693:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (42991616->44040191) req@ffff90b3879f9a40 x1876037604921216/t30064771144(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.379705:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9a40 with x1876037604921216 ext(42991616->44040191) 00002000:00010000:3.0:1789130176.379712:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9a40 00000100:00100000:3.0:1789130176.399891:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604921344:12345-192.168.201.39@tcp:4:dd.0 Request processed in 35320us (38724us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1789130176.399906:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00002000:00100000:3.0:1789130176.399921:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (44040192->45088767) req@ffff90b3879f9e00 x1876037604921344/t30064771145(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.399932:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f9e00 with x1876037604921344 ext(44040192->45088767) 00002000:00010000:3.0:1789130176.399939:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f9e00 00000100:00100000:1.0:1789130176.408893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.409118:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921472 00000100:00100000:3.0:1789130176.409131:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921472 00002000:00100000:3.0:1789130176.409235:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (45088768->46137343) req@ffff90b38975f480 x1876037604921472/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.409250:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975f480 with x1876037604921472 ext(45088768->46137343) 00002000:00010000:3.0:1789130176.409257:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975f480 00000100:00100000:3.0:1789130176.409296:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789130176.409308:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604921472:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.431531:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037604921472:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22212us (22638us total) trans 30064771146 rc 0/0 00000100:00100000:2.0:1789130176.431547:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00002000:00100000:2.0:1789130176.431561:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (45088768->46137343) req@ffff90b38975f480 x1876037604921472/t30064771146(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.431571:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975f480 with x1876037604921472 ext(45088768->46137343) 00002000:00010000:2.0:1789130176.431578:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975f480 00000100:00100000:0.0:1789130176.452831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.453822:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921600 00000100:00100000:3.0:1789130176.453837:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921600 00002000:00100000:3.0:1789130176.453906:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (46137344->47185919) req@ffff90b38866da40 x1876037604921600/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.453920:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866da40 with x1876037604921600 ext(46137344->47185919) 00002000:00010000:3.0:1789130176.453928:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866da40 00000100:00100000:3.0:1789130176.453954:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789130176.453965:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604921600:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130176.483362:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037604921600:12345-192.168.201.39@tcp:4:dd.0 Request processed in 29385us (30531us total) trans 30064771147 rc 0/0 00000100:00100000:3.0:1789130176.483395:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00002000:00100000:3.0:1789130176.483410:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (46137344->47185919) req@ffff90b38866da40 x1876037604921600/t30064771147(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.483421:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866da40 with x1876037604921600 ext(46137344->47185919) 00002000:00010000:3.0:1789130176.486071:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866da40 00000100:00100000:0.0:1789130176.491514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.491649:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921728 00000100:00100000:3.0:1789130176.491660:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921728 00002000:00100000:3.0:1789130176.491730:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (47185920->48234495) req@ffff90b38866ed00 x1876037604921728/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.491742:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866ed00 with x1876037604921728 ext(47185920->48234495) 00002000:00010000:3.0:1789130176.491748:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866ed00 00000100:00100000:3.0:1789130176.491781:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789130176.491791:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604921728:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130176.512238:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604921728:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20437us (20726us total) trans 30064771148 rc 0/0 00000100:00100000:3.0:1789130176.512255:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00002000:00100000:3.0:1789130176.512269:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (47185920->48234495) req@ffff90b38866ed00 x1876037604921728/t30064771148(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.512281:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866ed00 with x1876037604921728 ext(47185920->48234495) 00002000:00010000:3.0:1789130176.512289:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866ed00 00000100:00100000:0.0:1789130176.544789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130176.545182:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921856 00000100:00100000:1.0:1789130176.545194:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921856 00002000:00100000:1.0:1789130176.545252:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (48234496->49283071) req@ffff90b38866cf00 x1876037604921856/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130176.545263:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866cf00 with x1876037604921856 ext(48234496->49283071) 00002000:00010000:1.0:1789130176.545270:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866cf00 00000100:00100000:1.0:1789130176.545305:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130176.545315:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604921856:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130176.565678:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037604921856:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20346us (20886us total) trans 30064771149 rc 0/0 00000100:00100000:1.0:1789130176.565696:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00002000:00100000:1.0:1789130176.565714:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (48234496->49283071) req@ffff90b38866cf00 x1876037604921856/t30064771149(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130176.565727:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866cf00 with x1876037604921856 ext(48234496->49283071) 00002000:00010000:1.0:1789130176.565736:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866cf00 00000100:00100000:3.0:1789130176.587160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.587268:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604921984 00000100:00100000:0.0:1789130176.587278:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604921984 00002000:00100000:0.0:1789130176.587333:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (49283072->50331647) req@ffff90b389699a40 x1876037604921984/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.587344:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699a40 with x1876037604921984 ext(49283072->50331647) 00002000:00010000:0.0:1789130176.587351:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699a40 00000100:00100000:0.0:1789130176.587395:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130176.587406:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389699a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604921984:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130176.598952:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389699a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037604921984:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11536us (11791us total) trans 30064771150 rc 0/0 00000100:00100000:0.0:1789130176.598967:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00002000:00100000:0.0:1789130176.598981:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (49283072->50331647) req@ffff90b389699a40 x1876037604921984/t30064771150(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.598992:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699a40 with x1876037604921984 ext(49283072->50331647) 00002000:00010000:0.0:1789130176.599000:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699a40 00000100:00100000:2.0:1789130176.635031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.635184:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922112 00000100:00100000:0.0:1789130176.635213:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922112 00002000:00100000:0.0:1789130176.635268:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (50331648->51380223) req@ffff90b3879fad00 x1876037604922112/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.635280:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fad00 with x1876037604922112 ext(50331648->51380223) 00002000:00010000:0.0:1789130176.635286:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fad00 00000100:00100000:0.0:1789130176.635322:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:0.0:1789130176.635333:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604922112:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130176.657012:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604922112:12345-192.168.201.39@tcp:4:dd.0 Request processed in 21669us (21985us total) trans 30064771151 rc 0/0 00000100:00100000:0.0:1789130176.657030:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00002000:00100000:0.0:1789130176.657048:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (50331648->51380223) req@ffff90b3879fad00 x1876037604922112/t30064771151(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.657060:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fad00 with x1876037604922112 ext(50331648->51380223) 00002000:00010000:0.0:1789130176.657067:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fad00 00000100:00100000:2.0:1789130176.687100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.687204:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922240 00000100:00100000:3.0:1789130176.687214:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922240 00002000:00100000:3.0:1789130176.687279:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (51380224->52428799) req@ffff90b3879f8f00 x1876037604922240/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.687290:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8f00 with x1876037604922240 ext(51380224->52428799) 00002000:00010000:3.0:1789130176.687296:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8f00 00000100:00100000:3.0:1789130176.687333:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130176.687342:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604922240:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130176.734253:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604922240:12345-192.168.201.39@tcp:4:dd.0 Request processed in 46898us (47151us total) trans 30064771152 rc 0/0 00000100:00100000:0.0:1789130176.734267:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00002000:00100000:0.0:1789130176.734280:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (51380224->52428799) req@ffff90b3879f8f00 x1876037604922240/t30064771152(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.734292:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8f00 with x1876037604922240 ext(51380224->52428799) 00002000:00010000:0.0:1789130176.734298:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8f00 00000100:00100000:3.0:1789130176.750213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130176.750298:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922368 00000100:00100000:2.0:1789130176.750308:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922368 00002000:00100000:2.0:1789130176.750370:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (52428800->53477375) req@ffff90b389699e00 x1876037604922368/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.750381:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699e00 with x1876037604922368 ext(52428800->53477375) 00002000:00010000:2.0:1789130176.750387:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699e00 00000100:00100000:2.0:1789130176.750416:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789130176.750426:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389699e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604922368:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.773891:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389699e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604922368:12345-192.168.201.39@tcp:4:dd.0 Request processed in 23452us (23674us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1789130176.773908:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00002000:00100000:2.0:1789130176.773924:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (52428800->53477375) req@ffff90b389699e00 x1876037604922368/t30064771153(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.773962:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699e00 with x1876037604922368 ext(52428800->53477375) 00002000:00010000:2.0:1789130176.773970:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699e00 00000100:00100000:0.0:1789130176.778039:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130176.778073:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626819072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130176.778165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130176.778392:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819072 00000100:00100000:2.0:1789130176.778403:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819072 00000100:00100000:2.0:1789130176.778631:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130176.778644:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626819072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130176.778675:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 154992640 pending 17039360 free 3808428032 avail 3806330880 00000100:00100000:2.0:1789130176.778737:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626819072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130176.778744:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130176.778935:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626819072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130176.790877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.791241:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922496 00000100:00100000:3.0:1789130176.791252:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922496 00002000:00100000:3.0:1789130176.791314:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (53477376->54525951) req@ffff90b38975da40 x1876037604922496/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.791326:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975da40 with x1876037604922496 ext(53477376->54525951) 00002000:00010000:3.0:1789130176.791334:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975da40 00000100:00100000:3.0:1789130176.791380:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130176.791390:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604922496:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.815230:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604922496:12345-192.168.201.39@tcp:4:dd.0 Request processed in 23828us (24352us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1789130176.815247:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00002000:00100000:2.0:1789130176.815265:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (53477376->54525951) req@ffff90b38975da40 x1876037604922496/t30064771154(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.815276:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975da40 with x1876037604922496 ext(53477376->54525951) 00002000:00010000:2.0:1789130176.815283:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975da40 00000100:00100000:1.0:1789130176.838956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.839171:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922624 00000100:00100000:0.0:1789130176.839182:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922624 00002000:00100000:0.0:1789130176.839251:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (54525952->55574527) req@ffff90b38975de00 x1876037604922624/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.839264:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975de00 with x1876037604922624 ext(54525952->55574527) 00002000:00010000:0.0:1789130176.839275:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975de00 00000100:00100000:0.0:1789130176.839318:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1789130176.839331:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:2368:x1876037604922624:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.855170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130176.855344:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922752 00000100:00100000:0.0:1789130176.855365:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922752 00002000:00100000:0.0:1789130176.855420:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (55574528->56623103) req@ffff90b3879f8780 x1876037604922752/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.855444:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8780 with x1876037604922752 ext(55574528->56623103) 00002000:00010000:0.0:1789130176.855450:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8780 00000100:00100000:0.0:1789130176.855485:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130176.855496:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:2369:x1876037604922752:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130176.892956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.893415:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604922880 00000100:00100000:3.0:1789130176.893426:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604922880 00002000:00100000:3.0:1789130176.893478:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (56623104->57671679) req@ffff90b38866d680 x1876037604922880/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.893490:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866d680 with x1876037604922880 ext(56623104->57671679) 00002000:00010000:3.0:1789130176.893496:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866d680 00000100:00100000:3.0:1789130176.893531:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1789130176.893693:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604922880:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130176.922446:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:2368:x1876037604922624:12345-192.168.201.39@tcp:4:dd.0 Request processed in 83106us (83489us total) trans 30064771155 rc 0/0 00000100:00100000:0.0:1789130176.922462:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00002000:00100000:0.0:1789130176.923162:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (54525952->55574527) req@ffff90b38975de00 x1876037604922624/t30064771155(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130176.923244:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975de00 with x1876037604922624 ext(54525952->55574527) 00002000:00010000:0.0:1789130176.923256:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975de00 00000100:00100000:0.0:1789130176.937155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130176.937766:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923008 00000100:00100000:3.0:1789130176.937791:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923008 00002000:00100000:3.0:1789130176.937872:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (57671680->58720255) req@ffff90b38866c3c0 x1876037604923008/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.937886:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866c3c0 with x1876037604923008 ext(57671680->58720255) 00002000:00010000:3.0:1789130176.937893:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866c3c0 00000100:00100000:3.0:1789130176.937928:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:3.0:1789130176.937938:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604923008:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.950291:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604922752:12345-192.168.201.39@tcp:4:dd.0 Request processed in 94672us (95007us total) trans 30064771156 rc 0/0 00000100:00100000:2.0:1789130176.950307:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00002000:00100000:2.0:1789130176.950323:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (55574528->56623103) req@ffff90b3879f8780 x1876037604922752/t30064771156(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.950351:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879f8780 with x1876037604922752 ext(55574528->56623103) 00002000:00010000:2.0:1789130176.950359:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879f8780 00000100:00100000:0.0:1789130176.956058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130176.964144:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923136 00000100:00100000:2.0:1789130176.964161:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923136 00002000:00100000:2.0:1789130176.964236:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (58720256->59768831) req@ffff90b38866fc00 x1876037604923136/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/0 e 0 to 0 dl 1789130187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.964248:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866fc00 with x1876037604923136 ext(58720256->59768831) 00002000:00010000:2.0:1789130176.964255:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866fc00 00000100:00100000:2.0:1789130176.964285:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130176.964295:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604923136:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130176.965445:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604922880:12345-192.168.201.39@tcp:4:dd.0 Request processed in 71750us (72497us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1789130176.965457:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00002000:00100000:2.0:1789130176.965476:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc6:0x0] (56623104->57671679) req@ffff90b38866d680 x1876037604922880/t30064771157(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130176.965487:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866d680 with x1876037604922880 ext(56623104->57671679) 00002000:00010000:2.0:1789130176.965492:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866d680 00010000:00010000:3.0:1789130176.969023:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130176.982093:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604923008:12345-192.168.201.39@tcp:4:dd.0 Request processed in 44144us (44935us total) trans 30064771158 rc 0/0 00000100:00100000:3.0:1789130176.982108:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00002000:00100000:3.0:1789130176.982123:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (57671680->58720255) req@ffff90b38866c3c0 x1876037604923008/t30064771158(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130176.982134:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866c3c0 with x1876037604923008 ext(57671680->58720255) 00002000:00010000:3.0:1789130176.982141:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866c3c0 00000100:00100000:1.0:1789130177.009279:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604923136:12345-192.168.201.39@tcp:4:dd.0 Request processed in 44973us (53221us total) trans 30064771159 rc 0/0 00000100:00100000:1.0:1789130177.009298:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00002000:00100000:1.0:1789130177.009315:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc6:0x0] (58720256->59768831) req@ffff90b38866fc00 x1876037604923136/t30064771159(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:647/0 lens 488/448 e 0 to 0 dl 1789130187 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130177.009326:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866fc00 with x1876037604923136 ext(58720256->59768831) 00002000:00010000:1.0:1789130177.009334:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866fc00 00000100:00100000:0.0:1789130177.031595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130177.031802:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923264 00000100:00100000:2.0:1789130177.031814:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923264 00002000:00100000:2.0:1789130177.031908:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (59768832->60817407) req@ffff90b38866cb40 x1876037604923264/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/0 e 0 to 0 dl 1789130188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00080000:3.0:1789130177.031910:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1789130177.031928:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866cb40 with x1876037604923264 ext(59768832->60817407) 00002000:00010000:2.0:1789130177.031938:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866cb40 00000100:00100000:2.0:1789130177.032006:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789130177.032018:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604923264:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130177.052830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.052883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.052918:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923776 00000100:00100000:3.0:1789130177.052932:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923776 00000100:00100000:3.0:1789130177.053024:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130177.053038:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604923776:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130177.053145:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604923776:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130177.053154:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00080000:3.0:1789130177.053200:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130177.053233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.053263:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923648 00000100:00100000:3.0:1789130177.053268:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923648 00000100:00100000:3.0:1789130177.053308:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789130177.053315:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604923648:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130177.053358:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604923648:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130177.053366:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00080000:3.0:1789130177.053382:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130177.053464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.053486:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923904 00000100:00100000:3.0:1789130177.053490:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923904 00000100:00100000:3.0:1789130177.053521:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130177.053528:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604923904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130177.053555:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037604923904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130177.053561:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00080000:3.0:1789130177.053576:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130177.055528:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923520 00000100:00100000:0.0:1789130177.055549:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923520 00000100:00100000:0.0:1789130177.055669:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:0.0:1789130177.055681:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604923520:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130177.055763:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604923520:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130177.055773:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:1.0:1789130177.067737:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+43:2370:x1876037604923264:12345-192.168.201.39@tcp:4:dd.0 Request processed in 35710us (36141us total) trans 30064771160 rc 0/0 00000100:00100000:1.0:1789130177.067753:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00002000:00100000:1.0:1789130177.067768:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc6:0x0] (59768832->60817407) req@ffff90b38866cb40 x1876037604923264/t30064771160(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/448 e 0 to 0 dl 1789130188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130177.067779:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866cb40 with x1876037604923264 ext(59768832->60817407) 00002000:00010000:1.0:1789130177.067787:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38866cb40 00000100:00100000:2.0:1789130177.069171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130177.074021:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604923392 00000100:00100000:1.0:1789130177.074041:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604923392 00002000:00100000:1.0:1789130177.074111:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (60817408->61865983) req@ffff90b3879fa580 x1876037604923392/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/0 e 0 to 0 dl 1789130188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130177.074124:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa580 with x1876037604923392 ext(60817408->61865983) 00002000:00010000:1.0:1789130177.074132:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fa580 00000100:00100000:1.0:1789130177.074174:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:1.0:1789130177.074186:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:2370:x1876037604923392:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130177.107479:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+45:2370:x1876037604923392:12345-192.168.201.39@tcp:4:dd.0 Request processed in 33277us (38300us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1789130177.107497:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00002000:00100000:1.0:1789130177.107514:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (60817408->61865983) req@ffff90b3879fa580 x1876037604923392/t30064771161(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/448 e 0 to 0 dl 1789130188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130177.107526:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa580 with x1876037604923392 ext(60817408->61865983) 00002000:00010000:1.0:1789130177.107535:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fa580 00000100:00100000:3.0:1789130177.108954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.109084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130177.109243:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924032 00000100:00100000:0.0:1789130177.109257:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924032 00002000:00100000:0.0:1789130177.109317:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (61865984->62914559) req@ffff90b3896983c0 x1876037604924032/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/0 e 0 to 0 dl 1789130188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130177.109330:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3896983c0 with x1876037604924032 ext(61865984->62914559) 00002000:00010000:0.0:1789130177.109337:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3896983c0 00000100:00100000:0.0:1789130177.109378:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1789130177.109389:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3896983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:2367:x1876037604924032:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130177.109961:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924288 00000100:00100000:1.0:1789130177.109967:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924288 00000100:00100000:1.0:1789130177.110012:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1789130177.110021:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:34658:x1876037604924288:12345-192.168.201.39@tcp:35:dd.0 00000001:00080000:1.0:1789130177.110340:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771295 00000001:00080000:1.0:1789130177.110398:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771296 00000100:00100000:1.0:1789130177.110527:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:34658:x1876037604924288:12345-192.168.201.39@tcp:35:dd.0 Request processed in 506us (1583us total) trans 30064771297 rc 0/0 00000100:00100000:1.0:1789130177.110535:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000020:00080000:1.0:1789130177.110541:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789130177.143069:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3896983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+47:2367:x1876037604924032:12345-192.168.201.39@tcp:4:dd.0 Request processed in 33653us (33955us total) trans 30064771162 rc 0/0 00000100:00100000:0.0:1789130177.143091:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00002000:00100000:0.0:1789130177.143112:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (61865984->62914559) req@ffff90b3896983c0 x1876037604924032/t30064771162(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:648/0 lens 488/448 e 0 to 0 dl 1789130188 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130177.143125:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3896983c0 with x1876037604924032 ext(61865984->62914559) 00002000:00010000:0.0:1789130177.143134:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3896983c0 00000100:00100000:3.0:1789130177.266062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130177.266225:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924416 00000100:00100000:1.0:1789130177.266239:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924416 00000100:00100000:1.0:1789130177.266335:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:1.0:1789130177.266349:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:34670:x1876037604924416:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130177.266387:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130177.266429:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdba expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.266541:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.266597:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.266651:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130177.267042:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130177.267048:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130177.267136:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.267179:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdba expref: 26 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.267203:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdba expref: 25 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130177.267214:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:1.0:1789130177.267218:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130177.267222:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:1.0:1789130177.267319:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:34670:x1876037604924416:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 972us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130177.267328:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:2.0:1789130177.271182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130177.271346:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924544 00000100:00100000:3.0:1789130177.271361:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924544 00000100:00100000:3.0:1789130177.271448:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:3.0:1789130177.271461:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:34670:x1876037604924544:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130177.271763:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.271805:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.271821:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.271841:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.271848:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.271855:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272259:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272269:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272277:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130177.272327:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272343:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272349:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272384:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272391:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130177.272397:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272407:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272425:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:3.0:1789130177.272429:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130177.272438:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272445:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272462:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272469:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272475:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272481:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130177.272484:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272500:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272509:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b488939400) 00010000:00010000:3.0:1789130177.272512:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130177.272515:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272521:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce999a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272539:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272546:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272553:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272558:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130177.272561:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272568:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272575:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:3.0:1789130177.272578:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130177.272582:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130177.272598:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce99a1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130177.273999:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:34670:x1876037604924544:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2532us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130177.274014:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:2.0:1789130177.410175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130177.410285:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924672 00000100:00100000:0.0:1789130177.410297:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924672 00000100:00100000:0.0:1789130177.410381:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 263 00000100:00100000:0.0:1789130177.410392:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:34677:x1876037604924672:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789130177.410427:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130177.410453:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdc1 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410530:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410557:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410570:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410587:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410594:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.410857:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411193:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411204:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411224:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130177.411266:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 62914560 00000004:00200000:0.0:1789130177.411272:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130177.411316:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411328:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411337:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411344:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411351:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411358:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130177.411364:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411372:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411386:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:0.0:1789130177.411389:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130177.411394:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411410:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce99af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411426:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411432:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411438:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411444:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130177.411446:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411452:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411459:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130177.411461:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130177.411463:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411468:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce99b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411503:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc1 expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411526:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc1 expref: 26 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130177.411534:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:0.0:1789130177.411536:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130177.411539:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b800, rc 0) 00000100:00100000:0.0:1789130177.412081:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:34677:x1876037604924672:12345-192.168.201.39@tcp:101:stat.0 Request processed in 1684us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130177.412093:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 263 00010000:00010000:0.0:1789130177.990123:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130179.013898:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130180.038718:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130180.870294:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38685d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626819200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130180.870399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.870485:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626819712:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.870517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.870548:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130180.870554:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626819328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.870586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.870635:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626819840:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.870658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.870704:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626819584:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.870744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.870766:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789130180.870772:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626819456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130180.871274:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819584 00000100:00100000:0.0:1789130180.871286:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819584 00000100:00100000:0.0:1789130180.871361:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130180.871373:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626819584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130180.871448:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626819584:12345-0@lo:400:kworker.0 Request processed in 77us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130180.871457:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130180.872714:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819712 00000100:00100000:0.0:1789130180.872738:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819712 00000100:00100000:0.0:1789130180.872860:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819840 00000100:00100000:0.0:1789130180.872866:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819840 00000100:00100000:0.0:1789130180.872903:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130180.872915:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130180.873015:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626819712:12345-0@lo:400:kworker.0 Request processed in 102us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130180.873043:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130180.873078:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130180.873086:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130180.873123:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626819840:12345-0@lo:400:kworker.0 Request processed in 39us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130180.873130:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130180.873154:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819328 00000100:00100000:0.0:1789130180.873158:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819328 00000100:00100000:0.0:1789130180.873187:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789130180.873193:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130180.873241:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626819328:12345-0@lo:400:kworker.0 Request processed in 48us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130180.873248:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789130180.873923:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130180.873932:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130180.873983:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626819328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874006:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626819840:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874041:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626819712:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.874174:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3873530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626819968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130180.874231:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626819584:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874259:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819456 00000100:00100000:3.0:1789130180.874264:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819456 00000100:00100000:3.0:1789130180.874315:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130180.874325:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626819456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874376:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626819456:12345-0@lo:400:kworker.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130180.874384:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130180.874408:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819968 00000100:00100000:3.0:1789130180.874412:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819968 00000100:00100000:3.0:1789130180.874442:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130180.874450:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626819968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874484:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626819968:12345-0@lo:400:kworker.0 Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130180.874491:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789130180.874505:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130180.874509:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130180.874533:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626819456:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874544:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3873530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626819968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130180.874626:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626819200 00000100:00100000:3.0:1789130180.874630:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626819200 00000100:00100000:3.0:1789130180.874672:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789130180.874679:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626819200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130180.874716:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130180.874772:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626819200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130180.874789:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789130180.875776:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38685d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626819200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130181.063737:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130181.100854:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771287 is committed 00000001:00080000:2.0:1789130181.100870:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771297 is committed 00000020:00080000:2.0:1789130181.100888:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b482bd6c00 refcount 2 committed 0 result 0 batchid 25769803906 00000020:00080000:2.0:1789130181.100894:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b482bd6a80 00000020:00080000:2.0:1789130181.100898:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3873b5000 00000020:00080000:1.0:1789130181.101922:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803906 committed batchid 25769803905 00000020:00080000:1.0:1789130181.102182:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803905 00000001:00080000:1.0:1789130181.155444:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771162 is committed 00000001:00080000:1.0:1789130181.155575:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771143 is committed 00000100:00100000:0.0:1789130181.895978:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626820096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130181.896095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130181.896967:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820096 00000100:00100000:2.0:1789130181.896982:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820096 00000100:00100000:2.0:1789130181.897059:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789130181.897073:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626820096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130181.897131:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 5111808 granted 153288704 pending 0 free 3788505088 avail 3786407936 00000100:00100000:2.0:1789130181.897223:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626820096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130181.897233:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130181.897397:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771143 gen 2 00000004:00080000:1.0:1789130181.897428:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771143 committed transno 30064771143 00000100:00100000:1.0:1789130181.897470:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626820096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130182.086049:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130182.199851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130182.199900:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924800 00000100:00100000:0.0:1789130182.199904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130182.199917:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924800 00000100:00100000:0.0:1789130182.199940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130182.199963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130182.199984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130182.200000:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789130182.200007:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604924928 00000100:00100000:0.0:1789130182.200010:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604924928 00000100:00100000:2.0:1789130182.200013:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604924800:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130182.200059:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925312 00000100:00100000:0.0:1789130182.200063:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925312 00000100:00100000:0.0:1789130182.200085:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:0.0:1789130182.200092:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604924928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130182.200134:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604924800:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130182.200153:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789130182.200153:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604924928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 62us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130182.200160:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:0.0:1789130182.200174:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130182.200180:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604925312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130182.200201:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604925312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 21us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130182.200207:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130182.200230:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925056 00000100:00100000:0.0:1789130182.200234:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925056 00000100:00100000:0.0:1789130182.200264:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925184 00000100:00100000:0.0:1789130182.202671:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925184 00000100:00100000:0.0:1789130182.202926:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1789130182.202940:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604925056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130182.203067:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604925056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 130us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130182.203075:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1789130182.203095:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130182.203102:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604925184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130182.208389:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+5:2368:x1876037604925184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 5267us (8404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130182.208411:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00080000:0.0:1789130182.208487:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130182.208496:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130182.208500:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130183.109840:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130184.134355:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130184.985547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130184.986735:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925440 00000100:00100000:3.0:1789130184.986748:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925440 00000100:00100000:3.0:1789130184.986842:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:3.0:1789130184.986854:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:34621:x1876037604925440:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789130184.987083:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:34621:x1876037604925440:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 230us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130184.987092:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00080000:0.0:1789130184.988840:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130184.994297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130184.994488:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925696 00000100:00100000:0.0:1789130184.994499:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925696 00000100:00100000:0.0:1789130184.994555:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:0.0:1789130184.994564:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4813ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:34621:x1876037604925696:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130184.995147:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4813ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:34621:x1876037604925696:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 583us (870us total) trans 30064771298 rc 0/0 00000100:00100000:0.0:1789130184.995156:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00010000:00010000:3.0:1789130185.158047:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130185.383061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130185.383141:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925824 00000100:00100000:0.0:1789130185.383152:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925824 00000100:00100000:0.0:1789130185.383231:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 265 00000100:00100000:0.0:1789130185.383241:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:35117:x1876037604925824:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130185.383262:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130185.383289:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce99c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdc8 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383351:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383365:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383377:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130185.383684:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130185.383688:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130185.383768:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383799:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce99c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 7 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383817:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 6 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130185.383826:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:0.0:1789130185.383828:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130185.383832:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:0.0:1789130185.383896:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:35117:x1876037604925824:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 655us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130185.383903:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 265 00000100:00080000:3.0:1789130185.386147:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130185.754240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130185.754398:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604925952 00000100:00100000:1.0:1789130185.754409:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604925952 00002000:00100000:1.0:1789130185.754482:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc5:0x0] (0->11) req@ffff90b3873530c0 x1876037604925952/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:656/0 lens 504/0 e 0 to 0 dl 1789130196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130185.754496:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873530c0 with x1876037604925952 ext(0->11) 00002000:00010000:1.0:1789130185.754502:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3873530c0 00000100:00100000:1.0:1789130185.754542:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130185.754554:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2368:x1876037604925952:12345-192.168.201.39@tcp:4:cat.0 00000100:00100000:1.0:1789130185.755440:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604925952:12345-192.168.201.39@tcp:4:cat.0 Request processed in 884us (1206us total) trans 30064771163 rc 0/0 00000100:00100000:1.0:1789130185.755452:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00002000:00100000:1.0:1789130185.755461:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc5:0x0] (0->11) req@ffff90b3873530c0 x1876037604925952/t30064771163(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:656/0 lens 504/448 e 0 to 0 dl 1789130196 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130185.755472:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873530c0 with x1876037604925952 ext(0->11) 00002000:00010000:1.0:1789130185.755477:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3873530c0 00000100:00080000:3.0:1789130185.757804:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130185.991959:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130185.991988:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626820224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130185.992067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130185.992133:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820224 00000100:00100000:3.0:1789130185.992140:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820224 00000100:00100000:3.0:1789130185.992190:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130185.992214:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626820224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130185.992247:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789130185.992284:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626820224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130185.992289:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130185.992324:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626820224:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130185.992357:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130185.996391:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626820352:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.996483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130185.996545:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626820864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.996577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130185.996625:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130185.996642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626820736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.996668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130185.996720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626820480:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.996752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130185.996773:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130185.996778:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626820608:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.996802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130185.996838:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820864 00000100:00100000:1.0:1789130185.996846:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820864 00000100:00100000:1.0:1789130185.996897:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820736 00000100:00100000:1.0:1789130185.996901:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820736 00000100:00100000:1.0:1789130185.996922:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820608 00000100:00100000:1.0:1789130185.996925:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820608 00000100:00100000:1.0:1789130185.996943:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130185.996954:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.997014:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626820864:12345-0@lo:400:kworker.0 Request processed in 61us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130185.997024:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130185.997041:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789130185.997048:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626820736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.997076:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626820736:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130185.997083:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789130185.997096:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789130185.997102:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626820608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.997135:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626820608:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130185.997142:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789130185.997179:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626820736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.997204:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626820864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130185.997237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626820608:0@lo:400:kworker.0 00000100:00100000:2.0:1789130185.997525:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820352 00000100:00100000:2.0:1789130185.997531:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820352 00000100:00100000:2.0:1789130185.997577:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789130185.997586:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626820352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130185.997667:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626820352:12345-0@lo:400:kworker.0 Request processed in 83us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130185.997676:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789130185.998269:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820480 00000100:00100000:3.0:1789130185.998274:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820480 00000100:00100000:3.0:1789130185.998326:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130185.998334:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626820480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130185.998382:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626820480:12345-0@lo:400:kworker.0 Request processed in 49us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130185.998389:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130185.998425:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626820480:0@lo:400:kworker.0 00000100:00080000:3.0:1789130185.998447:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130185.998452:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130186.000783:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626820352:0@lo:400:kworker.0 00000001:00080000:3.0:1789130186.176492:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771298 is committed 00000020:00080000:3.0:1789130186.176527:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803906 batchid updated 00000020:00080000:0.0:1789130186.177896:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000020:00080000:0.0:1789130186.177916:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00010000:00010000:2.0:1789130186.184780:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130186.274243:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771163 is committed 00000040:00080000:3.0:1789130186.501987:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130186.501997:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130186.502114:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 4 00000040:00080000:3.0:1789130186.502122:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130187.014671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626820992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130187.014747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130187.015029:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626820992 00000100:00100000:1.0:1789130187.015037:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626820992 00000100:00100000:1.0:1789130187.015099:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130187.015110:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626820992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130187.015143:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 154992640 pending 0 free 3788505088 avail 3786407936 00000100:00100000:1.0:1789130187.015195:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626820992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130187.015203:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789130187.015267:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130187.015409:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626820992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130187.205843:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130187.292256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130187.292306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130187.292345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130187.292376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130187.292402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130187.292504:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926080 00000100:00100000:0.0:1789130187.292514:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926080 00000100:00100000:0.0:1789130187.292574:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:0.0:1789130187.292585:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604926080:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130187.292803:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604926080:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 219us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130187.292812:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:0.0:1789130187.292851:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926336 00000100:00100000:0.0:1789130187.292855:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926336 00000100:00100000:0.0:1789130187.292893:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926464 00000100:00100000:0.0:1789130187.292895:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926464 00000100:00100000:0.0:1789130187.292915:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130187.292940:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604926336:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130187.293319:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604926336:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 380us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130187.293326:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130187.293340:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:0.0:1789130187.293347:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604926464:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130187.293369:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+5:2367:x1876037604926464:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130187.293375:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00080000:3.0:1789130187.293631:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130187.293636:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130187.293748:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926592 00000100:00100000:1.0:1789130187.293753:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926592 00000100:00100000:1.0:1789130187.293810:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926208 00000100:00100000:1.0:1789130187.293813:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926208 00000100:00100000:1.0:1789130187.293836:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789130187.293843:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604926592:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130187.293879:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604926592:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130187.293887:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789130187.293898:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130187.293905:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604926208:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130187.293934:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604926208:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130187.293948:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00080000:3.0:1789130187.294389:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130188.234986:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130189.254084:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130190.277832:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130191.109859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626821504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.109929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.109985:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789130191.109992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626821120:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.110043:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626821632:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.110106:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626821248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.110154:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626821760:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.110193:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130191.110198:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626821376:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130191.110248:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821504 00000100:00100000:0.0:1789130191.110262:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821504 00000100:00100000:0.0:1789130191.110304:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821632 00000100:00100000:0.0:1789130191.110308:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821632 00000100:00100000:0.0:1789130191.110336:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821760 00000100:00100000:0.0:1789130191.110339:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821760 00000100:00100000:0.0:1789130191.110356:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789130191.110363:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626821504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110417:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626821504:12345-0@lo:400:kworker.0 Request processed in 53us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110425:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789130191.110439:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130191.110445:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626821632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110471:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626821632:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110476:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130191.110486:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130191.110491:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110517:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626821760:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110523:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130191.110538:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821120 00000100:00100000:0.0:1789130191.110590:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821120 00000100:00100000:0.0:1789130191.110649:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789130191.110656:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110687:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626821120:12345-0@lo:400:kworker.0 Request processed in 32us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110694:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789130191.110734:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821248 00000100:00100000:0.0:1789130191.110737:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821248 00000100:00100000:0.0:1789130191.110761:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821376 00000100:00100000:0.0:1789130191.110764:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821376 00000100:00100000:0.0:1789130191.110786:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789130191.110792:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626821248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110824:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626821248:12345-0@lo:400:kworker.0 Request processed in 32us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110830:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789130191.110840:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130191.110846:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626821376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.110873:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626821376:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130191.110878:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789130191.110901:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130191.110905:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130191.110907:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130191.111222:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626821376:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.111234:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626821248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.111244:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626821760:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.111288:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626821120:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.111297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626821632:0@lo:400:kworker.0 00000100:00100000:0.0:1789130191.111305:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626821504:0@lo:400:kworker.0 00000100:00100000:2.0:1789130191.125857:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626821888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130191.125931:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130191.125988:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626821888 00000100:00100000:2.0:1789130191.125996:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626821888 00000100:00100000:2.0:1789130191.126042:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130191.126051:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626821888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130191.126084:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789130191.126138:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626821888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130191.126146:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130191.126191:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626821888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130191.312261:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130191.507383:0:39765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 08:36:29 (1789130189) 00000100:00100000:2.0:1789130192.134828:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626822016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130192.134908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130192.138865:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626822016 00000100:00100000:1.0:1789130192.138882:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626822016 00000100:00100000:1.0:1789130192.139388:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130192.139402:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626822016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130192.139443:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 154992640 pending 0 free 3788505088 avail 3786407936 00000100:00100000:1.0:1789130192.139533:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626822016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130192.139540:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130192.139641:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626822016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130192.329619:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130192.414857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130192.414912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130192.414960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130192.414993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130192.415023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130192.415053:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926976 00000100:00100000:2.0:1789130192.415063:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926976 00000100:00100000:2.0:1789130192.415126:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927104 00000100:00100000:2.0:1789130192.415130:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927104 00000100:00100000:3.0:1789130192.415153:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926720 00000100:00100000:3.0:1789130192.415159:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926720 00000100:00100000:2.0:1789130192.415163:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130192.415177:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604926976:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130192.415207:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:3.0:1789130192.415215:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604926720:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130192.415309:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604926848 00000100:00100000:1.0:1789130192.415313:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604926848 00000100:00100000:1.0:1789130192.415347:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927232 00000100:00100000:1.0:1789130192.415350:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927232 00000100:00100000:1.0:1789130192.415373:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130192.415381:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604926848:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130192.415432:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604926976:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130192.415441:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130192.415459:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789130192.415466:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+5:2366:x1876037604927104:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1789130192.415486:0:37276:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce959c 00000100:00080000:2.0:1789130192.415507:0:37276:0:(import.c:65:import_set_state_nolock()) ffff90b381df4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130192.415563:0:37276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771095 00000100:00100000:0.0:1789130192.415890:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130192.415901:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604927232:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130192.416611:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604926720:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1324us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130192.416623:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00080000:3.0:1789130192.416767:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130192.416772:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130192.416774:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130192.417677:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130192.419630:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604926848:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 4238us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130192.419647:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130192.420634:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+2:2366:x1876037604927104:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 5159us (5602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130192.420651:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130192.422885:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037604927232:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 6972us (7958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130192.422904:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00010000:00010000:2.0:1789130193.355377:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130194.084739:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.085067:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927488 00000100:00100000:0.0:1789130194.085090:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927488 00000100:00100000:0.0:1789130194.085179:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:0.0:1789130194.085190:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:35399:x1876037604927488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130194.085211:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130194.085232:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce99d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdcf expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085314:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085329:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085342:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085357:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085364:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.085370:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130194.085973:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130194.086311:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086323:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086331:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130194.086340:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130194.086551:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086560:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086567:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086573:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130194.086578:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086584:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086596:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130194.086599:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130194.086627:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086643:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce99d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086655:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086660:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086665:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086670:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130194.086673:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086678:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086685:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130194.086688:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130194.086691:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.086696:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce99e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.087741:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce99d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdcf expref: 18 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.088021:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdcf expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.088175:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130194.088180:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130194.088184:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b600, rc 0) 00000100:00100000:0.0:1789130194.088349:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:35399:x1876037604927488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3160us (3619us total) trans 30064771299 rc 0/0 00000100:00100000:0.0:1789130194.088362:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:2.0:1789130194.115668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.115727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.115817:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927744 00000100:00100000:0.0:1789130194.115832:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927744 00000100:00100000:0.0:1789130194.115934:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130194.115945:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037604927744:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130194.115961:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130194.115986:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdcf expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.116006:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130194.116012:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130194.116105:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:2368:x1876037604927744:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 161us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130194.116113:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789130194.116246:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927616 00000100:00100000:3.0:1789130194.116257:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927616 00000100:00100000:3.0:1789130194.116336:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 267 00000100:00100000:3.0:1789130194.116348:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:35399:x1876037604927616:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130194.116473:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:35399:x1876037604927616:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 126us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130194.116482:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 267 00000100:00100000:3.0:1789130194.296691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.296743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.296790:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928128 00000100:00100000:0.0:1789130194.296811:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928128 00000100:00100000:0.0:1789130194.296896:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604927872 00000100:00100000:0.0:1789130194.296914:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604927872 00000100:00100000:0.0:1789130194.296956:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:0.0:1789130194.296966:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:35414:x1876037604928128:12345-192.168.201.39@tcp:36:mkdir.0 00000100:00100000:1.0:1789130194.296983:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 269 00000100:00100000:1.0:1789130194.296994:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604927872:12345-192.168.201.39@tcp:41:mkdir.0 00010000:00010000:0.0:1789130194.297023:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00000024:1.0:1789130194.297029:0:36587:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00010000:00010000:0.0:1789130194.297053:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce998c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdba expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.297073:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:0.0:1789130194.297079:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130194.297111:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:2367:x1876037604927872:12345-192.168.201.39@tcp:41:mkdir.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130194.297118:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 269 00010000:00010000:0.0:1789130194.297406:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.297421:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.297430:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.297468:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.297483:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 5 pid: 38734 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130194.297512:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38295d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626822144:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130194.297592:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130194.306745:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38295d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626822144:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130194.306780:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130194.307291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.307594:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928256 00000100:00100000:0.0:1789130194.307628:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928256 00010000:00010000:0.0:1789130194.307718:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 6 pid: 38734 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130194.307759:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1789130194.307768:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604928256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130194.307783:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130194.307791:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 6 pid: 38734 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307804:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 6 pid: 38734 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307826:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce99cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc8 expref: 6 pid: 38734 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307844:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:0.0:1789130194.307849:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307859:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307878:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130194.307910:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130194.307964:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604928256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 196us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130194.307972:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00010000:00010000:2.0:1789130194.308041:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.308049:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.308075:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.308084:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.308092:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130194.309535:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00010000:00010000:2.0:1789130194.309551:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309560:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309567:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309598:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130194.309627:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309636:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309649:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd100) 00010000:00010000:2.0:1789130194.309652:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130194.309657:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.309663:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce99f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130194.309684:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000057f30b2a reply state 00000000cdbffe16 transno 30064771300 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130194.309694:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130194.309772:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:35414:x1876037604928128:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 12805us (13097us total) trans 30064771300 rc 0/0 00000100:00100000:2.0:1789130194.309781:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00080000:3.0:1789130194.312830:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130194.313052:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313066:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313074:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313095:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130194.313100:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313107:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313188:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130194.313192:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130194.313199:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.313206:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce99fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130194.334189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.334688:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928384 00000100:00100000:3.0:1789130194.334701:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928384 00000100:00100000:3.0:1789130194.334765:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:3.0:1789130194.334775:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:35415:x1876037604928384:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130194.334801:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130194.334825:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdd6 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.334894:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.334909:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.334920:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130194.334984:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130194.334988:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130194.335017:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.335044:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce9a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdd6 expref: 18 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.335062:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdd6 expref: 17 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.335071:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130194.335074:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130194.335091:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86800, rc 0) 00000100:00100000:3.0:1789130194.335182:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:35415:x1876037604928384:12345-192.168.201.39@tcp:101:dd.0 Request processed in 401us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130194.335190:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:1.0:1789130194.339103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.339196:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928512 00000100:00100000:3.0:1789130194.339206:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928512 00000100:00100000:3.0:1789130194.339261:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 271 00000100:00100000:3.0:1789130194.339272:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:35415:x1876037604928512:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130194.339292:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130194.339312:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abddd expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339375:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339391:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339403:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339418:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339425:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339444:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339569:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339591:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339598:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130194.339671:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00000004:00200000:3.0:1789130194.339675:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130194.339698:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339710:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339717:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339725:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339730:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130194.339735:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339743:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339756:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130194.339759:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130194.339764:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339782:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339796:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339802:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339807:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339812:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130194.339815:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339822:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339830:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff90b488939400) 00010000:00010000:3.0:1789130194.339833:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130194.339835:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339841:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339869:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abddd expref: 19 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339894:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abddd expref: 18 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.339902:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:3.0:1789130194.339904:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130194.339906:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86c00, rc 0) 00000100:00100000:3.0:1789130194.339970:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:35415:x1876037604928512:12345-192.168.201.39@tcp:101:dd.0 Request processed in 700us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130194.339979:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 271 00000100:00100000:0.0:1789130194.343964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.344351:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928768 00000100:00100000:2.0:1789130194.344362:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928768 00000100:00100000:2.0:1789130194.344459:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:2.0:1789130194.344470:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+18:35415:x1876037604928768:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130194.344577:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130194.344616:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9a2d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abde4 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344752:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344768:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344801:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344817:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344825:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.344831:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130194.348398:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc7:0x0], index 1: 0 00010000:00010000:2.0:1789130194.349159:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9a42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349187:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9a42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349200:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9a42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349242:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349249:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349256:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349262:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130194.349281:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349290:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349303:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130194.349306:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130194.349311:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349318:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a34 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130194.349333:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000059242420 reply state 000000009af4d181 transno 30064771301 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130194.349343:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130194.349378:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9a2d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abde4 expref: 21 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349392:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9a42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abde4 expref: 20 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.349399:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130194.349401:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130194.349404:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:2.0:1789130194.349510:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:35415:x1876037604928768:12345-192.168.201.39@tcp:101:dd.0 Request processed in 5041us (5555us total) trans 30064771301 rc 0/0 00000100:00100000:2.0:1789130194.349520:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:1.0:1789130194.359356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.359796:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604928896 00000100:00100000:3.0:1789130194.359808:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604928896 00000100:00100000:3.0:1789130194.359851:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789130194.359860:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1876037604928896:12345-192.168.201.39@tcp:8:dd.0 00010000:00080000:3.0:1789130194.359902:0:37658:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp t0 exp 0000000000000000 cur 1357 last 0 00000020:00000080:3.0:1789130194.359946:0:37658:0:(genops.c:1385:class_connect()) connect: client 587d445f-41ce-47d3-97fe-edc16e866648, cookie 0x5c74554e47ce9a50 00002000:00100000:3.0:1789130194.359959:0:37658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 587d445f-41ce-47d3-97fe-edc16e866648/ffff90b381df0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789130194.359983:0:37658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789130194.360093:0:37658:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789130194.360127:0:37658:0:(import.c:65:import_set_state_nolock()) ffff90b381df2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130194.360201:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2366:x1876037604928896:12345-192.168.201.39@tcp:8:dd.0 Request processed in 341us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130194.360210:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00010000:00010000:2.0:1789130194.360875:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360889:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360899:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360904:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130194.360910:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360918:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360938:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130194.360942:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130194.360946:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.360952:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9a3b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130194.363028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.363194:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929024 00000100:00100000:3.0:1789130194.363206:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929024 00000100:00100000:3.0:1789130194.363302:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789130194.363311:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+6:35415:x1876037604929024:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130194.363330:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130194.363351:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdeb expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130194.363380:0:38727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130194.363403:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=1357s v=(0 0) 00010000:00010000:3.0:1789130194.363408:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130194.363419:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 7 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.363449:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 7 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.363463:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00000100:00100000:3.0:1789130194.363530:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:35415:x1876037604929024:12345-192.168.201.39@tcp:101:dd.0 Request processed in 220us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130194.363537:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00080000:1.0:1789130194.363629:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789130194.374862:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130194.400280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.400368:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929152 00000100:00100000:1.0:1789130194.400378:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929152 00002000:00100000:1.0:1789130194.400432:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff90b387350780 x1876037604929152/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.400455:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350780 with x1876037604929152 ext(0->1048575) 00002000:00010000:1.0:1789130194.400462:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387350780 00000100:00100000:1.0:1789130194.400502:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789130194.400512:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2369:x1876037604929152:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.462859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.462901:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929280 00000100:00100000:0.0:1789130194.462911:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929280 00002000:00100000:0.0:1789130194.462958:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff90b38295c3c0 x1876037604929280/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.462969:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c3c0 with x1876037604929280 ext(1048576->2097151) 00002000:00010000:0.0:1789130194.462974:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c3c0 00000100:00100000:0.0:1789130194.463012:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:0.0:1789130194.463022:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604929280:12345-192.168.201.39@tcp:4:dd.0 00000001:00100000:0.0:1789130194.499671:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:0.0:1789130194.499681:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b381df1800/587d445f-41ce-47d3-97fe-edc16e866648 00000001:00100000:0.0:1789130194.499712:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:0.0:1789130194.499746:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b381df1800/587d445f-41ce-47d3-97fe-edc16e866648 for lustre-OST0001 00000020:00000080:0.0:1789130194.499795:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b381df4000 for lustre-OST0001 00000100:00100000:2.0:1789130194.507905:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604929152:12345-192.168.201.39@tcp:4:dd.0 Request processed in 107381us (107621us total) trans 30064771096 rc 0/0 00000100:00100000:2.0:1789130194.507921:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00002000:00100000:2.0:1789130194.507936:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff90b387350780 x1876037604929152/t30064771096(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.507947:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350780 with x1876037604929152 ext(0->1048575) 00002000:00010000:2.0:1789130194.507967:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387350780 00000100:00100000:0.0:1789130194.514407:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604929280:12345-192.168.201.39@tcp:4:dd.0 Request processed in 51374us (51545us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1789130194.514421:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00002000:00100000:0.0:1789130194.514847:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff90b38295c3c0 x1876037604929280/t30064771097(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.514860:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c3c0 with x1876037604929280 ext(1048576->2097151) 00002000:00010000:0.0:1789130194.514867:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c3c0 00000100:00100000:1.0:1789130194.529122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.529223:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929408 00000100:00100000:2.0:1789130194.529234:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929408 00002000:00100000:2.0:1789130194.529285:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff90b384a71e00 x1876037604929408/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.529298:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71e00 with x1876037604929408 ext(2097152->3145727) 00002000:00010000:2.0:1789130194.529304:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a71e00 00000100:00100000:2.0:1789130194.529342:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789130194.529351:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604929408:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.556424:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037604929408:12345-192.168.201.39@tcp:4:dd.0 Request processed in 27062us (27301us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1789130194.556451:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00002000:00100000:0.0:1789130194.556466:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff90b384a71e00 x1876037604929408/t30064771098(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.556487:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71e00 with x1876037604929408 ext(2097152->3145727) 00002000:00010000:0.0:1789130194.556494:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a71e00 00000100:00100000:3.0:1789130194.576387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.579927:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929536 00000100:00100000:0.0:1789130194.579943:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929536 00002000:00100000:0.0:1789130194.580003:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff90b387351680 x1876037604929536/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.580016:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387351680 with x1876037604929536 ext(3145728->4194303) 00002000:00010000:0.0:1789130194.580024:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387351680 00000100:00100000:0.0:1789130194.580064:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789130194.580073:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604929536:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130194.585727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.591217:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037604929536:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11133us (14830us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1789130194.591231:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00002000:00100000:0.0:1789130194.591244:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff90b387351680 x1876037604929536/t30064771099(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.591256:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387351680 with x1876037604929536 ext(3145728->4194303) 00002000:00010000:0.0:1789130194.591263:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387351680 00000100:00100000:0.0:1789130194.591288:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929664 00000100:00100000:0.0:1789130194.591295:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929664 00002000:00100000:0.0:1789130194.591341:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff90b3873503c0 x1876037604929664/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.591350:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873503c0 with x1876037604929664 ext(4194304->5242879) 00002000:00010000:0.0:1789130194.591354:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3873503c0 00000100:00100000:2.0:1789130194.592124:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130194.592139:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604929664:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130194.600516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.600957:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929792 00000100:00100000:2.0:1789130194.600968:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929792 00002000:00100000:2.0:1789130194.601021:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff90b387353c00 x1876037604929792/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.601032:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387353c00 with x1876037604929792 ext(5242880->6291455) 00002000:00010000:2.0:1789130194.601039:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387353c00 00000100:00100000:2.0:1789130194.601070:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789130194.601081:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:2369:x1876037604929792:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.606082:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:2369:x1876037604929664:12345-192.168.201.39@tcp:4:dd.0 Request processed in 13936us (20355us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1789130194.606097:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00002000:00100000:2.0:1789130194.606110:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff90b3873503c0 x1876037604929664/t30064771100(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.606144:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873503c0 with x1876037604929664 ext(4194304->5242879) 00002000:00010000:2.0:1789130194.606151:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3873503c0 00000100:00100000:3.0:1789130194.612504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.612583:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604929920 00000100:00100000:2.0:1789130194.612595:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604929920 00002000:00100000:2.0:1789130194.612689:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff90b387350b40 x1876037604929920/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.612702:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350b40 with x1876037604929920 ext(6291456->7340031) 00002000:00010000:2.0:1789130194.612709:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387350b40 00000100:00100000:2.0:1789130194.612743:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:2.0:1789130194.612753:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037604929920:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.617554:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604929792:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16464us (17043us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1789130194.617568:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00002000:00100000:2.0:1789130194.617582:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff90b387353c00 x1876037604929792/t30064771101(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.617595:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387353c00 with x1876037604929792 ext(5242880->6291455) 00002000:00010000:2.0:1789130194.617629:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387353c00 00000100:00100000:2.0:1789130194.624459:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604929920:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11697us (11956us total) trans 30064771102 rc 0/0 00000100:00100000:2.0:1789130194.624474:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00002000:00100000:2.0:1789130194.624500:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff90b387350b40 x1876037604929920/t30064771102(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.624535:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350b40 with x1876037604929920 ext(6291456->7340031) 00002000:00010000:2.0:1789130194.624543:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b387350b40 00000100:00100000:0.0:1789130194.625975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.626027:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930048 00000100:00100000:3.0:1789130194.626035:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930048 00002000:00100000:3.0:1789130194.626082:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff90b38295fc00 x1876037604930048/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.626090:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295fc00 with x1876037604930048 ext(7340032->8388607) 00002000:00010000:3.0:1789130194.626094:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295fc00 00000100:00100000:3.0:1789130194.626129:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:3.0:1789130194.626138:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604930048:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130194.631583:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:2370:x1876037604930048:12345-192.168.201.39@tcp:4:dd.0 Request processed in 5433us (5602us total) trans 30064771103 rc 0/0 00000100:00100000:3.0:1789130194.631599:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00002000:00100000:3.0:1789130194.631647:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff90b38295fc00 x1876037604930048/t30064771103(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.631659:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295fc00 with x1876037604930048 ext(7340032->8388607) 00002000:00010000:3.0:1789130194.631666:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295fc00 00000100:00100000:0.0:1789130194.645582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.645647:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930176 00000100:00100000:2.0:1789130194.645660:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930176 00002000:00100000:2.0:1789130194.645718:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff90b38295cb40 x1876037604930176/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.645730:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295cb40 with x1876037604930176 ext(8388608->9437183) 00002000:00010000:2.0:1789130194.645736:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295cb40 00000100:00100000:2.0:1789130194.645771:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:2.0:1789130194.645782:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:2367:x1876037604930176:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.651592:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:2367:x1876037604930176:12345-192.168.201.39@tcp:4:dd.0 Request processed in 5801us (6009us total) trans 30064771104 rc 0/0 00000100:00100000:2.0:1789130194.651629:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00002000:00100000:2.0:1789130194.651643:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff90b38295cb40 x1876037604930176/t30064771104(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.651654:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295cb40 with x1876037604930176 ext(8388608->9437183) 00002000:00010000:2.0:1789130194.651662:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295cb40 00000100:00100000:1.0:1789130194.666302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.666368:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930304 00000100:00100000:2.0:1789130194.666379:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930304 00002000:00100000:2.0:1789130194.666438:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff90b384a72d00 x1876037604930304/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.666451:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72d00 with x1876037604930304 ext(9437184->10485759) 00002000:00010000:2.0:1789130194.666457:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72d00 00000100:00100000:2.0:1789130194.666525:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:2.0:1789130194.666535:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:2367:x1876037604930304:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.677908:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604930304:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11362us (11602us total) trans 30064771105 rc 0/0 00000100:00100000:2.0:1789130194.677924:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00002000:00100000:2.0:1789130194.677938:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff90b384a72d00 x1876037604930304/t30064771105(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.677949:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72d00 with x1876037604930304 ext(9437184->10485759) 00002000:00010000:2.0:1789130194.677956:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72d00 00000100:00100000:0.0:1789130194.690192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.690533:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930432 00000100:00100000:1.0:1789130194.690545:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930432 00002000:00100000:1.0:1789130194.690593:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff90b38295f0c0 x1876037604930432/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.690630:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f0c0 with x1876037604930432 ext(10485760->11534335) 00002000:00010000:1.0:1789130194.690637:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295f0c0 00000100:00100000:1.0:1789130194.690670:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130194.690680:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+26:2369:x1876037604930432:12345-192.168.201.39@tcp:4:dd.0 00000040:00080000:1.0:1789130194.693964:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130194.693974:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130194.694013:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 4 00000040:00080000:1.0:1789130194.694033:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130194.700122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.707747:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930560 00000100:00100000:1.0:1789130194.707762:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930560 00002000:00100000:1.0:1789130194.707828:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff90b38295c000 x1876037604930560/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.707840:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c000 with x1876037604930560 ext(11534336->12582911) 00002000:00010000:1.0:1789130194.707846:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c000 00000100:00100000:1.0:1789130194.707884:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:1.0:1789130194.707895:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037604930560:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130194.720357:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604930432:12345-192.168.201.39@tcp:4:dd.0 Request processed in 29667us (30164us total) trans 30064771106 rc 0/0 00000100:00100000:3.0:1789130194.720372:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00002000:00100000:3.0:1789130194.720385:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff90b38295f0c0 x1876037604930432/t30064771106(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.720397:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f0c0 with x1876037604930432 ext(10485760->11534335) 00002000:00010000:3.0:1789130194.720405:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295f0c0 00000100:00100000:2.0:1789130194.723745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.724116:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930688 00000100:00100000:3.0:1789130194.724997:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930688 00002000:00100000:3.0:1789130194.725051:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff90b384b7ed00 x1876037604930688/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.725081:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7ed00 with x1876037604930688 ext(12582912->13631487) 00002000:00010000:3.0:1789130194.725087:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b7ed00 00000100:00100000:3.0:1789130194.725273:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1789130194.725284:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604930688:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.732545:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:2369:x1876037604930560:12345-192.168.201.39@tcp:4:dd.0 Request processed in 24639us (32523us total) trans 30064771107 rc 0/0 00000100:00100000:2.0:1789130194.732563:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00002000:00100000:2.0:1789130194.732576:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff90b38295c000 x1876037604930560/t30064771107(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.732588:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c000 with x1876037604930560 ext(11534336->12582911) 00002000:00010000:2.0:1789130194.732599:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c000 00000100:00100000:3.0:1789130194.735530:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:2369:x1876037604930688:12345-192.168.201.39@tcp:4:dd.0 Request processed in 10235us (11783us total) trans 30064771108 rc 0/0 00000100:00100000:3.0:1789130194.735543:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00002000:00100000:3.0:1789130194.735555:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff90b384b7ed00 x1876037604930688/t30064771108(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.735565:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7ed00 with x1876037604930688 ext(12582912->13631487) 00002000:00010000:3.0:1789130194.735571:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b7ed00 00000100:00100000:0.0:1789130194.736138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.736233:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930816 00000100:00100000:3.0:1789130194.736243:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930816 00002000:00100000:3.0:1789130194.736278:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff90b38295f840 x1876037604930816/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.736288:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f840 with x1876037604930816 ext(13631488->14680063) 00002000:00010000:3.0:1789130194.736292:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295f840 00000100:00100000:3.0:1789130194.736354:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:3.0:1789130194.736364:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:2370:x1876037604930816:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.745149:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:2370:x1876037604930816:12345-192.168.201.39@tcp:4:dd.0 Request processed in 8778us (9005us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1789130194.745161:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00002000:00100000:0.0:1789130194.745171:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff90b38295f840 x1876037604930816/t30064771109(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.745179:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f840 with x1876037604930816 ext(13631488->14680063) 00002000:00010000:0.0:1789130194.745184:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295f840 00000100:00100000:3.0:1789130194.751586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.751655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.751717:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931200 00000100:00100000:2.0:1789130194.751729:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931200 00000100:00100000:1.0:1789130194.751811:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604930944 00000100:00100000:1.0:1789130194.751816:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604930944 00002000:00100000:1.0:1789130194.751856:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff90b38685f840 x1876037604930944/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789130194.751865:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00002000:00100000:1.0:1789130194.751868:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685f840 with x1876037604930944 ext(14680064->15728639) 00002000:00010000:1.0:1789130194.751874:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685f840 00000100:00100000:2.0:1789130194.751877:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:35415:x1876037604931200:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:1.0:1789130194.751900:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789130194.751908:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+34:2370:x1876037604930944:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.752343:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:35415:x1876037604931200:12345-192.168.201.39@tcp:35:dd.0 Request processed in 467us (687us total) trans 30064771302 rc 0/0 00000100:00100000:2.0:1789130194.752353:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:0.0:1789130194.758897:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+36:2370:x1876037604930944:12345-192.168.201.39@tcp:4:dd.0 Request processed in 6980us (7311us total) trans 30064771110 rc 0/0 00000100:00100000:0.0:1789130194.758908:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00002000:00100000:0.0:1789130194.758918:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff90b38685f840 x1876037604930944/t30064771110(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.758926:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685f840 with x1876037604930944 ext(14680064->15728639) 00002000:00010000:0.0:1789130194.758932:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685f840 00000100:00100000:1.0:1789130194.763449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.763827:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931456 00000100:00100000:3.0:1789130194.763856:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931456 00000100:00100000:3.0:1789130194.763910:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 273 00000100:00100000:3.0:1789130194.763921:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:35416:x1876037604931456:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130194.763948:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130194.763970:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a5e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdf2 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764101:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764115:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764182:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764202:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764209:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130194.764215:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130194.764959:0:36587:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc7:0x0], index 0: 0 00010000:00010000:2.0:1789130194.765094:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9a73 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765111:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9a73 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765117:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9a73 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765147:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765152:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765156:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765160:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130194.765163:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765167:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765176:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130194.765178:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130194.765182:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765185:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9a65 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130194.765202:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003e5d5443 reply state 00000000948d82eb transno 30064771303 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130194.765208:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130194.765229:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9a5e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf2 expref: 24 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765238:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9a73 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf2 expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.765243:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130194.765245:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130194.765247:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:2.0:1789130194.765309:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+24:35416:x1876037604931456:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1389us (1870us total) trans 30064771303 rc 0/0 00000100:00100000:2.0:1789130194.765317:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 273 00010000:00010000:1.0:1789130194.767263:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767280:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767288:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767312:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130194.767317:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767325:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767341:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff90b488939f00) 00010000:00010000:1.0:1789130194.767344:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130194.767348:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130194.767355:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9a6c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130194.771017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.771546:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931584 00000100:00100000:2.0:1789130194.771556:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931584 00000100:00100000:2.0:1789130194.771652:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130194.771665:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+8:35416:x1876037604931584:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130194.771684:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130194.771711:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce9a81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abdf9 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130194.771741:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130194.771761:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=1357s v=(0 0) 00010000:00010000:2.0:1789130194.771778:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130194.771796:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce9a81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf9 expref: 9 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.771814:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce9a81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf9 expref: 9 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130194.771828:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:2.0:1789130194.771903:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:35416:x1876037604931584:12345-192.168.201.39@tcp:101:dd.0 Request processed in 237us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130194.771910:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00080000:1.0:1789130194.771992:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130194.798462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.799936:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931712 00000100:00100000:1.0:1789130194.799952:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931712 00002000:00100000:0.0:1789130194.800659:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff90b384b7d2c0 x1876037604931712/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.800691:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7d2c0 with x1876037604931712 ext(0->1048575) 00002000:00010000:0.0:1789130194.800697:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7d2c0 00000100:00100000:0.0:1789130194.800787:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:0.0:1789130194.800798:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604931712:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.815343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130194.815451:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931840 00000100:00100000:2.0:1789130194.815461:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931840 00002000:00100000:2.0:1789130194.815523:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff90b38295e1c0 x1876037604931840/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.815536:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e1c0 with x1876037604931840 ext(1048576->2097151) 00002000:00010000:2.0:1789130194.815543:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295e1c0 00000100:00100000:2.0:1789130194.815579:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130194.815591:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604931840:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.831553:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037604931712:12345-192.168.201.39@tcp:4:dd.0 Request processed in 30746us (33092us total) trans 30064771164 rc 0/0 00000100:00100000:0.0:1789130194.831568:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00002000:00100000:0.0:1789130194.831581:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff90b384b7d2c0 x1876037604931712/t30064771164(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.831591:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7d2c0 with x1876037604931712 ext(0->1048575) 00002000:00010000:0.0:1789130194.831598:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7d2c0 00000100:00100000:3.0:1789130194.835576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.835706:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604931968 00000100:00100000:1.0:1789130194.835718:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604931968 00002000:00100000:1.0:1789130194.835779:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff90b492796d00 x1876037604931968/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.835792:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492796d00 with x1876037604931968 ext(2097152->3145727) 00002000:00010000:1.0:1789130194.835799:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492796d00 00000100:00100000:1.0:1789130194.835837:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1789130194.835848:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604931968:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.846352:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604931840:12345-192.168.201.39@tcp:4:dd.0 Request processed in 30755us (31012us total) trans 30064771165 rc 0/0 00000100:00100000:0.0:1789130194.846364:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00002000:00100000:0.0:1789130194.846375:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff90b38295e1c0 x1876037604931840/t30064771165(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.846383:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e1c0 with x1876037604931840 ext(1048576->2097151) 00002000:00010000:0.0:1789130194.846390:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295e1c0 00000100:00100000:1.0:1789130194.849276:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604931968:12345-192.168.201.39@tcp:4:dd.0 Request processed in 13419us (13703us total) trans 30064771166 rc 0/0 00000100:00100000:1.0:1789130194.849297:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00002000:00100000:1.0:1789130194.849312:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff90b492796d00 x1876037604931968/t30064771166(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.849324:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492796d00 with x1876037604931968 ext(2097152->3145727) 00002000:00010000:1.0:1789130194.849332:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492796d00 00000100:00100000:3.0:1789130194.865977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.866259:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932096 00000100:00100000:1.0:1789130194.866271:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932096 00002000:00100000:1.0:1789130194.866386:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff90b4927943c0 x1876037604932096/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130194.866397:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927943c0 with x1876037604932096 ext(3145728->4194303) 00002000:00010000:1.0:1789130194.866404:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927943c0 00000100:00100000:1.0:1789130194.866434:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789130194.866445:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604932096:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130194.896686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.896734:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932224 00000100:00100000:0.0:1789130194.896746:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932224 00002000:00100000:0.0:1789130194.896811:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff90b492795680 x1876037604932224/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.896841:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492795680 with x1876037604932224 ext(4194304->5242879) 00002000:00010000:0.0:1789130194.896849:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492795680 00000100:00100000:0.0:1789130194.896903:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1789130194.896916:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037604932224:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.901830:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604932096:12345-192.168.201.39@tcp:4:dd.0 Request processed in 35372us (35848us total) trans 30064771167 rc 0/0 00000100:00100000:2.0:1789130194.901846:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00002000:00100000:2.0:1789130194.901862:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff90b4927943c0 x1876037604932096/t30064771167(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.901924:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927943c0 with x1876037604932096 ext(3145728->4194303) 00002000:00010000:2.0:1789130194.901931:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927943c0 00000100:00100000:0.0:1789130194.914151:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:2368:x1876037604932224:12345-192.168.201.39@tcp:4:dd.0 Request processed in 17226us (17469us total) trans 30064771168 rc 0/0 00000100:00100000:0.0:1789130194.914165:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00002000:00100000:0.0:1789130194.914199:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff90b492795680 x1876037604932224/t30064771168(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.914212:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492795680 with x1876037604932224 ext(4194304->5242879) 00002000:00010000:0.0:1789130194.914219:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492795680 00000100:00100000:3.0:1789130194.916771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.917105:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932352 00000100:00100000:0.0:1789130194.917120:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932352 00002000:00100000:0.0:1789130194.917179:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff90b492795a40 x1876037604932352/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.917191:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492795a40 with x1876037604932352 ext(5242880->6291455) 00002000:00010000:0.0:1789130194.917197:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492795a40 00000100:00100000:0.0:1789130194.917233:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:0.0:1789130194.917243:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2368:x1876037604932352:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130194.950975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130194.951154:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932480 00000100:00100000:0.0:1789130194.951168:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932480 00002000:00100000:0.0:1789130194.951230:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff90b383f29a40 x1876037604932480/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.951260:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f29a40 with x1876037604932480 ext(6291456->7340031) 00002000:00010000:0.0:1789130194.951268:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383f29a40 00000100:00100000:0.0:1789130194.951313:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:0.0:1789130194.951324:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:2369:x1876037604932480:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130194.970776:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130194.970852:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932608 00000100:00100000:3.0:1789130194.970863:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932608 00002000:00100000:3.0:1789130194.970940:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff90b384a71680 x1876037604932608/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130194.970951:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71680 with x1876037604932608 ext(7340032->8388607) 00002000:00010000:3.0:1789130194.970958:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a71680 00000100:00100000:3.0:1789130194.970990:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:3.0:1789130194.970999:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:2367:x1876037604932608:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130194.979073:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:2368:x1876037604932352:12345-192.168.201.39@tcp:4:dd.0 Request processed in 61822us (62303us total) trans 30064771169 rc 0/0 00000100:00100000:0.0:1789130194.979085:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00002000:00100000:0.0:1789130194.979095:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff90b492795a40 x1876037604932352/t30064771169(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.979103:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492795a40 with x1876037604932352 ext(5242880->6291455) 00002000:00010000:0.0:1789130194.979108:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492795a40 00000100:00100000:0.0:1789130194.983666:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604932480:12345-192.168.201.39@tcp:4:dd.0 Request processed in 32332us (32691us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1789130194.983681:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00002000:00100000:0.0:1789130194.983695:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff90b383f29a40 x1876037604932480/t30064771170(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130194.983707:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f29a40 with x1876037604932480 ext(6291456->7340031) 00002000:00010000:0.0:1789130194.983715:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383f29a40 00000100:00100000:2.0:1789130194.986116:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:2367:x1876037604932608:12345-192.168.201.39@tcp:4:dd.0 Request processed in 15109us (15340us total) trans 30064771171 rc 0/0 00000100:00100000:2.0:1789130194.986130:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00002000:00100000:2.0:1789130194.986142:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff90b384a71680 x1876037604932608/t30064771171(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130194.986152:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71680 with x1876037604932608 ext(7340032->8388607) 00002000:00010000:2.0:1789130194.986159:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a71680 00000100:00100000:3.0:1789130194.998902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130194.998967:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932736 00000100:00100000:1.0:1789130194.998978:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932736 00002000:00100000:1.0:1789130194.999042:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff90b486f412c0 x1876037604932736/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/0 e 0 to 0 dl 1789130205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130195.003780:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f412c0 with x1876037604932736 ext(8388608->9437183) 00002000:00010000:1.0:1789130195.003789:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f412c0 00000100:00100000:1.0:1789130195.003846:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:1.0:1789130195.003868:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:2367:x1876037604932736:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130195.015246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.015756:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932864 00000100:00100000:3.0:1789130195.015769:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932864 00002000:00100000:3.0:1789130195.015821:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff90b383f29e00 x1876037604932864/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130195.015832:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f29e00 with x1876037604932864 ext(9437184->10485759) 00002000:00010000:3.0:1789130195.015839:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383f29e00 00000100:00100000:3.0:1789130195.015872:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789130195.015883:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2370:x1876037604932864:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130195.016222:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:2367:x1876037604932736:12345-192.168.201.39@tcp:4:dd.0 Request processed in 12366us (17326us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1789130195.016228:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00002000:00100000:2.0:1789130195.016234:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff90b486f412c0 x1876037604932736/t30064771172(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:665/0 lens 488/448 e 0 to 0 dl 1789130205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.016240:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f412c0 with x1876037604932736 ext(8388608->9437183) 00002000:00010000:2.0:1789130195.016244:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f412c0 00000100:00100000:3.0:1789130195.030022:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037604932864:12345-192.168.201.39@tcp:4:dd.0 Request processed in 14131us (14777us total) trans 30064771173 rc 0/0 00000100:00100000:3.0:1789130195.030036:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00002000:00100000:3.0:1789130195.030047:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff90b383f29e00 x1876037604932864/t30064771173(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130195.030057:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f29e00 with x1876037604932864 ext(9437184->10485759) 00002000:00010000:3.0:1789130195.030064:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383f29e00 00000100:00100000:0.0:1789130195.049251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.049320:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604932992 00000100:00100000:3.0:1789130195.049330:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604932992 00002000:00100000:3.0:1789130195.049400:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff90b38295e580 x1876037604932992/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130195.049412:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e580 with x1876037604932992 ext(10485760->11534335) 00002000:00010000:3.0:1789130195.049419:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295e580 00000100:00100000:3.0:1789130195.049482:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789130195.049494:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:2367:x1876037604932992:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130195.067880:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604932992:12345-192.168.201.39@tcp:4:dd.0 Request processed in 18376us (18623us total) trans 30064771174 rc 0/0 00000100:00100000:1.0:1789130195.067907:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00002000:00100000:1.0:1789130195.067921:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff90b38295e580 x1876037604932992/t30064771174(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130195.067932:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e580 with x1876037604932992 ext(10485760->11534335) 00002000:00010000:1.0:1789130195.067939:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295e580 00000100:00100000:0.0:1789130195.078651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.078792:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933120 00000100:00100000:2.0:1789130195.078801:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933120 00002000:00100000:2.0:1789130195.078851:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff90b38295d2c0 x1876037604933120/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.078862:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295d2c0 with x1876037604933120 ext(11534336->12582911) 00002000:00010000:2.0:1789130195.078879:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295d2c0 00000100:00100000:2.0:1789130195.078944:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:2.0:1789130195.078955:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604933120:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130195.089440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.093289:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933248 00000100:00100000:2.0:1789130195.093309:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933248 00002000:00100000:2.0:1789130195.093370:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff90b384a570c0 x1876037604933248/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.093383:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a570c0 with x1876037604933248 ext(12582912->13631487) 00002000:00010000:2.0:1789130195.093391:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a570c0 00000100:00100000:2.0:1789130195.093439:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:2.0:1789130195.093450:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604933248:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130195.095479:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+35:2369:x1876037604933120:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16506us (16814us total) trans 30064771175 rc 0/0 00000100:00100000:2.0:1789130195.095497:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00002000:00100000:2.0:1789130195.095510:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff90b38295d2c0 x1876037604933120/t30064771175(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.095520:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295d2c0 with x1876037604933120 ext(11534336->12582911) 00002000:00010000:2.0:1789130195.095527:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295d2c0 00000100:00100000:2.0:1789130195.111981:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604933248:12345-192.168.201.39@tcp:4:dd.0 Request processed in 18522us (22549us total) trans 30064771176 rc 0/0 00000100:00100000:2.0:1789130195.111995:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00002000:00100000:2.0:1789130195.112020:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff90b384a570c0 x1876037604933248/t30064771176(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.112043:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a570c0 with x1876037604933248 ext(12582912->13631487) 00002000:00010000:2.0:1789130195.112049:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a570c0 00000100:00100000:3.0:1789130195.112651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.114230:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933376 00000100:00100000:2.0:1789130195.114245:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933376 00002000:00100000:2.0:1789130195.114305:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff90b384a54000 x1876037604933376/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.114317:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a54000 with x1876037604933376 ext(13631488->14680063) 00002000:00010000:2.0:1789130195.114323:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a54000 00000100:00100000:2.0:1789130195.114368:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:2.0:1789130195.114379:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+35:2368:x1876037604933376:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130195.141867:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:2368:x1876037604933376:12345-192.168.201.39@tcp:4:dd.0 Request processed in 27480us (29207us total) trans 30064771177 rc 0/0 00000100:00100000:2.0:1789130195.141880:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00002000:00100000:2.0:1789130195.141893:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff90b384a54000 x1876037604933376/t30064771177(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130195.141903:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a54000 with x1876037604933376 ext(13631488->14680063) 00002000:00010000:2.0:1789130195.141910:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a54000 00000100:00100000:0.0:1789130195.144549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.144650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130195.144734:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933504 00000100:00100000:1.0:1789130195.144743:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933504 00002000:00100000:1.0:1789130195.144801:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff90b38295f480 x1876037604933504/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/0 e 0 to 0 dl 1789130206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130195.144814:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f480 with x1876037604933504 ext(14680064->15728639) 00002000:00010000:1.0:1789130195.144820:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295f480 00000100:00100000:1.0:1789130195.144844:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:1.0:1789130195.144853:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:2370:x1876037604933504:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130195.145674:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933760 00000100:00100000:2.0:1789130195.145681:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933760 00000100:00100000:2.0:1789130195.145728:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789130195.145736:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:35416:x1876037604933760:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130195.146328:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:35416:x1876037604933760:12345-192.168.201.39@tcp:35:dd.0 Request processed in 590us (1787us total) trans 30064771304 rc 0/0 00000100:00100000:2.0:1789130195.146355:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130195.167224:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604933504:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22243us (22444us total) trans 30064771178 rc 0/0 00000100:00100000:1.0:1789130195.167239:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00002000:00100000:1.0:1789130195.167252:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff90b38295f480 x1876037604933504/t30064771178(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:666/0 lens 488/448 e 0 to 0 dl 1789130206 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130195.167263:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295f480 with x1876037604933504 ext(14680064->15728639) 00002000:00010000:1.0:1789130195.167270:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295f480 00000100:00100000:3.0:1789130195.176289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.176397:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604933888 00000100:00100000:2.0:1789130195.176407:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604933888 00000100:00100000:2.0:1789130195.176481:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:2.0:1789130195.176491:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+24:35417:x1876037604933888:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130195.176518:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130195.176540:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9a88 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe00 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176577:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176593:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176645:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176784:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9a88 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 26 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176816:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 25 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.176824:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130195.176827:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130195.176831:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:2.0:1789130195.176889:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:35417:x1876037604933888:12345-192.168.201.39@tcp:101:chown.0 Request processed in 400us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130195.176904:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:0.0:1789130195.183913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.184121:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934144 00000100:00100000:2.0:1789130195.184133:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934144 00000100:00100000:2.0:1789130195.184195:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:2.0:1789130195.184206:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:35417:x1876037604934144:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:2.0:1789130195.184263:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130195.184290:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9a42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abde4 expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.184311:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130195.184316:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130195.184346:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.184360:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.184371:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130195.185026:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].9, 88 off8840 00000004:00080000:2.0:1789130195.185038:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1358282435684ns, next at 1359282433162ns, rc = 0 00000004:00010000:2.0:1789130195.185118:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c29058fe reply state 000000007f74dcb0 transno 30064771305 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.185129:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130195.185234:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:35417:x1876037604934144:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1029us (1329us total) trans 30064771305 rc 0/0 00000100:00100000:2.0:1789130195.185253:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 275 00010000:00010000:2.0:1789130195.186998:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187013:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187020:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187026:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130195.187031:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187040:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187056:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130195.187059:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130195.187062:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.187068:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9a96 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130195.188330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.188482:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934272 00000100:00100000:2.0:1789130195.188494:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934272 00000100:00100000:2.0:1789130195.188595:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:2.0:1789130195.188647:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:35417:x1876037604934272:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130195.188671:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130195.188699:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe07 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.188759:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 26 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.188773:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 26 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.188791:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130195.188794:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130195.188798:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:2.0:1789130195.188850:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:35417:x1876037604934272:12345-192.168.201.39@tcp:101:chown.0 Request processed in 206us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130195.188857:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:0.0:1789130195.197855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130195.197969:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934400 00000100:00100000:1.0:1789130195.197980:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934400 00000100:00100000:1.0:1789130195.198087:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130195.198119:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:2367:x1876037604934400:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:1.0:1789130195.198334:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1789130195.198338:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1789130194 00002000:00010000:1.0:1789130195.198341:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130195.198343:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1789130194 00002000:00010000:1.0:1789130195.198346:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130195.198409:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2367:x1876037604934400:12345-192.168.201.39@tcp:2:chown.0 Request processed in 292us (564us total) trans 30064771111 rc 0/0 00000100:00100000:1.0:1789130195.198425:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789130195.213588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.213805:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934528 00000100:00100000:0.0:1789130195.213817:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934528 00000100:00100000:0.0:1789130195.213882:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:0.0:1789130195.213893:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:35418:x1876037604934528:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130195.213915:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.214403:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9aa4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe0e expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214516:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce9aab lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214531:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce9aab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214544:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce9aab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214691:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9aa4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe0e expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214712:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce9aab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe0e expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.214721:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130195.214725:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130195.214728:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b200, rc 0) 00000100:00100000:0.0:1789130195.215043:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:35418:x1876037604934528:12345-192.168.201.39@tcp:101:chown.0 Request processed in 1150us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.215060:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:0.0:1789130195.219273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.219723:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934784 00000100:00100000:2.0:1789130195.219735:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934784 00000100:00100000:2.0:1789130195.219965:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:2.0:1789130195.219977:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:35418:x1876037604934784:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:2.0:1789130195.220032:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130195.220064:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9a73 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf2 expref: 27 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.220086:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130195.220091:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130195.220177:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.220212:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.220223:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130195.221080:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].9, 88 off8912 00000004:00080000:2.0:1789130195.221094:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1358318491206ns, next at 1359318488171ns, rc = 0 00000004:00010000:2.0:1789130195.221244:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cff7f26b reply state 000000005767e7f5 transno 30064771306 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.221255:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130195.221365:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:35418:x1876037604934784:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1388us (2100us total) trans 30064771306 rc 0/0 00000100:00100000:2.0:1789130195.221375:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:3.0:1789130195.224208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130195.224280:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224292:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224300:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224305:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130195.224310:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224317:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224354:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130195.224357:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130195.224363:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224368:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ab2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.224404:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604934912 00000100:00100000:2.0:1789130195.224414:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604934912 00000100:00100000:2.0:1789130195.224487:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:2.0:1789130195.224499:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:35418:x1876037604934912:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130195.224526:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130195.224544:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9ab9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe15 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224628:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9ab9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe15 expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224642:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9ab9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe15 expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.224662:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130195.224666:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130195.224668:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:2.0:1789130195.224729:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:35418:x1876037604934912:12345-192.168.201.39@tcp:101:chown.0 Request processed in 233us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130195.224747:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:3.0:1789130195.227317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.227644:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935040 00000100:00100000:2.0:1789130195.227655:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935040 00000100:00100000:2.0:1789130195.227707:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130195.227719:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:2368:x1876037604935040:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:2.0:1789130195.227933:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789130195.227937:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1789130194 00002000:00010000:2.0:1789130195.227940:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130195.227942:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1789130194 00002000:00010000:2.0:1789130195.227944:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130195.228002:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:2368:x1876037604935040:12345-192.168.201.39@tcp:2:chown.0 Request processed in 285us (693us total) trans 30064771179 rc 0/0 00000100:00100000:2.0:1789130195.228010:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130195.307965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.308061:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935168 00000100:00100000:3.0:1789130195.308071:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935168 00000100:00100000:3.0:1789130195.308129:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:3.0:1789130195.308139:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:35424:x1876037604935168:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:3.0:1789130195.308162:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130195.308185:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9ac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe1c expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130195.309542:0:36589:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1303us 00010000:00010000:0.0:1789130195.337212:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.337252:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.337268:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.337334:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00000004:00200000:0.0:1789130195.337338:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130195.337388:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.337852:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47ce9ac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe1c expref: 30 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.337875:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe1c expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.337884:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130195.337887:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130195.337891:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151bc00, rc 0) 00000100:00100000:0.0:1789130195.337971:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:35424:x1876037604935168:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 29832us (30016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.337997:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:1.0:1789130195.349348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.349539:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935296 00000100:00100000:0.0:1789130195.349551:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935296 00000100:00100000:0.0:1789130195.349643:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:0.0:1789130195.349655:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:35424:x1876037604935296:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130195.349677:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.349698:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9ace lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe23 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349778:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349792:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349802:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349816:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349822:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349828:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349942:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349971:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.349977:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.350005:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00000004:00200000:0.0:1789130195.350009:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130195.350025:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350036:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350043:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350049:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350055:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350061:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130195.350065:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350072:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350083:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130195.350091:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130195.350111:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350118:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9ad5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350133:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350139:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350145:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350151:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130195.350154:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350160:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350167:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130195.350169:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130195.350172:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350177:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9adc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350207:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9ace lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350231:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 30 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.350251:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130195.350254:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130195.350257:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:0.0:1789130195.350327:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:35424:x1876037604935296:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 674us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.350334:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:1.0:1789130195.354254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.354411:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935552 00000100:00100000:3.0:1789130195.354435:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935552 00000100:00100000:3.0:1789130195.354517:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:3.0:1789130195.354529:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:35424:x1876037604935552:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:3.0:1789130195.354554:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130195.354576:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9aea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe2a expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.354738:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9af1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.354756:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9af1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.354769:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9af1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130195.354780:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:3.0:1789130195.354911:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9aea lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe2a expref: 33 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.354929:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9af1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe2a expref: 32 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.354937:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:3.0:1789130195.354940:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130195.354945:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:3.0:1789130195.354998:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:35424:x1876037604935552:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 472us (766us total) trans 30064771307 rc 0/0 00000100:00100000:3.0:1789130195.355006:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:1.0:1789130195.357694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.357818:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935680 00000100:00100000:0.0:1789130195.357828:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935680 00000100:00100000:0.0:1789130195.357882:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789130195.357893:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:2370:x1876037604935680:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130195.357908:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130195.357931:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce9af1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe2a expref: 32 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.357946:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130195.357950:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130195.358007:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:2370:x1876037604935680:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.358014:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789130195.358955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.359021:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604935936 00000100:00100000:0.0:1789130195.359027:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604935936 00000100:00100000:0.0:1789130195.359123:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:0.0:1789130195.359151:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:35424:x1876037604935936:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130195.359174:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.359191:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9aff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe31 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.359296:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.359313:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.359323:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.359335:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:0.0:1789130195.359816:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9aff lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe31 expref: 34 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.359834:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe31 expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.359843:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130195.359846:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130195.359849:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:0.0:1789130195.359904:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:35424:x1876037604935936:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 755us (950us total) trans 30064771308 rc 0/0 00000100:00100000:0.0:1789130195.359911:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 283 00010000:00010000:2.0:1789130195.397929:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130195.590092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.590426:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936064 00000100:00100000:3.0:1789130195.590438:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936064 00000100:00100000:3.0:1789130195.590702:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789130195.590714:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:2368:x1876037604936064:12345-192.168.201.39@tcp:1:lfs.500 00010000:00010000:3.0:1789130195.590780:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.590831:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 37 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.590841:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789130195.590846:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130195.590851:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.590907:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 37 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.590925:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 37 pid: 38727 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130195.590939:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626822272:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130195.591032:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130195.593748:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626822272:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130195.593779:0:37658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130195.613419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.613998:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936192 00000100:00100000:0.0:1789130195.614010:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936192 00010000:00010000:0.0:1789130195.614073:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 38 pid: 38727 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130195.614131:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:0.0:1789130195.614142:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604936192:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130195.614162:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130195.614186:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 38 pid: 38727 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.614212:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 38 pid: 38727 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.614238:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f983c4b/0x5c74554e47ce9a57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abdeb expref: 38 pid: 38727 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.614256:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130195.614262:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130195.614268:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.614742:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.615016:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130195.615104:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604936192:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 960us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.615127:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00010000:00010000:1.0:1789130195.616106:0:37658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616123:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616162:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616171:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616208:0:37658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616216:0:37658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130195.616220:0:37658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616229:0:37658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616250:0:37658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.616259:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b423d5e4/0x5c74554e47ce9b14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130195.617701:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+36:2368:x1876037604936064:12345-192.168.201.39@tcp:1:lfs.500 Request processed in 26978us (27611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130195.617714:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789130195.622891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.623061:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936448 00000100:00100000:2.0:1789130195.623072:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936448 00000100:00100000:2.0:1789130195.623142:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789130195.623152:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:35424:x1876037604936448:12345-192.168.201.39@tcp:35:lfs.500 00000004:00010000:2.0:1789130195.623232:0:36590:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe31 expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130195.623865:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771309 00000001:00080000:2.0:1789130195.624244:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771310 00000001:00080000:2.0:1789130195.626742:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771311 00010000:00010000:2.0:1789130195.626836:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626870:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 37 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626879:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 37 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626887:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 37 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626896:0:36590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626932:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 37 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.626948:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 37 pid: 36587 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.626963:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822400:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130195.627078:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 37 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.627087:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 37 pid: 36588 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.627096:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822528:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130195.627142:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 37 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.627152:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 37 pid: 38734 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.627162:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822656:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130195.627185:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130195.635762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.635815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.636396:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936576 00000100:00100000:3.0:1789130195.636406:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936576 00010000:00010000:3.0:1789130195.636449:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 38 pid: 36588 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130195.636533:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936704 00000100:00100000:3.0:1789130195.636537:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936704 00010000:00010000:3.0:1789130195.636551:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 39 pid: 38734 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130195.636571:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130195.636580:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604936576:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130195.636596:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130195.636631:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 39 pid: 36588 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636643:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 39 pid: 36588 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636670:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:3.0:1789130195.636675:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636683:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636690:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130195.636883:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604936576:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 304us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130195.636889:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130195.636909:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:3.0:1789130195.636921:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+38:2370:x1876037604936704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130195.636927:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130195.636932:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 38 pid: 38734 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636939:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 38 pid: 38734 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636948:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:3.0:1789130195.636951:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636956:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.636959:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130195.636975:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+38:2370:x1876037604936704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 54us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130195.636979:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130195.637149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130195.637173:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936832 00000100:00100000:1.0:1789130195.637178:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936832 00010000:00010000:1.0:1789130195.637202:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 38 pid: 36587 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130195.637243:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130195.637253:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:2370:x1876037604936832:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130195.637263:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130195.637270:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 38 pid: 36587 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.637281:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 38 pid: 36587 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.637293:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:1.0:1789130195.637297:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.637305:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.637312:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.637330:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130195.637491:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:2370:x1876037604936832:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 238us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130195.637499:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00010000:00010000:2.0:1789130195.637789:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9a9d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe07 expref: 37 pid: 36587 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.637809:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822400:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130195.637823:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9ae3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe23 expref: 36 pid: 36588 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.637833:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822528:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130195.637843:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9a8f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe00 expref: 35 pid: 38734 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130195.637853:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626822656:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130195.637883:0:36590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.637892:0:36590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.637976:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130195.638136:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771312 00000001:00080000:2.0:1789130195.639790:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771313 00000100:00100000:2.0:1789130195.639973:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626822784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130195.640048:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130195.640390:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130195.640409:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626822784 00000100:00100000:3.0:1789130195.640416:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626822784 00000100:00080000:0.0:1789130195.640533:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130195.640582:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130195.640591:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626822784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130195.640686:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626822784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130195.640694:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130195.640729:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626822784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130195.641530:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771314 00000100:00100000:0.0:1789130195.641644:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626822912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130195.641694:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130195.641716:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130195.641783:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626822912 00000100:00100000:2.0:1789130195.641788:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626822912 00000100:00100000:2.0:1789130195.641822:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130195.641828:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626822912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130195.641971:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36590:x1876037626822912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (275us total) trans 30064771112 rc 0/0 00000100:00100000:2.0:1789130195.641978:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130195.642076:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626822912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130195.642129:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771315 00010000:00010000:0.0:1789130195.642164:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642174:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642237:0:36590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642245:0:36590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130195.642250:0:36590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642257:0:36590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642272:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130195.642284:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130195.642290:0:36590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.642297:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9b1b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130195.642570:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130195.642659:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].10, 64 off8904 00000001:00080000:0.0:1789130195.642667:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771316 00010000:00010000:0.0:1789130195.642691:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130195.642694:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130195.642699:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b06 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe31 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130195.642799:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:35424:x1876037604936448:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 19648us (19918us total) trans 30064771317 rc 0/0 00000100:00100000:0.0:1789130195.642808:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000020:00080000:0.0:1789130195.642812:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789130195.650222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130195.650566:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604936960 00000100:00100000:3.0:1789130195.650578:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604936960 00000100:00100000:3.0:1789130195.650809:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:3.0:1789130195.650820:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:35424:x1876037604936960:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130195.650854:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130195.650882:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9b22 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe38 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.650947:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9b22 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe38 expref: 39 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.650964:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9b22 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe38 expref: 39 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130195.650983:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130195.650986:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130195.651002:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:3.0:1789130195.651290:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:35424:x1876037604936960:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 469us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130195.651439:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:1.0:1789130195.658839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.661909:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604937216 00000100:00100000:0.0:1789130195.661925:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604937216 00000100:00100000:0.0:1789130195.662053:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130195.662065:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:35424:x1876037604937216:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130195.662361:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:35424:x1876037604937216:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 298us (3532us total) trans 30064771318 rc 0/0 00000100:00100000:0.0:1789130195.662369:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789130195.749890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.750003:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604937344 00000100:00100000:0.0:1789130195.750015:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604937344 00000100:00100000:0.0:1789130195.750102:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 285 00000100:00100000:0.0:1789130195.750114:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:35430:x1876037604937344:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130195.750139:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.750160:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b29 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe3f expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750233:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750248:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750260:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750274:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750281:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750287:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750393:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750403:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750420:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.750475:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00000004:00200000:0.0:1789130195.750480:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130195.750498:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750508:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750516:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750522:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750528:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750534:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130195.750537:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750544:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750554:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130195.750557:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130195.750561:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750566:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b30 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750595:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750655:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750661:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750666:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130195.750669:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750675:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750682:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130195.750684:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130195.750687:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750693:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b37 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750725:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b29 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe3f expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750738:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe3f expref: 41 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.750756:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130195.750759:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130195.750762:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a400, rc 0) 00000100:00100000:0.0:1789130195.750883:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:35430:x1876037604937344:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 771us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130195.750893:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 285 00000100:00100000:1.0:1789130195.766715:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.767031:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604937600 00000100:00100000:0.0:1789130195.767040:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604937600 00000100:00100000:0.0:1789130195.767312:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:0.0:1789130195.767323:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:35430:x1876037604937600:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130195.767341:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.767359:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b45 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe46 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.767445:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b4c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.767470:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.767482:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.767494:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:0.0:1789130195.767681:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b45 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe46 expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.767716:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe46 expref: 43 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.767737:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130195.767741:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130195.767745:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:0.0:1789130195.767805:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+43:35430:x1876037604937600:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 483us (1100us total) trans 30064771319 rc 0/0 00000100:00100000:0.0:1789130195.772622:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:2.0:1789130195.780474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.780526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.780635:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604937856 00000100:00100000:0.0:1789130195.780647:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604937856 00000100:00100000:0.0:1789130195.780694:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 287 00000100:00100000:0.0:1789130195.780702:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+43:35430:x1876037604937856:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130195.780799:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130195.780819:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b5a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe4d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.780919:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.780937:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.780948:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130195.780959:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:0.0:1789130195.781320:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b5a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe4d expref: 46 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.781336:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe4d expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130195.781343:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130195.781345:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130195.781348:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ac00, rc 0) 00000100:00100000:0.0:1789130195.781411:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:35430:x1876037604937856:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 709us (955us total) trans 30064771320 rc 0/0 00000100:00100000:0.0:1789130195.781416:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 287 00000100:00100000:1.0:1789130195.781502:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604937984 00000100:00100000:1.0:1789130195.781514:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604937984 00000100:00100000:1.0:1789130195.781551:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789130195.781557:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:2370:x1876037604937984:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130195.781565:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130195.781578:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b4c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe46 expref: 45 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130195.781587:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130195.781589:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130195.781636:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604937984:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 80us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130195.781641:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789130195.878098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.878225:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604938112 00000100:00100000:2.0:1789130195.878237:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604938112 00000100:00100000:2.0:1789130195.879624:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130195.879645:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:35430:x1876037604938112:12345-192.168.201.39@tcp:103:lfs.500 00010000:00010000:2.0:1789130195.879666:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130195.879700:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b61 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe4d expref: 44 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130195.879724:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130195.879746:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130195.880299:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:35430:x1876037604938112:12345-192.168.201.39@tcp:103:lfs.500 Request processed in 661us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130195.880310:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789130195.883253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130195.883354:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604938368 00000100:00100000:2.0:1789130195.883366:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604938368 00000100:00100000:2.0:1789130195.883547:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789130195.883561:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49646a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:35430:x1876037604938368:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:2.0:1789130195.883893:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49646a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:35430:x1876037604938368:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 335us (651us total) trans 30064771321 rc 0/0 00000100:00100000:2.0:1789130195.883902:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1789130195.925794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130195.925883:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604938624 00000100:00100000:0.0:1789130195.925895:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604938624 00000100:00100000:0.0:1789130195.925960:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1789130195.925972:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:35430:x1876037604938624:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130195.926226:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:35430:x1876037604938624:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 255us (442us total) trans 30064771322 rc 0/0 00000100:00100000:0.0:1789130195.926246:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:1.0:1789130196.094725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.094834:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604938880 00000100:00100000:0.0:1789130196.094844:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604938880 00000100:00100000:0.0:1789130196.094922:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00100000:0.0:1789130196.094934:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+45:35441:x1876037604938880:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130196.094959:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130196.094979:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe54 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130196.095154:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00010000:00010000:0.0:1789130196.095286:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe54 expref: 47 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.095302:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130196.095305:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130196.095311:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe54 expref: 47 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.095325:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:0.0:1789130196.095398:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+46:35441:x1876037604938880:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 467us (683us total) trans 30064771323 rc 301/301 00000100:00100000:0.0:1789130196.095406:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00080000:1.0:1789130196.095778:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130196.107962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.108853:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604939008 00000100:00100000:0.0:1789130196.108866:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604939008 00000100:00100000:0.0:1789130196.109069:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 289 00000100:00100000:0.0:1789130196.109089:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:35441:x1876037604939008:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130196.109166:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109196:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109209:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109225:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109249:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109256:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109392:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109400:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109413:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130196.109466:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109478:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109485:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109491:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109496:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130196.109500:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109507:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109526:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130196.109529:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130196.109535:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109541:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9b7d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109555:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109560:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109565:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109571:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130196.109574:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109580:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109587:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130196.109599:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130196.109624:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109631:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9b84 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109658:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109664:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109669:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109674:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130196.109677:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109682:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109689:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130196.109691:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130196.109695:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.109699:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9b8b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130196.110330:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:35441:x1876037604939008:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1248us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130196.110340:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 289 00000100:00100000:2.0:1789130196.114184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.117239:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604939264 00000100:00100000:0.0:1789130196.117254:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604939264 00000100:00100000:0.0:1789130196.117382:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130196.117775:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:35441:x1876037604939264:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130196.118068:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:35441:x1876037604939264:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 298us (3893us total) trans 30064771324 rc 0/0 00000100:00100000:0.0:1789130196.118076:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000004:00080000:2.0:1789130196.229831:0:36612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1359327225462ns, next at 1360327223012ns, rc = 0 00000100:00100000:3.0:1789130196.231394:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130196.231505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130196.234277:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823040 00000100:00100000:0.0:1789130196.234294:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823040 00000100:00100000:0.0:1789130196.234380:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130196.234390:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626823040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130196.234438:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 95354880 pending 25559040 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789130196.234558:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626823040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130196.234566:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130196.234671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130196.239667:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626823296:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.239759:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130196.239820:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789130196.240103:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626823552:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.240140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130196.240164:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130196.240169:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626823424:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.240192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130196.240218:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823296 00000100:00100000:2.0:1789130196.240224:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823296 00000100:00100000:2.0:1789130196.240276:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130196.240284:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.240320:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626823296:12345-0@lo:400:kworker.0 Request processed in 38us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130196.240333:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130196.240355:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823552 00000100:00100000:2.0:1789130196.240357:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823552 00000100:00100000:2.0:1789130196.240379:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823424 00000100:00100000:2.0:1789130196.240381:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823424 00000100:00100000:2.0:1789130196.240396:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789130196.240400:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626823552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130196.240415:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130196.240429:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626823424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.240480:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626823552:12345-0@lo:400:kworker.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130196.240489:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130196.240663:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626823424:12345-0@lo:400:kworker.0 Request processed in 237us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130196.240671:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789130196.246232:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130196.246242:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130196.246295:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626823424:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246312:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626823552:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246351:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626823168:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246420:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130196.246484:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626823680:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130196.246546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626823296:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246573:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823680 00000100:00100000:2.0:1789130196.246579:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823680 00000100:00100000:2.0:1789130196.246657:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789130196.246667:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626823680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.246724:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626823680:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130196.246748:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789130196.246768:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130196.246785:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626823680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130196.247106:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823168 00000100:00100000:3.0:1789130196.247119:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823168 00000100:00100000:3.0:1789130196.247154:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789130196.247161:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626823168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130196.247220:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626823168:12345-0@lo:400:kworker.0 Request processed in 59us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130196.247227:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789130196.247264:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626823168:0@lo:400:kworker.0 00000100:00100000:2.0:1789130196.269216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130196.269251:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604939520 00000100:00100000:2.0:1789130196.269261:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604939520 00000100:00100000:2.0:1789130196.269319:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 290 00000100:00100000:2.0:1789130196.269331:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:35451:x1876037604939520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130196.269359:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130196.269382:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe5b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130196.290461:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 7680 00010000:00010000:2.0:1789130196.290744:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9b92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe5b expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.290762:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130196.290765:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130196.290772:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ce9b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe5b expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.290784:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:2.0:1789130196.290853:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:35451:x1876037604939520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 21523us (21647us total) trans 30064771325 rc 301/301 00000100:00100000:2.0:1789130196.290864:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 290 00000100:00100000:1.0:1789130196.297433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130196.298301:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604939776 00000100:00100000:2.0:1789130196.298334:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604939776 00000100:00100000:2.0:1789130196.298395:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130196.298406:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:35451:x1876037604939776:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130196.299460:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:35451:x1876037604939776:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1040us (2025us total) trans 30064771326 rc 0/0 00000100:00100000:2.0:1789130196.299472:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000001:00080000:3.0:1789130196.337146:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771324 is committed 00000020:00080000:3.0:1789130196.337177:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4bad44a80 refcount 2 committed 0 result 0 batchid 25769803907 00000020:00080000:3.0:1789130196.337184:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381272700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bad44780 00000020:00080000:3.0:1789130196.337188:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381272900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b387308800 00000004:00080000:3.0:1789130196.337219:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1789130196.337249:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789130196.337261:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1789130196.337369:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1789130196.337376:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803907 committed batchid 25769803906 00000100:00100000:2.0:1789130196.337386:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626823808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130196.337474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130196.337523:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823808 00000100:00100000:3.0:1789130196.337531:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823808 00000020:00080000:1.0:1789130196.337557:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000100:00100000:3.0:1789130196.337588:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789130196.337596:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626823808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130196.337749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626823936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130196.337779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1789130196.337790:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:3.0:1789130196.337794:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb mtime from disk: 1789130194 -> 1789130194 00002000:00010000:3.0:1789130196.337796:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130196.337798:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb ctime from disk: 1789130194 -> 1789130194 00002000:00010000:3.0:1789130196.337800:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:1.0:1789130196.337816:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626823936 00000100:00100000:1.0:1789130196.337819:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626823936 00000100:00100000:3.0:1789130196.337841:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626823808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (368us total) trans 30064771180 rc 0/0 00000100:00100000:1.0:1789130196.337842:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789130196.337848:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626823936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130196.337849:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789130196.337979:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626823936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (198us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1789130196.337986:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000004:00080000:3.0:1789130196.338008:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384b51680/2, rc 0, transno 30064771113 00000100:00100000:3.0:1789130196.338031:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626823936:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1789130196.338393:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383f2b0c0/2, rc 0, transno 30064771180 00000100:00100000:2.0:1789130196.338399:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626823808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130196.339418:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626824064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130196.339488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130196.339633:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626824064 00000100:00100000:0.0:1789130196.339639:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626824064 00000100:00100000:0.0:1789130196.339706:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130196.339714:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626824064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789130196.339735:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:199 count 1 00002000:00010000:0.0:1789130196.339771:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 15728640, mtime: 0x6aa3f5d2, atime: 0x0, ctime: 0x6aa3f5d2, blocks: 0x1 00010000:00010000:0.0:1789130196.339778:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.339792:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=1359s v=(0 0) 00010000:00010000:0.0:1789130196.339796:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130196.339801:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.339828:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.339835:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.339840:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.339861:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130196.340506:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1876037626824064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 779us (1005us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1789130196.340515:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:1.0:1789130196.340589:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130196.340597:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130196.340631:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130196.340635:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130196.340643:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384b53c00/2, rc 0, transno 30064771114 00010000:00010000:1.0:1789130196.340643:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130196.340654:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626824064:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789130196.340665:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130196.340672:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce9ba0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130196.340688:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130196.340689:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130196.340690:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130196.346293:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771170 is committed 00000001:00080000:1.0:1789130196.346331:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771178 is committed 00000001:00080000:1.0:1789130196.346345:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771179 is committed 00000100:00100000:2.0:1789130196.420107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.420296:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940032 00000100:00100000:0.0:1789130196.420309:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940032 00000100:00100000:0.0:1789130196.420424:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 291 00000100:00100000:0.0:1789130196.420438:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:35457:x1876037604940032:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130196.420483:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130196.420510:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9ba7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe62 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420590:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420623:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420659:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420677:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420684:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.420690:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130196.421969:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130196.423761:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9bbc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423778:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9bbc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423788:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9bbc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130196.423796:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:0.0:1789130196.423887:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423893:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423898:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423902:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130196.423914:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423920:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423929:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:0.0:1789130196.423931:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130196.423935:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423939:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9bae lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423950:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423953:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423957:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423960:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130196.423962:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423965:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423968:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130196.423970:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130196.423975:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.423979:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bb5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.424044:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9ba7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe62 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.424060:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9bbc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe62 expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.424068:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130196.424070:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130196.424073:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:0.0:1789130196.424143:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940032:12345-192.168.201.39@tcp:101:dd.500 Request processed in 3708us (4046us total) trans 30064771327 rc 0/0 00000100:00100000:0.0:1789130196.424153:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 291 00000100:00100000:0.0:1789130196.429333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130196.429586:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940288 00000100:00100000:3.0:1789130196.429597:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940288 00000100:00100000:3.0:1789130196.430395:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 292 00000100:00100000:3.0:1789130196.430408:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940288:12345-192.168.201.39@tcp:36:dd.500 00010000:00010000:3.0:1789130196.430486:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130196.430517:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9bbc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe62 expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130196.430532:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130196.430537:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130196.430790:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130196.430801:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130196.430809:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130196.430861:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771328 00000004:00010000:3.0:1789130196.430877:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000019d5e74f reply state 0000000018a37d19 transno 30064771329 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130196.430884:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130196.430972:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:35457:x1876037604940288:12345-192.168.201.39@tcp:36:dd.500 Request processed in 567us (1648us total) trans 30064771329 rc 0/0 00000100:00100000:3.0:1789130196.430992:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 292 00000020:00080000:3.0:1789130196.430997:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789130196.432836:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432852:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432860:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432866:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130196.432884:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432894:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432918:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:2.0:1789130196.432920:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130196.432924:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130196.432928:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9bca lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130196.741894:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130196.741916:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130196.742551:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 3 00000040:00080000:1.0:1789130196.742560:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130196.746273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130196.746528:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940544 00000100:00100000:1.0:1789130196.746540:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940544 00000100:00100000:1.0:1789130196.746639:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789130196.746662:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:35457:x1876037604940544:12345-192.168.201.39@tcp:103:dd.500 00010000:00010000:1.0:1789130196.746679:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130196.746706:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9b22 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe38 expref: 26 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130196.746726:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130196.746737:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130196.746807:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940544:12345-192.168.201.39@tcp:103:dd.500 Request processed in 149us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130196.746817:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789130196.754083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.754245:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940672 00000100:00100000:0.0:1789130196.754255:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940672 00000100:00100000:0.0:1789130196.754322:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 293 00000100:00100000:0.0:1789130196.754332:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940672:12345-192.168.201.39@tcp:58:dd.500 00010000:00010000:0.0:1789130196.754456:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.754475:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.754504:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130196.755254:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].8, 136 off9280 00000100:00100000:0.0:1789130196.756796:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940672:12345-192.168.201.39@tcp:58:dd.500 Request processed in 2457us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130196.756806:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 293 00000100:00100000:2.0:1789130196.760314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130196.760398:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940800 00000100:00100000:0.0:1789130196.760407:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940800 00000100:00100000:0.0:1789130196.760479:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 294 00000100:00100000:0.0:1789130196.760488:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:35457:x1876037604940800:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130196.760508:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130196.760527:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe69 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760580:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760589:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760631:0:36588:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760641:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760652:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130196.760665:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130196.760669:0:36588:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130196.760674:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b600, rc 0) 00000100:00100000:0.0:1789130196.760726:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:35457:x1876037604940800:12345-192.168.201.39@tcp:101:dd.500 Request processed in 239us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130196.760733:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 294 00000100:00100000:2.0:1789130197.255794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626824192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130197.255871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130197.256008:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626824192 00000100:00100000:0.0:1789130197.256016:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626824192 00000100:00100000:0.0:1789130197.256121:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130197.256131:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626824192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130197.256166:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 180551680 pending 0 free 3772776448 avail 3770679296 00000100:00100000:0.0:1789130197.256223:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626824192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130197.256232:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789130197.257502:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626824192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130197.445921:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130197.530709:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.530807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.530844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.530937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.530970:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941312 00000100:00100000:3.0:1789130197.530978:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941312 00000100:00100000:3.0:1789130197.531044:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:3.0:1789130197.531055:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604941312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130197.531110:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941184 00000100:00100000:2.0:1789130197.531116:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941184 00000100:00100000:3.0:1789130197.531154:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604941312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.531158:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941056 00000100:00100000:2.0:1789130197.531163:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941056 00000100:00100000:3.0:1789130197.531164:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130197.531208:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789130197.531218:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:2370:x1876037604941184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130197.531268:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:2370:x1876037604941184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00080000:3.0:1789130197.531276:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130197.531276:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00080000:3.0:1789130197.531282:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130197.531287:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130197.531298:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130197.531308:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604941056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130197.531355:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604941056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.531362:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1789130197.532187:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604940928 00000100:00100000:0.0:1789130197.532196:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604940928 00000100:00100000:0.0:1789130197.532237:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130197.532245:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604940928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130197.532287:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604940928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130197.532294:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000040:00080000:1.0:1789130197.767960:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130197.767971:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130197.768016:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 4 00000040:00080000:1.0:1789130197.768028:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130197.768332:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b530c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626824320:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130197.768486:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482bd6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130197.778511:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b530c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626824320:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130197.784891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130197.784986:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941440 00000100:00100000:0.0:1789130197.784997:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941440 00000100:00100000:0.0:1789130197.785079:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 295 00000100:00100000:0.0:1789130197.785090:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604941440:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130197.785142:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130197.785257:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604941440:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 168us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130197.785263:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 295 00000100:00100000:3.0:1789130197.791465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130197.792685:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941568 00000100:00100000:1.0:1789130197.792700:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941568 00000100:00100000:1.0:1789130197.793793:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 296 00000100:00100000:1.0:1789130197.793820:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604941568:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130197.793907:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793926:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793937:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793952:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793958:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793965:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793988:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.793996:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794001:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130197.794041:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00000004:00200000:1.0:1789130197.794061:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130197.794075:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794087:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794093:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794100:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794106:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130197.794110:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794117:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794128:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130197.794131:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130197.794136:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794142:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9bdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794153:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794158:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794172:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794177:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130197.794180:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794186:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794193:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdcf8d881 (ffff90b4909bd400) 00010000:00010000:1.0:1789130197.794195:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130197.794198:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794203:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9be6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794216:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794221:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794226:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794231:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130197.794234:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794247:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794254:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130197.794256:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130197.794259:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.794264:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9bed lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130197.794370:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604941568:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 565us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130197.794379:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 296 00000100:00100000:3.0:1789130197.813430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.813523:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941824 00000100:00100000:2.0:1789130197.813554:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941824 00000100:00100000:2.0:1789130197.813692:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 297 00000100:00100000:2.0:1789130197.813705:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604941824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130197.813729:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130197.813759:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9bf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe70 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.813869:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.813882:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.813890:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130197.813899:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00010000:00010000:2.0:1789130197.813986:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.813992:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.813996:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814000:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130197.814004:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814009:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814025:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:2.0:1789130197.814028:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130197.814032:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814036:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9bfb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814074:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9bf4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe70 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814081:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130197.814082:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130197.814085:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9bf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe70 expref: 28 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.814091:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130197.814162:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604941824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 462us (751us total) trans 30064771330 rc 301/301 00000100:00100000:2.0:1789130197.814168:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 297 00000100:00100000:0.0:1789130197.820754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.824257:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604941952 00000100:00100000:2.0:1789130197.824276:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604941952 00000100:00100000:2.0:1789130197.824448:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 298 00000100:00100000:2.0:1789130197.824461:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604941952:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130197.824511:0:36588:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130197.824669:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604941952:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 210us (3925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.824730:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 298 00000100:00100000:0.0:1789130197.838737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130197.838947:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604942208 00000100:00100000:1.0:1789130197.838958:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604942208 00000100:00100000:1.0:1789130197.839022:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 299 00000100:00100000:1.0:1789130197.839034:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604942208:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130197.839057:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130197.839061:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130197.839101:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9ac7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe1c expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.839119:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:1.0:1789130197.839126:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130197.839140:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c09 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe77 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130197.840139:0:38723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc8:0x0], index 1: 0 00010000:00010000:1.0:1789130197.840410:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9c10 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.840438:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9c10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.840450:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9c10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.840512:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c09 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe77 expref: 29 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.840530:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9c10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe77 expref: 28 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.840539:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130197.840542:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130197.840545:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00100000:1.0:1789130197.840643:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:35458:x1876037604942208:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1610us (1915us total) trans 30064771331 rc 0/0 00000100:00100000:1.0:1789130197.840651:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 299 00000100:00100000:0.0:1789130197.855775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.856060:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604942464 00000100:00100000:2.0:1789130197.856080:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604942464 00000100:00100000:2.0:1789130197.856148:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 300 00000100:00100000:2.0:1789130197.856160:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:35458:x1876037604942464:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130197.856232:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130197.856269:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9c10 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe77 expref: 28 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856292:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130197.856304:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130197.856336:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856354:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856366:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856394:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856402:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856409:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856787:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856811:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856818:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856826:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130197.856831:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856838:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856849:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130197.856852:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130197.856857:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856862:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c1e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856873:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856879:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856884:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856895:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130197.856899:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856905:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856914:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x5cc9d4b0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130197.856916:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130197.856919:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.856926:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c25 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x5cc9d4b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130197.857033:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604942464:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 873us (1265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130197.857042:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 300 00000100:00100000:0.0:1789130197.863687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130197.863786:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604942592 00000100:00100000:1.0:1789130197.863808:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604942592 00000100:00100000:1.0:1789130197.863873:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 301 00000100:00100000:1.0:1789130197.863884:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:35458:x1876037604942592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130197.863908:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130197.863940:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9c2c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe7e expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.863973:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.863984:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.863993:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.864105:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce9c2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 29 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.864122:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 28 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.864130:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130197.864133:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130197.864137:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130197.864200:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:35458:x1876037604942592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 319us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130197.864206:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 301 00000100:00100000:1.0:1789130197.872558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130197.872683:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604942848 00000100:00100000:0.0:1789130197.872693:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604942848 00000100:00100000:0.0:1789130197.872756:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 302 00000100:00100000:0.0:1789130197.872767:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+28:35458:x1876037604942848:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130197.872850:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130197.872869:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130197.872881:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130197.873654:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].11, 88 off8992 00000004:00080000:0.0:1789130197.873665:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1360971062304ns, next at 1361971060204ns, rc = 0 00000004:00010000:0.0:1789130197.873749:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d37ca15c reply state 000000000aff51b6 transno 30064771332 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130197.873760:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130197.873865:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:35458:x1876037604942848:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1098us (1315us total) trans 30064771332 rc 0/0 00000100:00100000:0.0:1789130197.873882:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 302 00010000:00010000:2.0:1789130197.878158:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878174:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878179:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878183:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130197.878187:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878206:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878220:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789130197.878222:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130197.878225:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.878229:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c3a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130197.878471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.878528:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604942976 00000100:00100000:3.0:1789130197.878538:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604942976 00000100:00100000:3.0:1789130197.878771:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 303 00000100:00100000:0.0:1789130197.879347:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:35458:x1876037604942976:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130197.879413:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130197.879442:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe85 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130197.879504:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 30 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130197.879518:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 30 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130197.879539:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130197.879541:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130197.879543:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:0.0:1789130197.879669:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:35458:x1876037604942976:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 818us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130197.879677:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 303 00000100:00100000:1.0:1789130197.882807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130197.882877:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604943104 00000100:00100000:0.0:1789130197.882885:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604943104 00000100:00100000:0.0:1789130197.882959:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1789130197.882967:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:2369:x1876037604943104:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789130197.883325:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604943104:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 356us (524us total) trans 30064771115 rc 0/0 00000100:00100000:0.0:1789130197.883354:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130197.888564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.888663:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604943360 00000100:00100000:2.0:1789130197.888671:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604943360 00000100:00100000:2.0:1789130197.888722:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130197.888729:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:35458:x1876037604943360:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130197.888927:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:35458:x1876037604943360:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 197us (372us total) trans 30064771333 rc 0/0 00000100:00100000:2.0:1789130197.888932:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:1.0:1789130197.890818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.890929:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604943616 00000100:00100000:2.0:1789130197.890938:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604943616 00000100:00100000:2.0:1789130197.890993:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 304 00000100:00100000:2.0:1789130197.891003:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:35458:x1876037604943616:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130197.891112:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:35458:x1876037604943616:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.891118:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 304 00000100:00100000:1.0:1789130197.894256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.894409:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604943744 00000100:00100000:2.0:1789130197.894434:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604943744 00000100:00100000:2.0:1789130197.894488:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:2.0:1789130197.894498:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:35458:x1876037604943744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130197.894518:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130197.894539:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c48 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe8c expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895532:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895554:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895567:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130197.895619:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130197.895638:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895670:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9c48 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe8c expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895687:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe8c expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.895696:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789130197.895699:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789130197.895702:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130197.895901:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:35458:x1876037604943744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1404us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.895917:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:1.0:1789130197.901060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.901175:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604943872 00000100:00100000:3.0:1789130197.901184:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604943872 00000100:00100000:3.0:1789130197.901233:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:3.0:1789130197.901241:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604943872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130197.901257:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130197.901286:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe93 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130197.901307:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f5d5, blocks: 0x1 00010000:00010000:3.0:1789130197.901324:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=1360s v=(0 0) 00010000:00010000:3.0:1789130197.901327:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130197.901334:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 38 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130197.901348:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 38 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130197.901358:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87600, rc 0) 00000100:00100000:3.0:1789130197.901416:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604943872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 176us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130197.901432:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:1.0:1789130197.911075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130197.911210:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944128 00000100:00100000:0.0:1789130197.911222:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944128 00000100:00100000:0.0:1789130197.911288:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:0.0:1789130197.911300:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:35458:x1876037604944128:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130197.911435:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:35458:x1876037604944128:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 137us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130197.911443:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:1.0:1789130197.917467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.917623:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944256 00000100:00100000:2.0:1789130197.917633:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944256 00000100:00100000:2.0:1789130197.917700:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130197.917711:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+38:35458:x1876037604944256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130197.917729:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130197.917747:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abe9a expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.917778:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.917787:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130197.917792:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130197.917798:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 39 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.917838:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.917852:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130197.917868:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626824448:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130197.917984:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130197.921201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.921299:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626824448:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130197.921343:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 39 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130197.921368:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130197.921463:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:35458:x1876037604944256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3753us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130197.921473:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1789130197.922089:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944384 00000100:00100000:1.0:1789130197.922097:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944384 00010000:00010000:1.0:1789130197.922136:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130197.922173:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130197.922183:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604944384:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130197.922199:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130197.922224:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.922236:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.922262:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028febcdb/0x5c74554e47ce9c56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe93 expref: 39 pid: 37276 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.922277:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130197.922281:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130197.922289:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 38 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.922300:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 38 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130197.922355:0:36574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 38 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130197.922382:0:36574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:36574:1876037626824576:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130197.922467:0:36574:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482bd6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130197.929568:0:36574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:36574:1876037626824576:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130197.929633:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130197.929689:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604944384:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 7506us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130197.929702:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130197.947556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130197.947704:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944512 00000100:00100000:2.0:1789130197.947713:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944512 00002000:00100000:2.0:1789130197.947778:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff90b486df5a40 x1876037604944512/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/0 e 0 to 0 dl 1789130208 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130197.947791:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df5a40 with x1876037604944512 ext(0->1048575) 00002000:00010000:2.0:1789130197.947798:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df5a40 00000100:00100000:2.0:1789130197.947835:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:2.0:1789130197.947845:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604944512:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130197.975443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130197.979931:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944640 00000100:00100000:1.0:1789130197.979947:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944640 00002000:00100000:1.0:1789130197.980002:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff90b383f2a580 x1876037604944640/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/0 e 0 to 0 dl 1789130208 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130197.980027:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a580 with x1876037604944640 ext(1048576->2097151) 00002000:00010000:1.0:1789130197.980035:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a580 00000100:00100000:2.0:1789130197.981081:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604944512:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 33232us (33532us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1789130197.984674:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:0.0:1789130197.984871:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:0.0:1789130197.984896:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604944640:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00002000:00100000:2.0:1789130197.985473:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff90b486df5a40 x1876037604944512/t30064771116(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/448 e 0 to 0 dl 1789130208 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130197.985488:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df5a40 with x1876037604944512 ext(0->1048575) 00002000:00010000:2.0:1789130197.985496:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df5a40 00000100:00100000:0.0:1789130197.989704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130197.992289:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944768 00000100:00100000:3.0:1789130197.992309:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944768 00002000:00100000:3.0:1789130197.992394:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff90b486df5e00 x1876037604944768/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/0 e 0 to 0 dl 1789130208 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130197.992408:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df5e00 with x1876037604944768 ext(2097152->3145727) 00002000:00010000:3.0:1789130197.992415:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df5e00 00000100:00100000:3.0:1789130197.992476:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1789130197.992489:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037604944768:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.004799:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604944640:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 19906us (29368us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1789130198.004811:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00002000:00100000:1.0:1789130198.004821:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff90b383f2a580 x1876037604944640/t30064771117(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/448 e 0 to 0 dl 1789130208 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.004829:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a580 with x1876037604944640 ext(1048576->2097151) 00002000:00010000:1.0:1789130198.004834:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a580 00000100:00100000:0.0:1789130198.013199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.013459:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604944896 00000100:00100000:1.0:1789130198.013469:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604944896 00002000:00100000:1.0:1789130198.013519:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff90b486df6d00 x1876037604944896/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.013531:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df6d00 with x1876037604944896 ext(3145728->4194303) 00002000:00010000:1.0:1789130198.013537:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df6d00 00000100:00100000:1.0:1789130198.013794:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:1.0:1789130198.013803:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604944896:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130198.017120:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:2370:x1876037604944768:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 24624us (27416us total) trans 30064771118 rc 0/0 00000100:00100000:3.0:1789130198.017141:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00002000:00100000:3.0:1789130198.017155:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff90b486df5e00 x1876037604944768/t30064771118(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:668/0 lens 488/448 e 0 to 0 dl 1789130208 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.017167:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df5e00 with x1876037604944768 ext(2097152->3145727) 00002000:00010000:3.0:1789130198.017174:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df5e00 00000100:00100000:1.0:1789130198.025403:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+46:2370:x1876037604944896:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 11587us (12198us total) trans 30064771119 rc 0/0 00000100:00100000:1.0:1789130198.025429:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00002000:00100000:1.0:1789130198.025445:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff90b486df6d00 x1876037604944896/t30064771119(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.025456:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df6d00 with x1876037604944896 ext(3145728->4194303) 00002000:00010000:1.0:1789130198.025463:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df6d00 00000100:00100000:2.0:1789130198.025902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.026004:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945024 00000100:00100000:0.0:1789130198.026024:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945024 00002000:00100000:0.0:1789130198.026078:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff90b383f28000 x1876037604945024/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.026090:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f28000 with x1876037604945024 ext(4194304->5242879) 00002000:00010000:0.0:1789130198.026094:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f28000 00000100:00100000:0.0:1789130198.026130:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:0.0:1789130198.026143:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+46:2368:x1876037604945024:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.037785:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+48:2368:x1876037604945024:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 11631us (11872us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1789130198.037799:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00002000:00100000:1.0:1789130198.037815:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff90b383f28000 x1876037604945024/t30064771120(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.037824:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f28000 with x1876037604945024 ext(4194304->5242879) 00002000:00010000:1.0:1789130198.037831:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f28000 00000100:00100000:0.0:1789130198.040920:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.041816:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945152 00000100:00100000:1.0:1789130198.041827:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945152 00002000:00100000:1.0:1789130198.041891:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff90b486df4f00 x1876037604945152/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.041900:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df4f00 with x1876037604945152 ext(5242880->6291455) 00002000:00010000:1.0:1789130198.041905:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df4f00 00000100:00100000:1.0:1789130198.041923:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:1.0:1789130198.041930:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:2368:x1876037604945152:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.055579:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:2368:x1876037604945152:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 13635us (14653us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1789130198.055594:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00002000:00100000:1.0:1789130198.055656:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff90b486df4f00 x1876037604945152/t30064771121(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.055668:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df4f00 with x1876037604945152 ext(5242880->6291455) 00002000:00010000:1.0:1789130198.055676:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df4f00 00000100:00100000:2.0:1789130198.056638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130198.056784:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945280 00000100:00100000:3.0:1789130198.056794:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945280 00002000:00100000:3.0:1789130198.056838:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff90b383f2b480 x1876037604945280/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.056849:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2b480 with x1876037604945280 ext(6291456->7340031) 00002000:00010000:3.0:1789130198.056854:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2b480 00000100:00100000:3.0:1789130198.056889:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:3.0:1789130198.056899:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:2367:x1876037604945280:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130198.068437:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:2367:x1876037604945280:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 11519us (11783us total) trans 30064771122 rc 0/0 00000100:00100000:3.0:1789130198.068452:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00002000:00100000:3.0:1789130198.068467:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff90b383f2b480 x1876037604945280/t30064771122(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.068478:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2b480 with x1876037604945280 ext(6291456->7340031) 00002000:00010000:3.0:1789130198.068486:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2b480 00000100:00100000:1.0:1789130198.074230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.074330:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945408 00000100:00100000:0.0:1789130198.074352:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945408 00002000:00100000:0.0:1789130198.074403:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff90b384b53480 x1876037604945408/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.074427:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53480 with x1876037604945408 ext(7340032->8388607) 00002000:00010000:0.0:1789130198.074434:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53480 00000100:00100000:0.0:1789130198.074460:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:0.0:1789130198.074468:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:2368:x1876037604945408:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.081091:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2368:x1876037604945408:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 6607us (6855us total) trans 30064771123 rc 0/0 00000100:00100000:1.0:1789130198.081109:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00002000:00100000:1.0:1789130198.081123:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff90b384b53480 x1876037604945408/t30064771123(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.081131:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53480 with x1876037604945408 ext(7340032->8388607) 00002000:00010000:1.0:1789130198.081138:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53480 00000100:00100000:2.0:1789130198.088788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.088879:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945536 00000100:00100000:0.0:1789130198.088891:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945536 00002000:00100000:0.0:1789130198.088946:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff90b38685e1c0 x1876037604945536/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.088957:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e1c0 with x1876037604945536 ext(8388608->9437183) 00002000:00010000:0.0:1789130198.088964:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685e1c0 00000100:00100000:0.0:1789130198.089003:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:0.0:1789130198.089171:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:2369:x1876037604945536:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.101833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.101862:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945664 00000100:00100000:1.0:1789130198.101880:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945664 00002000:00100000:1.0:1789130198.101927:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff90b384b51a40 x1876037604945664/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.101937:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51a40 with x1876037604945664 ext(9437184->10485759) 00002000:00010000:1.0:1789130198.101944:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51a40 00000100:00100000:1.0:1789130198.101969:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:1.0:1789130198.101981:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+56:2369:x1876037604945664:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130198.103276:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:2369:x1876037604945536:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 14259us (14490us total) trans 30064771124 rc 0/0 00000100:00100000:0.0:1789130198.103288:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00002000:00100000:0.0:1789130198.103297:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff90b38685e1c0 x1876037604945536/t30064771124(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.103308:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e1c0 with x1876037604945536 ext(8388608->9437183) 00002000:00010000:0.0:1789130198.103313:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685e1c0 00000100:00100000:1.0:1789130198.124997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.125055:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945792 00000100:00100000:1.0:1789130198.125066:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945792 00002000:00100000:1.0:1789130198.125124:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff90b384b51e00 x1876037604945792/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.125135:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51e00 with x1876037604945792 ext(10485760->11534335) 00002000:00010000:1.0:1789130198.125142:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51e00 00000100:00100000:1.0:1789130198.125169:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:1.0:1789130198.125178:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+59:2369:x1876037604945792:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130198.131311:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+60:2369:x1876037604945664:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 29096us (29252us total) trans 30064771125 rc 0/0 00000100:00100000:0.0:1789130198.131340:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00002000:00100000:0.0:1789130198.131357:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff90b384b51a40 x1876037604945664/t30064771125(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.131375:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51a40 with x1876037604945664 ext(9437184->10485759) 00002000:00010000:0.0:1789130198.131382:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51a40 00000100:00100000:1.0:1789130198.132924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.133213:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604945920 00000100:00100000:0.0:1789130198.133225:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604945920 00002000:00100000:0.0:1789130198.133284:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff90b384b52d00 x1876037604945920/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.133295:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b52d00 with x1876037604945920 ext(11534336->12582911) 00002000:00010000:0.0:1789130198.133301:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b52d00 00000100:00100000:0.0:1789130198.133336:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:0.0:1789130198.133345:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+60:2369:x1876037604945920:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130198.136504:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+62:2369:x1876037604945792:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 11314us (11506us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1789130198.136520:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00002000:00100000:2.0:1789130198.136534:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff90b384b51e00 x1876037604945792/t30064771126(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130198.136545:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51e00 with x1876037604945792 ext(10485760->11534335) 00002000:00010000:2.0:1789130198.136554:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51e00 00000100:00100000:1.0:1789130198.144675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.144946:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946048 00000100:00100000:1.0:1789130198.144957:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946048 00002000:00100000:1.0:1789130198.145006:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff90b384b50f00 x1876037604946048/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.145019:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50f00 with x1876037604946048 ext(12582912->13631487) 00002000:00010000:1.0:1789130198.145027:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50f00 00000100:00100000:1.0:1789130198.145941:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130198.145956:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:2369:x1876037604946048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130198.154009:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+64:2369:x1876037604945920:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20650us (21082us total) trans 30064771127 rc 0/0 00000100:00100000:0.0:1789130198.154257:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00002000:00100000:0.0:1789130198.154274:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff90b384b52d00 x1876037604945920/t30064771127(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.154286:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b52d00 with x1876037604945920 ext(11534336->12582911) 00002000:00010000:0.0:1789130198.154295:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b52d00 00000100:00100000:1.0:1789130198.160212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.160302:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946176 00000100:00100000:0.0:1789130198.160313:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946176 00002000:00100000:0.0:1789130198.160366:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff90b384b50780 x1876037604946176/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.160398:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50780 with x1876037604946176 ext(13631488->14680063) 00002000:00010000:0.0:1789130198.160405:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50780 00000100:00100000:0.0:1789130198.160495:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:0.0:1789130198.160506:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:2370:x1876037604946176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.173584:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:2369:x1876037604946048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 27618us (28903us total) trans 30064771128 rc 0/0 00000100:00100000:1.0:1789130198.173600:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00002000:00100000:1.0:1789130198.174193:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff90b384b50f00 x1876037604946048/t30064771128(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.174206:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50f00 with x1876037604946048 ext(12582912->13631487) 00002000:00010000:1.0:1789130198.174214:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50f00 00000100:00100000:0.0:1789130198.181452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.181548:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946304 00000100:00100000:1.0:1789130198.181561:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946304 00002000:00100000:1.0:1789130198.181647:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff90b486df4780 x1876037604946304/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.181661:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df4780 with x1876037604946304 ext(14680064->15728639) 00002000:00010000:1.0:1789130198.181669:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df4780 00000100:00100000:1.0:1789130198.181712:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:1.0:1789130198.181723:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+66:2370:x1876037604946304:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.188144:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+68:2370:x1876037604946176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 27627us (27931us total) trans 30064771129 rc 0/0 00000100:00100000:1.0:1789130198.188160:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00002000:00100000:1.0:1789130198.188175:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff90b384b50780 x1876037604946176/t30064771129(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.188204:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50780 with x1876037604946176 ext(13631488->14680063) 00002000:00010000:1.0:1789130198.188211:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50780 00000100:00100000:3.0:1789130198.201057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.202599:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+68:2370:x1876037604946304:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20868us (21149us total) trans 30064771130 rc 0/0 00000100:00100000:1.0:1789130198.202652:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00002000:00100000:1.0:1789130198.202664:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff90b486df4780 x1876037604946304/t30064771130(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.202672:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df4780 with x1876037604946304 ext(14680064->15728639) 00002000:00010000:1.0:1789130198.202678:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df4780 00000100:00100000:1.0:1789130198.202701:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946432 00000100:00100000:1.0:1789130198.202706:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946432 00002000:00100000:1.0:1789130198.202732:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (15728640->16777215) req@ffff90b384a543c0 x1876037604946432/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.202737:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a543c0 with x1876037604946432 ext(15728640->16777215) 00002000:00010000:1.0:1789130198.202739:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a543c0 00000100:00100000:1.0:1789130198.202762:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:1.0:1789130198.202769:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+68:2370:x1876037604946432:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.226636:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+70:2370:x1876037604946432:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 23853us (25581us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1789130198.226654:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00002000:00100000:1.0:1789130198.226671:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (15728640->16777215) req@ffff90b384a543c0 x1876037604946432/t30064771131(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.226706:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a543c0 with x1876037604946432 ext(15728640->16777215) 00002000:00010000:1.0:1789130198.226714:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a543c0 00000100:00100000:2.0:1789130198.230664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.230755:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946560 00000100:00100000:1.0:1789130198.230766:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946560 00002000:00100000:1.0:1789130198.230819:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (16777216->17825791) req@ffff90b38685d2c0 x1876037604946560/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.230831:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685d2c0 with x1876037604946560 ext(16777216->17825791) 00002000:00010000:1.0:1789130198.230838:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685d2c0 00000100:00100000:1.0:1789130198.230875:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:1.0:1789130198.230885:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:2369:x1876037604946560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130198.242566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130198.243251:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+72:2369:x1876037604946560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 12366us (12599us total) trans 30064771132 rc 0/0 00000100:00100000:3.0:1789130198.243275:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00002000:00100000:3.0:1789130198.243286:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (16777216->17825791) req@ffff90b38685d2c0 x1876037604946560/t30064771132(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.243294:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685d2c0 with x1876037604946560 ext(16777216->17825791) 00002000:00010000:3.0:1789130198.243300:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685d2c0 00000100:00100000:3.0:1789130198.243324:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946688 00000100:00100000:3.0:1789130198.243330:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946688 00002000:00100000:3.0:1789130198.243356:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (17825792->18874367) req@ffff90b38295ed00 x1876037604946688/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.243361:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295ed00 with x1876037604946688 ext(17825792->18874367) 00002000:00010000:3.0:1789130198.243363:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295ed00 00000100:00100000:3.0:1789130198.243381:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:3.0:1789130198.243389:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+72:2368:x1876037604946688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130198.274258:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:2368:x1876037604946688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 30855us (31689us total) trans 30064771133 rc 0/0 00000100:00100000:3.0:1789130198.274275:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00002000:00100000:3.0:1789130198.274291:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (17825792->18874367) req@ffff90b38295ed00 x1876037604946688/t30064771133(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130198.274302:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295ed00 with x1876037604946688 ext(17825792->18874367) 00002000:00010000:3.0:1789130198.274308:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295ed00 00000100:00100000:2.0:1789130198.282521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.282688:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946816 00000100:00100000:0.0:1789130198.282700:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946816 00002000:00100000:0.0:1789130198.282761:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (18874368->19922943) req@ffff90b38295c780 x1876037604946816/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130198.282773:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c780 with x1876037604946816 ext(18874368->19922943) 00002000:00010000:0.0:1789130198.282780:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c780 00000100:00100000:0.0:1789130198.282807:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:0.0:1789130198.282816:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+74:2367:x1876037604946816:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130198.305383:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+76:2367:x1876037604946816:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 22542us (22848us total) trans 30064771134 rc 0/0 00000100:00100000:1.0:1789130198.305408:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00002000:00100000:1.0:1789130198.305434:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (18874368->19922943) req@ffff90b38295c780 x1876037604946816/t30064771134(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130198.305446:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295c780 with x1876037604946816 ext(18874368->19922943) 00002000:00010000:1.0:1789130198.305457:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295c780 00000100:00100000:2.0:1789130198.310007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130198.313841:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604946944 00000100:00100000:3.0:1789130198.313866:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604946944 00002000:00100000:2.0:1789130198.314087:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (19922944->20971519) req@ffff90b38295e940 x1876037604946944/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130198.314104:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e940 with x1876037604946944 ext(19922944->20971519) 00002000:00010000:2.0:1789130198.314113:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295e940 00000100:00100000:2.0:1789130198.314330:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:2.0:1789130198.314345:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+76:2369:x1876037604946944:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130198.330820:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:2369:x1876037604946944:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 16459us (20805us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1789130198.330844:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00002000:00100000:2.0:1789130198.330863:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (19922944->20971519) req@ffff90b38295e940 x1876037604946944/t30064771135(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130198.330891:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295e940 with x1876037604946944 ext(19922944->20971519) 00002000:00010000:2.0:1789130198.330902:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295e940 00000100:00100000:2.0:1789130198.338321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.338509:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947072 00000100:00100000:0.0:1789130198.338522:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947072 00000100:00080000:3.0:1789130198.338656:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130198.338726:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:0.0:1789130198.338739:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:35458:x1876037604947072:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130198.428399:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771332 is committed 00000004:00080000:2.0:1789130198.428430:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000020:00080000:2.0:1789130198.428457:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803907 batchid updated 00000001:00080000:2.0:1789130198.428467:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771333 is committed 00000020:00080000:1.0:1789130198.432019:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000020:00080000:1.0:1789130198.432044:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000100:00100000:3.0:1789130198.432126:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626824704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130198.432242:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:35458:x1876037604947072:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 93499us (93933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130198.432256:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:3.0:1789130198.437263:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130198.440486:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626824704 00000100:00100000:2.0:1789130198.440511:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626824704 00000100:00100000:2.0:1789130198.441661:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789130198.441682:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1876037626824704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789130198.441966:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1789130198.441971:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1789130198 00002000:00010000:2.0:1789130198.441974:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130198.441976:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 1789130197 -> 1789130198 00002000:00010000:2.0:1789130198.441979:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130198.442191:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3309:x1876037626824704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 515us (4938us total) trans 30064771136 rc 0/0 00000100:00100000:2.0:1789130198.442201:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:0.0:1789130198.442520:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384b503c0/2, rc 0, transno 30064771136 00000100:00100000:0.0:1789130198.442530:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626824704:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789130198.442640:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130198.449882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.450200:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947200 00000100:00100000:2.0:1789130198.450214:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947200 00000100:00100000:2.0:1789130198.450288:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130198.450301:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+78:2369:x1876037604947200:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789130198.485368:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130198.538722:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771134 is committed 00000001:00080000:3.0:1789130198.538778:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771114 is committed 00000001:00080000:3.0:1789130198.538849:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771136 is committed 00000001:00080000:3.0:1789130198.538856:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771135 is committed 00000100:00100000:2.0:1789130198.539330:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2369:x1876037604947200:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 89022us (89453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130198.539447:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130198.578049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.578185:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947456 00000100:00100000:2.0:1789130198.578199:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947456 00000100:00100000:2.0:1789130198.578273:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:2.0:1789130198.578286:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:35458:x1876037604947456:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130198.578360:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130198.578399:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9c4f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe8c expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.578433:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789130198.578439:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130198.578484:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.578502:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.578514:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130198.579106:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000092314342 reply state 00000000034c0d85 transno 30064771334 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.579121:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130198.579265:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:35458:x1876037604947456:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 980us (1234us total) trans 30064771334 rc 0/0 00000100:00100000:2.0:1789130198.579274:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 308 00010000:00010000:2.0:1789130198.584279:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584326:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584335:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584341:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130198.584348:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584356:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584380:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789130198.584383:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130198.584389:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.584395:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c64 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130198.588419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.589824:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947584 00000100:00100000:2.0:1789130198.589845:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947584 00000100:00100000:2.0:1789130198.589925:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789130198.589938:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604947584:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130198.590301:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:2.0:1789130198.590305:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 1789130198 -> 1789130196 00002000:00010000:2.0:1789130198.590308:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb atime from disk: 0 -> 1789130195 00002000:00010000:2.0:1789130198.590311:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 1789130198 -> 1789130196 00002000:00010000:2.0:1789130198.590332:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:2.0:1789130198.590430:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604947584:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 494us (2030us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1789130198.590439:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1789130198.593007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.593696:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947840 00000100:00100000:2.0:1789130198.593712:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947840 00000100:00100000:2.0:1789130198.593802:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:2.0:1789130198.593816:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:35458:x1876037604947840:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130198.593935:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.593959:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 23 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.593973:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.594145:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 23 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.594163:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 23 pid: 38723 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.594184:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626824832:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130198.594317:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130198.603668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.603792:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604947968 00000100:00100000:0.0:1789130198.603804:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604947968 00010000:00010000:0.0:1789130198.603863:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 24 pid: 38723 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130198.603952:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:0.0:1789130198.603965:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604947968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130198.603986:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130198.603995:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 24 pid: 38723 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.604011:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 24 pid: 38723 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.604039:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130198.604045:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.604058:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.604067:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.604092:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130198.604172:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604947968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130198.604180:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00010000:00010000:2.0:1789130198.604653:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9c33 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe7e expref: 23 pid: 38723 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.604748:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626824832:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130198.604830:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604840:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604845:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604884:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604891:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604898:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604905:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130198.604910:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.604924:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.605166:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789130198.605170:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130198.605176:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.605190:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ce9c6b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.605266:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:35458:x1876037604947840:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 11453us (12272us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130198.605275:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:0.0:1789130198.608387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.610557:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948096 00000100:00100000:2.0:1789130198.610579:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948096 00000100:00100000:2.0:1789130198.610695:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1789130198.610708:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604948096:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130198.610784:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.610812:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.610823:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130198.610829:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130198.610834:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.610877:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.610891:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 7 pid: 37658 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.610925:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626824960:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130198.611057:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130198.614401:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626824960:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130198.614456:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130198.653394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.653766:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948224 00000100:00100000:2.0:1789130198.653780:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948224 00010000:00010000:2.0:1789130198.653847:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 8 pid: 37658 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130198.653907:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130198.653919:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2368:x1876037604948224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130198.653939:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130198.653969:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 8 pid: 37658 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.653987:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 8 pid: 37658 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.654028:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb19b6f/0x5c74554e47ce9c5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe9a expref: 8 pid: 37658 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.654081:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130198.654087:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130198.654094:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.654106:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.654142:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130198.654212:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604948224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 295us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130198.654221:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00010000:00010000:0.0:1789130198.654472:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654494:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654524:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654534:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654543:0:37275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654551:0:37275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130198.654556:0:37275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654565:0:37275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654580:0:37275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.654589:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9c72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130198.654694:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+6:2370:x1876037604948096:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 43989us (46333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130198.654704:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789130198.661482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.661589:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948480 00000100:00100000:1.0:1789130198.661647:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948480 00000100:00100000:1.0:1789130198.661720:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:1.0:1789130198.661733:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:35458:x1876037604948480:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130198.661841:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.661863:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.661878:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.662505:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.662519:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.662529:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.662571:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.662588:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 23 pid: 36587 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130198.662731:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626825088:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130198.662883:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130198.668113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130198.668202:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948608 00000100:00100000:0.0:1789130198.668214:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948608 00010000:00010000:0.0:1789130198.668273:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 24 pid: 36587 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130198.668327:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1789130198.668340:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604948608:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130198.668358:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130198.668365:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 24 pid: 36587 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.668382:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 24 pid: 36587 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.668418:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789130198.668426:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.668437:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.668446:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.668490:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130198.668554:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604948608:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 216us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130198.668562:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:1.0:1789130198.668851:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9c41 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abe85 expref: 23 pid: 36587 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130198.668872:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626825088:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130198.668908:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.668919:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.668926:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130198.669246:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771335 00000001:00080000:1.0:1789130198.669440:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771336 00000001:00080000:1.0:1789130198.669488:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771337 00000100:00100000:1.0:1789130198.669582:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626825216:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130198.670461:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130198.670556:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130198.678209:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825216 00000100:00100000:2.0:1789130198.678232:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825216 00000100:00100000:2.0:1789130198.678327:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130198.678341:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626825216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789130198.679599:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626825216:12345-0@lo:1000:mdt00_004.0 Request processed in 1255us (9134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130198.679632:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130198.679903:0:38734:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771136 gen 2 00000004:00080000:1.0:1789130198.679912:0:38734:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771112 committed transno 30064771136 00000004:00080000:1.0:1789130198.679960:0:38734:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384b51680, transno 30064771113 00000004:00080000:1.0:1789130198.679979:0:38734:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384b53c00, transno 30064771114 00000004:00080000:1.0:1789130198.679982:0:38734:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384b503c0, transno 30064771136 00000100:00100000:1.0:1789130198.679991:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626825216:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1789130198.681466:0:36611:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:1.0:1789130198.682283:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771338 00000100:00100000:1.0:1789130198.682471:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626825344:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789130198.682574:0:38734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130198.682779:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130198.682865:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825344 00000100:00100000:2.0:1789130198.682875:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825344 00000100:00100000:3.0:1789130198.683143:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130198.683157:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38734:x1876037626825344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789130198.683538:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38734:x1876037626825344:12345-0@lo:1000:mdt00_004.0 Request processed in 383us (962us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1789130198.683547:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130198.683835:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:38734:1876037626825344:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789130198.683886:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.683898:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.683906:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.683912:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130198.683918:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.683927:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684172:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130198.684176:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130198.684183:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684190:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9c80 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684228:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684252:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684258:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684263:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130198.684266:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684272:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684281:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130198.684284:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130198.684292:0:38734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684305:0:38734:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684315:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.684356:0:38734:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130198.685598:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e3840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626825472:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130198.687239:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130198.696138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.696293:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948736 00000100:00100000:2.0:1789130198.696306:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948736 00000100:00100000:2.0:1789130198.696388:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:2.0:1789130198.696423:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:35457:x1876037604948736:12345-192.168.201.39@tcp:49:dd.500 00000100:00100000:2.0:1789130198.696631:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:35457:x1876037604948736:12345-192.168.201.39@tcp:49:dd.500 Request processed in 211us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130198.696650:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130198.697823:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e3840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626825472:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130198.697870:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130198.697883:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9bd1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698126:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698144:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698157:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698168:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698175:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698182:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698189:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130198.698193:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698200:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698213:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130198.698226:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130198.698231:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698237:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9c87 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698248:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698254:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698261:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698266:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130198.698269:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698275:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698282:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:0.0:1789130198.698284:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130198.698287:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.698292:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9c79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130198.698845:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604948480:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 37112us (37374us total) trans 30064771339 rc 0/0 00000100:00100000:0.0:1789130198.698868:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 310 00000020:00080000:0.0:1789130198.698875:0:38734:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789130198.699266:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130198.699271:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130198.700218:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 4 00000040:00080000:1.0:1789130198.700237:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130198.705333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.705490:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948864 00000100:00100000:2.0:1789130198.705504:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948864 00000100:00100000:2.0:1789130198.705582:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130198.705596:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:35457:x1876037604948864:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130198.705797:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130198.705829:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce9c8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abea1 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130198.705869:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 20971520, mtime: 0x6aa3f5d4, atime: 0x6aa3f5d3, ctime: 0x6aa3f5d4, blocks: 0xa007 00010000:00010000:2.0:1789130198.705899:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=1361s v=(0 0) 00010000:00010000:2.0:1789130198.705904:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130198.705917:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce9c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abea1 expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.705951:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce9c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abea1 expref: 7 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130198.705969:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:2.0:1789130198.706127:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+7:35457:x1876037604948864:12345-192.168.201.39@tcp:101:dd.500 Request processed in 534us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130198.706136:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130198.738350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.740805:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604948992 00000100:00100000:1.0:1789130198.740824:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604948992 00002000:00100000:1.0:1789130198.740909:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (20971520->22020095) req@ffff90b486ed2580 x1876037604948992/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.740923:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed2580 with x1876037604948992 ext(20971520->22020095) 00002000:00010000:1.0:1789130198.740931:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed2580 00000100:00100000:1.0:1789130198.740986:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789130198.740996:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604948992:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130198.784920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.785024:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949120 00000100:00100000:1.0:1789130198.785040:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949120 00002000:00100000:1.0:1789130198.785121:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (22020096->23068671) req@ffff90b486ed12c0 x1876037604949120/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.785135:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed12c0 with x1876037604949120 ext(22020096->23068671) 00002000:00010000:1.0:1789130198.785142:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed12c0 00000100:00100000:1.0:1789130198.785213:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:1.0:1789130198.785226:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604949120:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:3.0:1789130198.786784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.786891:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949248 00000100:00100000:2.0:1789130198.786901:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949248 00002000:00100000:2.0:1789130198.786948:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (23068672->24117247) req@ffff90b384a57480 x1876037604949248/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130198.786960:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57480 with x1876037604949248 ext(23068672->24117247) 00002000:00010000:2.0:1789130198.786966:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a57480 00000100:00100000:2.0:1789130198.786996:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:2.0:1789130198.787006:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037604949248:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130198.788150:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604948992:12345-192.168.201.39@tcp:4:dd.500 Request processed in 47148us (49804us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1789130198.788164:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00002000:00100000:0.0:1789130198.788176:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (20971520->22020095) req@ffff90b486ed2580 x1876037604948992/t30064771139(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130198.788186:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed2580 with x1876037604948992 ext(20971520->22020095) 00002000:00010000:0.0:1789130198.788192:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed2580 00000100:00100000:1.0:1789130198.800956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.802269:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604949120:12345-192.168.201.39@tcp:4:dd.500 Request processed in 17033us (20761us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1789130198.802287:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00002000:00100000:1.0:1789130198.802303:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (22020096->23068671) req@ffff90b486ed12c0 x1876037604949120/t30064771140(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.802317:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed12c0 with x1876037604949120 ext(22020096->23068671) 00002000:00010000:1.0:1789130198.802327:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed12c0 00000100:00100000:1.0:1789130198.802361:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949376 00000100:00100000:1.0:1789130198.802370:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949376 00002000:00100000:1.0:1789130198.802425:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (24117248->25165823) req@ffff90b48e6e3840 x1876037604949376/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.802434:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e3840 with x1876037604949376 ext(24117248->25165823) 00002000:00010000:1.0:1789130198.802437:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e3840 00000100:00100000:1.0:1789130198.802473:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:1.0:1789130198.802485:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037604949376:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:1.0:1789130198.827736:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604949248:12345-192.168.201.39@tcp:4:dd.500 Request processed in 40713us (40945us total) trans 30064771141 rc 0/0 00000100:00100000:1.0:1789130198.827755:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00002000:00100000:1.0:1789130198.827775:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (23068672->24117247) req@ffff90b384a57480 x1876037604949248/t30064771141(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.827816:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57480 with x1876037604949248 ext(23068672->24117247) 00002000:00010000:1.0:1789130198.827825:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a57480 00000100:00100000:3.0:1789130198.841800:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604949376:12345-192.168.201.39@tcp:4:dd.500 Request processed in 39299us (40842us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1789130198.841819:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00002000:00100000:3.0:1789130198.841837:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (24117248->25165823) req@ffff90b48e6e3840 x1876037604949376/t30064771142(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130198.841850:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e3840 with x1876037604949376 ext(24117248->25165823) 00002000:00010000:3.0:1789130198.841860:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e3840 00000100:00100000:2.0:1789130198.853517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130198.856962:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949504 00000100:00100000:3.0:1789130198.856986:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949504 00002000:00100000:3.0:1789130198.857079:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (25165824->26214399) req@ffff90b486ed2940 x1876037604949504/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130198.857129:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed2940 with x1876037604949504 ext(25165824->26214399) 00002000:00010000:3.0:1789130198.857138:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed2940 00000100:00100000:3.0:1789130198.857186:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130198.857198:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604949504:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:1.0:1789130198.857729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130198.858819:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949760 00000100:00100000:3.0:1789130198.858837:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949760 00000100:00100000:3.0:1789130198.858913:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130198.858935:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49646b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:35458:x1876037604949760:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130198.866206:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789130198.866361:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771340 00010000:00010000:0.0:1789130198.866481:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866502:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866516:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866526:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866532:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866538:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130198.866569:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130198.873339:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49646b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:35458:x1876037604949760:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 14384us (15590us total) trans 30064771341 rc 0/0 00000100:00100000:0.0:1789130198.873363:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000020:00080000:0.0:1789130198.873376:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130198.875544:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130198.875566:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130198.875581:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130198.875587:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130198.875599:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130198.875677:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff90b4a2a08500) 00010000:00010000:3.0:1789130198.875681:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130198.875687:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130198.875694:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9c95 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130198.875756:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130198.875758:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130198.875761:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130198.878937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.878993:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604949888 00000100:00100000:2.0:1789130198.879008:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604949888 00002000:00100000:2.0:1789130198.879288:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (26214400->27262975) req@ffff90b486ed3480 x1876037604949888/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130198.879302:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed3480 with x1876037604949888 ext(26214400->27262975) 00002000:00010000:2.0:1789130198.879311:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed3480 00000100:00100000:2.0:1789130198.879350:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:2.0:1789130198.879363:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604949888:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130198.884212:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604949504:12345-192.168.201.39@tcp:4:dd.500 Request processed in 26709us (30404us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1789130198.884237:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00002000:00100000:0.0:1789130198.884258:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (25165824->26214399) req@ffff90b486ed2940 x1876037604949504/t30064771143(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130198.884272:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed2940 with x1876037604949504 ext(25165824->26214399) 00002000:00010000:0.0:1789130198.884282:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed2940 00000100:00100000:2.0:1789130198.924481:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604949888:12345-192.168.201.39@tcp:4:dd.500 Request processed in 45106us (45556us total) trans 30064771144 rc 0/0 00000100:00100000:2.0:1789130198.924500:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00002000:00100000:2.0:1789130198.924515:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (26214400->27262975) req@ffff90b486ed3480 x1876037604949888/t30064771144(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130198.924549:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed3480 with x1876037604949888 ext(26214400->27262975) 00002000:00010000:2.0:1789130198.924558:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed3480 00000100:00100000:3.0:1789130198.926200:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130198.929939:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950016 00000100:00100000:2.0:1789130198.929962:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950016 00002000:00100000:2.0:1789130198.931420:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (27262976->28311551) req@ffff90b384a55a40 x1876037604950016/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130198.931441:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a55a40 with x1876037604950016 ext(27262976->28311551) 00002000:00010000:2.0:1789130198.931453:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a55a40 00000100:00100000:2.0:1789130198.931517:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130198.931542:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604950016:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130198.964088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130198.964514:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950144 00000100:00100000:1.0:1789130198.964529:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950144 00002000:00100000:1.0:1789130198.964653:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (28311552->29360127) req@ffff90b486df7c00 x1876037604950144/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/0 e 0 to 0 dl 1789130209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.964667:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df7c00 with x1876037604950144 ext(28311552->29360127) 00002000:00010000:1.0:1789130198.964675:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df7c00 00000100:00100000:1.0:1789130198.964734:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:1.0:1789130198.964746:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+21:2369:x1876037604950144:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:1.0:1789130198.981171:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604950016:12345-192.168.201.39@tcp:4:dd.500 Request processed in 49624us (54963us total) trans 30064771145 rc 0/0 00000100:00100000:1.0:1789130198.981192:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00002000:00100000:1.0:1789130198.981212:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (27262976->28311551) req@ffff90b384a55a40 x1876037604950016/t30064771145(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.981226:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a55a40 with x1876037604950016 ext(27262976->28311551) 00002000:00010000:1.0:1789130198.981237:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a55a40 00000100:00100000:1.0:1789130198.995540:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604950144:12345-192.168.201.39@tcp:4:dd.500 Request processed in 30779us (31450us total) trans 30064771146 rc 0/0 00000100:00100000:1.0:1789130198.995560:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00002000:00100000:1.0:1789130198.995577:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc8:0x0] (28311552->29360127) req@ffff90b486df7c00 x1876037604950144/t30064771146(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:669/0 lens 488/448 e 0 to 0 dl 1789130209 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130198.995650:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df7c00 with x1876037604950144 ext(28311552->29360127) 00002000:00010000:1.0:1789130198.995659:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df7c00 00000100:00100000:0.0:1789130199.037268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130199.037418:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950272 00000100:00100000:3.0:1789130199.037432:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950272 00002000:00100000:3.0:1789130199.037533:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (29360128->30408703) req@ffff90b486df70c0 x1876037604950272/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:670/0 lens 488/0 e 0 to 0 dl 1789130210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130199.037549:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df70c0 with x1876037604950272 ext(29360128->30408703) 00002000:00010000:3.0:1789130199.037557:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df70c0 00000100:00100000:3.0:1789130199.037644:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:3.0:1789130199.037657:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:2370:x1876037604950272:12345-192.168.201.39@tcp:4:dd.500 00000100:00080000:2.0:1789130199.038215:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130199.061023:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:2370:x1876037604950272:12345-192.168.201.39@tcp:4:dd.500 Request processed in 22691us (23093us total) trans 30064771147 rc 0/0 00000100:00100000:1.0:1789130199.061060:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00002000:00100000:1.0:1789130199.061078:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (29360128->30408703) req@ffff90b486df70c0 x1876037604950272/t30064771147(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:670/0 lens 488/448 e 0 to 0 dl 1789130210 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130199.061091:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df70c0 with x1876037604950272 ext(29360128->30408703) 00002000:00010000:1.0:1789130199.061102:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df70c0 00000100:00100000:1.0:1789130199.063490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130199.063640:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950400 00000100:00100000:3.0:1789130199.063657:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950400 00002000:00100000:3.0:1789130199.063727:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (30408704->31457279) req@ffff90b48e6e21c0 x1876037604950400/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:670/0 lens 488/0 e 0 to 0 dl 1789130210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130199.063741:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e21c0 with x1876037604950400 ext(30408704->31457279) 00002000:00010000:3.0:1789130199.063749:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e21c0 00000100:00100000:3.0:1789130199.063802:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:3.0:1789130199.063815:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+25:2368:x1876037604950400:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130199.067795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130199.068160:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950656 00000100:00100000:0.0:1789130199.068174:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950656 00000100:00100000:0.0:1789130199.068256:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:0.0:1789130199.068269:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:35457:x1876037604950656:12345-192.168.201.39@tcp:35:dd.500 00000001:00080000:0.0:1789130199.068708:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771342 00000001:00080000:0.0:1789130199.068776:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771343 00000100:00100000:0.0:1789130199.068941:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:35457:x1876037604950656:12345-192.168.201.39@tcp:35:dd.500 Request processed in 673us (1160us total) trans 30064771344 rc 0/0 00000100:00100000:0.0:1789130199.068951:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000020:00080000:0.0:1789130199.068958:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789130199.098869:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604950400:12345-192.168.201.39@tcp:4:dd.500 Request processed in 35037us (35375us total) trans 30064771148 rc 0/0 00000100:00100000:3.0:1789130199.098891:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00002000:00100000:3.0:1789130199.098910:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (30408704->31457279) req@ffff90b48e6e21c0 x1876037604950400/t30064771148(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:670/0 lens 488/448 e 0 to 0 dl 1789130210 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130199.098943:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e21c0 with x1876037604950400 ext(30408704->31457279) 00002000:00010000:3.0:1789130199.098952:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e21c0 00000100:00100000:2.0:1789130199.169923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130199.170235:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604950912 00000100:00100000:0.0:1789130199.170268:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604950912 00000100:00100000:0.0:1789130199.170359:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:0.0:1789130199.170372:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:35467:x1876037604950912:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130199.170415:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130199.170445:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abea8 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130199.171548:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 7680 00010000:00010000:2.0:1789130199.171878:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abea8 expref: 33 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.171899:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130199.171903:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130199.171910:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abea8 expref: 33 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.171939:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:2.0:1789130199.172156:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:35467:x1876037604950912:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1785us (2257us total) trans 30064771345 rc 301/301 00000100:00100000:2.0:1789130199.172178:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:1.0:1789130199.178310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130199.178514:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951040 00000100:00100000:2.0:1789130199.178530:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951040 00000100:00100000:2.0:1789130199.178682:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:2.0:1789130199.178695:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:35467:x1876037604951040:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130199.178961:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.178984:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179003:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179021:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179103:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179112:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179683:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179695:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.179703:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130199.179776:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180240:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180252:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180260:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180267:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130199.180271:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180280:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180298:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:2.0:1789130199.180302:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130199.180308:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180315:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9caa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180332:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180338:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180432:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180438:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130199.180440:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180447:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180457:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff90b48a1fd100) 00010000:00010000:2.0:1789130199.180459:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130199.180463:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180469:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9cb1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180489:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180496:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180502:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180507:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130199.180510:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180529:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180538:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:2.0:1789130199.180541:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130199.180544:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130199.180549:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9cb8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130199.180703:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:35467:x1876037604951040:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2006us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130199.180715:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:1.0:1789130199.183696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130199.184279:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951296 00000100:00100000:3.0:1789130199.184294:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951296 00000100:00100000:3.0:1789130199.184456:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789130199.184470:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:35467:x1876037604951296:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130199.185908:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:35467:x1876037604951296:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1428us (2214us total) trans 30064771346 rc 0/0 00000100:00100000:3.0:1789130199.185924:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00010000:00010000:1.0:1789130199.495634:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130200.519623:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130201.127415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130201.127493:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951424 00000100:00100000:1.0:1789130201.127505:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951424 00002000:00100000:1.0:1789130201.127579:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (42811392->42991615) req@ffff90b384a552c0 x1876037604951424/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:672/0 lens 488/0 e 0 to 0 dl 1789130212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130201.127591:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a552c0 with x1876037604951424 ext(42811392->42991615) 00002000:00010000:1.0:1789130201.127598:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a552c0 00000100:00100000:1.0:1789130201.127662:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:1.0:1789130201.127673:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+9:2369:x1876037604951424:12345-192.168.201.39@tcp:4:dd.0 00000100:00080000:2.0:1789130201.128061:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130201.158444:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037604951424:12345-192.168.201.39@tcp:4:dd.0 Request processed in 30764us (31032us total) trans 30064771181 rc 0/0 00000100:00100000:3.0:1789130201.158459:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00002000:00100000:3.0:1789130201.158473:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc6:0x0] (42811392->42991615) req@ffff90b384a552c0 x1876037604951424/t30064771181(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:672/0 lens 488/448 e 0 to 0 dl 1789130212 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130201.158483:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a552c0 with x1876037604951424 ext(42811392->42991615) 00002000:00010000:3.0:1789130201.158489:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a552c0 00000100:00100000:0.0:1789130201.351758:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130201.351834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130201.357059:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825600 00000100:00100000:2.0:1789130201.357075:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825600 00000100:00100000:2.0:1789130201.357144:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130201.357154:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626825600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130201.357190:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 137953280 pending 17039360 free 3830448128 avail 3828350976 00000100:00080000:1.0:1789130201.361131:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130201.364054:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626825600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6891us (12209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130201.364071:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130201.364160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626825728:0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.364252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130201.364334:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825728 00000100:00100000:2.0:1789130201.364343:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825728 00000100:00100000:2.0:1789130201.364451:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789130201.364461:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.364515:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626825728:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130201.364521:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789130201.364572:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626825728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130201.365027:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626825856:0@lo:400:kworker.0 00000100:00100000:3.0:1789130201.365064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130201.365113:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130201.365120:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626825984:0@lo:400:kworker.0 00000100:00100000:3.0:1789130201.365144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130201.371837:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825856 00000100:00100000:1.0:1789130201.371914:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825856 00000100:00100000:1.0:1789130201.373580:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789130201.373596:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626825856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130201.373725:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626825856:12345-0@lo:400:kworker.0 Request processed in 133us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130201.373733:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789130201.373784:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626825856:0@lo:400:kworker.0 00000100:00080000:1.0:1789130201.373811:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130201.374008:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626826240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130201.374082:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130201.374089:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3896992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626826112:0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130201.374138:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626825984 00000100:00100000:2.0:1789130201.374145:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626825984 00000100:00100000:2.0:1789130201.374173:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826240 00000100:00100000:2.0:1789130201.374176:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826240 00000100:00100000:2.0:1789130201.374211:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826112 00000100:00100000:2.0:1789130201.374214:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826112 00000100:00100000:2.0:1789130201.374231:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789130201.374238:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374276:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626825984:12345-0@lo:400:kworker.0 Request processed in 38us (9130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130201.374283:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789130201.374296:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130201.374302:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626826240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374348:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626826240:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130201.374378:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130201.374402:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789130201.374410:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626826112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374439:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626826112:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130201.374444:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1789130201.374464:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130201.374484:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626825984:0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374506:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3896992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626826112:0@lo:400:kworker.0 00000100:00100000:2.0:1789130201.374515:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626826240:0@lo:400:kworker.0 00000100:00100000:0.0:1789130201.377366:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626825600:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789130201.467482:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771181 is committed 00000001:00080000:2.0:1789130201.467506:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771180 is committed 00010000:00010000:1.0:1789130201.541994:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130202.377801:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130202.377825:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626826368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130202.377896:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130202.377958:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826368 00000100:00100000:3.0:1789130202.378068:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826368 00000100:00100000:3.0:1789130202.378129:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130202.378138:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626826368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130202.378162:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 182255616 pending 0 free 3772776448 avail 3769630720 00000100:00100000:3.0:1789130202.378205:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626826368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130202.378213:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130202.378249:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771180 gen 2 00000004:00080000:3.0:1789130202.378256:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383f2b0c0, transno 30064771180 00000100:00100000:3.0:1789130202.378279:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626826368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130202.566801:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130202.649184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130202.649221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130202.649245:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130202.649260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130202.649277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130202.649311:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951808 00000100:00100000:2.0:1789130202.649319:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951808 00000100:00100000:2.0:1789130202.649370:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951936 00000100:00100000:2.0:1789130202.649373:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951936 00000100:00100000:2.0:1789130202.649399:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130202.649407:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2367:x1876037604951808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130202.649476:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:2367:x1876037604951808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130202.649495:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130202.649511:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789130202.649517:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2367:x1876037604951936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130202.649541:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2367:x1876037604951936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130202.649547:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789130202.651478:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951552 00000100:00100000:3.0:1789130202.651489:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951552 00000100:00100000:3.0:1789130202.651544:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1789130202.651552:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604951552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130202.651637:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604951552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 79us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130202.651645:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789130202.651993:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952064 00000100:00100000:2.0:1789130202.651998:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952064 00000100:00100000:2.0:1789130202.652038:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604951680 00000100:00100000:2.0:1789130202.652041:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604951680 00000100:00100000:2.0:1789130202.652063:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130202.652069:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604952064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130202.652100:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604952064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130202.652106:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130202.652117:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789130202.652122:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604951680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130202.652144:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604951680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 22us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130202.652150:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00080000:2.0:1789130202.652175:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130202.652179:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789130203.468727:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771344 is committed 00000020:00080000:3.0:1789130203.468768:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4b5759cc0 refcount 2 committed 0 result 0 batchid 25769803908 00000020:00080000:3.0:1789130203.468774:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b57596c0 00000020:00080000:3.0:1789130203.468777:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b382de7800 00000020:00080000:3.0:1789130203.468818:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803908 committed batchid 25769803907 00000020:00080000:3.0:1789130203.469017:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000001:00080000:3.0:1789130203.469035:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771345 is committed 00000001:00080000:3.0:1789130203.469064:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771346 is committed 00010000:00010000:1.0:1789130203.589893:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130204.040744:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771143 is committed 00000001:00080000:3.0:1789130204.040773:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771147 is committed 00000001:00080000:3.0:1789130204.040808:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771148 is committed 00000001:00080000:3.0:1789130204.040818:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771138 is committed 00010000:00010000:1.0:1789130204.617272:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130205.270747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130205.271116:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952192 00000100:00100000:0.0:1789130205.271128:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952192 00000100:00100000:0.0:1789130205.271218:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:0.0:1789130205.271230:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+20:35399:x1876037604952192:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130205.271360:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+20:35399:x1876037604952192:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 132us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130205.271368:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00080000:2.0:1789130205.271714:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130205.285579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130205.285703:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952448 00000100:00100000:0.0:1789130205.285722:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952448 00000100:00100000:0.0:1789130205.285829:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1789130205.285843:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:35399:x1876037604952448:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130205.286732:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:35399:x1876037604952448:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 889us (1162us total) trans 30064771347 rc 0/0 00000100:00100000:0.0:1789130205.286744:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:1.0:1789130205.638037:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130205.670498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130205.671576:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952576 00000100:00100000:0.0:1789130205.671642:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952576 00000100:00100000:0.0:1789130205.671762:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:0.0:1789130205.671776:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:35908:x1876037604952576:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130205.671805:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130205.671835:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abeaf expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130205.671921:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789130205.671929:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130205.671939:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130205.671954:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130205.672346:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130205.672352:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130205.672448:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130205.672480:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 7 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130205.672501:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 6 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130205.672511:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130205.672515:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130205.672519:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:0.0:1789130205.672661:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:35908:x1876037604952576:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 888us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130205.672669:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:0.0:1789130206.472814:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626826752:0@lo:400:kworker.0 00000100:00100000:0.0:1789130206.472926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130206.473005:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626827264:0@lo:400:kworker.0 00000100:00100000:0.0:1789130206.473036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130206.473090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626826496:0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.473133:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130206.473162:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626826624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130206.473232:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626827008:0@lo:400:kworker.0 00000100:00100000:2.0:1789130206.473284:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626826880:0@lo:400:kworker.0 00000100:00100000:2.0:1789130206.473311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130206.473359:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826752 00000100:00100000:2.0:1789130206.473369:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826752 00000100:00100000:2.0:1789130206.473448:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826880 00000100:00100000:2.0:1789130206.473452:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826880 00000100:00100000:2.0:1789130206.473484:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130206.473495:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626826752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130206.473576:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626826752:12345-0@lo:400:kworker.0 Request processed in 82us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130206.473584:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130206.473638:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130206.473645:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626826880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.473701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130206.473918:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827264 00000100:00100000:3.0:1789130206.473924:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827264 00000100:00100000:3.0:1789130206.473964:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130206.473972:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626827264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.475647:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626827136:0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.475784:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826496 00000100:00100000:1.0:1789130206.475793:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826496 00000100:00100000:1.0:1789130206.475870:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789130206.475882:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626826496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.475955:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626826496:12345-0@lo:400:kworker.0 Request processed in 74us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130206.475963:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789130206.476008:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626826624 00000100:00100000:1.0:1789130206.476133:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626826624 00000100:00100000:1.0:1789130206.476200:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789130206.476207:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626826624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130206.476440:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 120913920 pending 0 free 3819962368 avail 3817865216 00000100:00100000:1.0:1789130206.476490:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626826624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 284us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130206.476498:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789130206.476631:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130206.476638:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130206.476641:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130206.480652:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626826880:12345-0@lo:400:kworker.0 Request processed in 6994us (7326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130206.480672:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789130206.480923:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626826752:0@lo:400:kworker.0 00000100:00100000:2.0:1789130206.481253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130206.481317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130206.481360:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626826496:0@lo:400:kworker.0 00000100:00100000:2.0:1789130206.481377:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771138 gen 2 00000004:00080000:2.0:1789130206.481384:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771138 committed transno 30064771138 00000100:00100000:2.0:1789130206.481425:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626826624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130206.481453:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827008 00000100:00100000:2.0:1789130206.481461:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827008 00000100:00100000:2.0:1789130206.481521:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827136 00000100:00100000:2.0:1789130206.481524:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827136 00000100:00100000:2.0:1789130206.481566:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789130206.481576:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626827008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130206.481825:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130206.481837:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626827136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130206.481887:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626827136:12345-0@lo:400:kworker.0 Request processed in 53us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130206.481896:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130206.481931:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626827136:0@lo:400:kworker.0 00000100:00080000:0.0:1789130206.481976:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130206.482141:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626827008:12345-0@lo:400:kworker.0 Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130206.482149:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789130206.482181:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492797c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626827008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130206.482395:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626826880:0@lo:400:kworker.0 00000100:00100000:3.0:1789130206.482565:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626827264:12345-0@lo:400:kworker.0 Request processed in 8592us (9526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130206.482574:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789130206.482793:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626827264:0@lo:400:kworker.0 00010000:00010000:1.0:1789130206.661918:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130206.917934:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130206.917948:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130206.918025:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 4 00000040:00080000:3.0:1789130206.918049:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130207.499807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130207.503349:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626827392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130207.503475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130207.503961:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827392 00000100:00100000:1.0:1789130207.503973:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827392 00000100:00100000:1.0:1789130207.504041:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789130207.504051:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626827392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130207.504101:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 182255616 pending 0 free 3772776448 avail 3770679296 00000100:00100000:1.0:1789130207.504168:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626827392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130207.504177:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130207.504433:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626827392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130207.690052:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130207.776861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130207.776930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130207.777004:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952704 00000100:00100000:1.0:1789130207.777019:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952704 00000100:00100000:3.0:1789130207.777066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130207.777110:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789130207.777122:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604952704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130207.777226:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604952704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130207.777235:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:3.0:1789130207.778208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130207.787670:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952960 00000100:00100000:2.0:1789130207.787692:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952960 00000100:00100000:2.0:1789130207.787808:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130207.787823:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604952960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130207.787966:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037604952960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 146us (11034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130207.787975:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00080000:1.0:1789130207.788463:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130207.791627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130207.791929:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953088 00000100:00100000:1.0:1789130207.791953:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953088 00000100:00100000:1.0:1789130207.792057:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789130207.792071:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604953088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130207.792187:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+6:2368:x1876037604953088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 120us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130207.792196:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00080000:3.0:1789130207.792469:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130207.794468:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953216 00000100:00100000:0.0:1789130207.794489:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953216 00000100:00100000:0.0:1789130207.794632:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604952832 00000100:00100000:0.0:1789130207.794637:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604952832 00000100:00100000:0.0:1789130207.794675:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:0.0:1789130207.794705:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604953216:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130207.794809:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604953216:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 105us (17742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130207.794818:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:0.0:1789130207.794837:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1789130207.794844:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604952832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130207.794883:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604952832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 39us (16680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130207.794889:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00080000:3.0:1789130207.795022:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789130208.622105:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771347 is committed 00000020:00080000:1.0:1789130208.622136:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803908 batchid updated 00000020:00080000:3.0:1789130208.622212:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000020:00080000:3.0:1789130208.622261:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00010000:00010000:1.0:1789130208.710446:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130209.737681:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130210.427007:0:39971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 08:36:48 (1789130208) 00010000:00010000:1.0:1789130210.758828:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130211.590693:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626827776:0@lo:400:kworker.0 00000100:00100000:0.0:1789130211.590768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130211.590787:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626827904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130211.590819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130211.590852:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827904 00000100:00100000:0.0:1789130211.590860:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827904 00000100:00100000:0.0:1789130211.590910:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789130211.590920:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626827904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130211.590979:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626827904:12345-0@lo:400:kworker.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130211.590986:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789130211.591149:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626827520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130211.591225:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626828032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130211.591251:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626827904:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130211.591268:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789130211.591274:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626827648:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130211.591309:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827776 00000100:00100000:3.0:1789130211.591313:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827776 00000100:00100000:2.0:1789130211.591324:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626828160:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130211.591360:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827648 00000100:00100000:3.0:1789130211.591363:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827648 00000100:00100000:3.0:1789130211.591381:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789130211.591385:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626827520 00000100:00100000:3.0:1789130211.591387:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626827776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591388:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626827520 00000100:00100000:2.0:1789130211.591413:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789130211.591419:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626827520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130211.591420:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626827776:12345-0@lo:400:kworker.0 Request processed in 34us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130211.591426:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130211.591437:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130211.591443:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626827648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591466:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626827520:12345-0@lo:400:kworker.0 Request processed in 47us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130211.591467:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626827648:12345-0@lo:400:kworker.0 Request processed in 25us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130211.591473:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130211.591485:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789130211.591498:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130211.591501:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626828032 00000100:00080000:3.0:1789130211.591502:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130211.591504:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626828032 00000100:00100000:3.0:1789130211.591507:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130211.591513:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626828288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130211.591526:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626828160 00000100:00100000:2.0:1789130211.591530:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626828160 00000100:00100000:3.0:1789130211.591539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130211.591548:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789130211.591553:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626828032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130211.591561:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789130211.591568:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626828160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591582:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626828032:12345-0@lo:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130211.591588:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789130211.591591:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626828160:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130211.591625:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789130211.591628:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626827648:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591638:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626828160:0@lo:400:kworker.0 00000100:00080000:3.0:1789130211.591640:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130211.591645:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1967840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626827520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130211.591654:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626828032:0@lo:400:kworker.0 00000100:00100000:1.0:1789130211.592625:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626828288 00000100:00100000:1.0:1789130211.592633:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626828288 00000100:00100000:1.0:1789130211.592691:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130211.592700:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626828288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130211.592734:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 120913920 pending 0 free 3819962368 avail 3817865216 00000100:00100000:1.0:1789130211.592803:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626828288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130211.592810:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130211.592968:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626828288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130211.594835:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626827776:0@lo:400:kworker.0 00010000:00010000:2.0:1789130211.783167:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130212.033898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.034016:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953472 00000100:00100000:0.0:1789130212.034030:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953472 00000100:00080000:3.0:1789130212.034190:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130212.034926:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:0.0:1789130212.034945:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:36190:x1876037604953472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130212.034993:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130212.035022:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9ccd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abeb6 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035144:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035164:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035190:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035209:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035217:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035226:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035857:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ce2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035868:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.035876:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130212.035888:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130212.036133:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036141:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036148:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036155:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.036160:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036176:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036193:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130212.036196:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.036203:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036209:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9cd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036224:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036230:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036235:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036249:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.036252:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036258:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036266:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4a2a08900) 00010000:00010000:0.0:1789130212.036269:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.036272:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036278:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cdb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036874:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9ccd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeb6 expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036896:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeb6 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.036904:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130212.036907:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.036911:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:0.0:1789130212.037008:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:36190:x1876037604953472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2068us (3123us total) trans 30064771348 rc 0/0 00000100:00100000:0.0:1789130212.037018:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:2.0:1789130212.049687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.049769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.050190:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953728 00000100:00100000:3.0:1789130212.050204:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953728 00000100:00100000:3.0:1789130212.050337:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 316 00000100:00100000:3.0:1789130212.050349:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:36190:x1876037604953728:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130212.050505:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:36190:x1876037604953728:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 158us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130212.050515:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 316 00000100:00100000:1.0:1789130212.051006:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953600 00000100:00100000:1.0:1789130212.051013:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953600 00000100:00100000:1.0:1789130212.051074:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130212.051083:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:2367:x1876037604953600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130212.051096:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130212.051135:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ce2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeb6 expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130212.051189:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130212.051196:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130212.051234:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037604953600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 153us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130212.051242:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789130212.165453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.165943:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604953984 00000100:00100000:0.0:1789130212.165974:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604953984 00000100:00100000:0.0:1789130212.166058:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 317 00000100:00100000:0.0:1789130212.166070:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:36205:x1876037604953984:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789130212.166329:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130212.166369:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdd6 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.166392:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130212.166399:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130212.167021:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.167041:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.167051:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.167094:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.167111:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 5 pid: 36587 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130212.167310:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626828416:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130212.167491:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4887e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130212.176916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.177108:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626828416:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130212.177160:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.177319:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954112 00000100:00100000:2.0:1789130212.177339:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954112 00010000:00010000:2.0:1789130212.177416:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 6 pid: 36587 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.177460:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130212.177472:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604954112:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130212.177492:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130212.177501:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 6 pid: 36587 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177514:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 6 pid: 36587 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177542:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9cc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeaf expref: 6 pid: 36587 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177562:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130212.177567:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177578:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177587:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.177670:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1789130212.177835:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130212.178069:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.178078:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.178110:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.178133:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.178143:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130212.179731:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00000100:00100000:2.0:1789130212.184025:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604954112:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6535us (7105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130212.184046:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00010000:00010000:0.0:1789130212.185056:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185069:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185077:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185083:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.185089:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185098:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185159:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130212.185162:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.185180:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.185187:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cf0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130212.185220:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000496f37bb reply state 00000000ee263c1e transno 30064771349 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130212.185231:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130212.185375:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+22:36205:x1876037604953984:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 19306us (19937us total) trans 30064771349 rc 0/0 00000100:00100000:0.0:1789130212.185385:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 317 00010000:00010000:0.0:1789130212.192644:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192669:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192679:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192686:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.192693:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192704:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192768:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff90b4a2a08900) 00010000:00010000:0.0:1789130212.192772:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.192779:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.192787:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9cf7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130212.199338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.199542:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954240 00000100:00100000:0.0:1789130212.199555:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954240 00000100:00100000:0.0:1789130212.199666:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 318 00000100:00100000:0.0:1789130212.199679:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+21:36206:x1876037604954240:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130212.199719:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130212.199758:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abebd expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200053:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200070:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200083:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130212.200176:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130212.200180:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130212.200211:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200267:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9cfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abebd expref: 23 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200291:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abebd expref: 22 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.200300:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130212.200303:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130212.200307:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151bc00, rc 0) 00000100:00100000:0.0:1789130212.200381:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:36206:x1876037604954240:12345-192.168.201.39@tcp:101:dd.0 Request processed in 704us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130212.200388:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 318 00000100:00100000:1.0:1789130212.203959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.204090:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954368 00000100:00100000:3.0:1789130212.204105:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954368 00000100:00100000:3.0:1789130212.204314:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:3.0:1789130212.204337:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab0cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+22:36206:x1876037604954368:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130212.204368:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130212.204397:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abec4 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204495:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204512:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204545:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204563:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204570:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204577:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204779:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204803:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204811:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130212.204848:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00000004:00200000:3.0:1789130212.204852:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130212.204879:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204892:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204899:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204917:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204924:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130212.204928:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204937:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204951:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:3.0:1789130212.204955:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130212.204960:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204967:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204984:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204991:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.204997:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205001:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130212.205004:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205034:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205043:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff90b488939200) 00010000:00010000:3.0:1789130212.205045:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130212.205048:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205054:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9d1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205091:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abec4 expref: 24 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205107:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abec4 expref: 23 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130212.205122:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130212.205124:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130212.205127:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86200, rc 0) 00000100:00100000:3.0:1789130212.205218:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab0cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:36206:x1876037604954368:12345-192.168.201.39@tcp:101:dd.0 Request processed in 893us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130212.205226:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:0.0:1789130212.213972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.221768:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954624 00000100:00100000:2.0:1789130212.221782:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954624 00000100:00100000:2.0:1789130212.221856:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 320 00000100:00100000:2.0:1789130212.221865:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:36206:x1876037604954624:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130212.221883:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130212.221913:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9d28 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abecb expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222025:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222037:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222046:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222058:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222062:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222067:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130212.222764:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc8:0x0], index 0: 0 00010000:00010000:2.0:1789130212.222889:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9d3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222981:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9d3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.222994:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9d3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223023:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223028:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223032:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223036:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130212.223039:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223043:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223051:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130212.223053:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130212.223058:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223062:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9d2f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130212.223071:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000047df7ea3 reply state 0000000012a1cdc9 transno 30064771350 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.223086:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130212.223219:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9d28 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abecb expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223232:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9d3d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abecb expref: 25 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.223236:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130212.223238:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130212.223240:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:2.0:1789130212.223316:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:36206:x1876037604954624:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1451us (9358us total) trans 30064771350 rc 0/0 00000100:00100000:2.0:1789130212.223324:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 320 00010000:00010000:2.0:1789130212.229525:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229543:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229550:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229555:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130212.229560:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229578:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229596:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff90b4976b8200) 00010000:00010000:2.0:1789130212.229599:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130212.229648:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.229654:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9d36 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130212.230452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.230516:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954752 00000100:00100000:2.0:1789130212.230531:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954752 00000100:00080000:3.0:1789130212.230715:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130212.230752:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:2.0:1789130212.230765:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:36206:x1876037604954752:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130212.230782:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130212.230804:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abed2 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130212.230829:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130212.230852:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=1375s v=(0 0) 00010000:00010000:2.0:1789130212.230857:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130212.230866:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.230883:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.230895:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130212.230972:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:36206:x1876037604954752:12345-192.168.201.39@tcp:101:dd.0 Request processed in 210us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130212.230980:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130212.269058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.269417:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604954880 00000100:00100000:1.0:1789130212.269435:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604954880 00002000:00100000:1.0:1789130212.269491:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff90b384b17c00 x1876037604954880/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.269500:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b17c00 with x1876037604954880 ext(0->1048575) 00002000:00010000:1.0:1789130212.269505:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b17c00 00000100:00100000:1.0:1789130212.269548:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:1.0:1789130212.269558:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604954880:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130212.296559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.298312:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955008 00000100:00100000:2.0:1789130212.298341:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955008 00002000:00100000:2.0:1789130212.298399:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff90b382d843c0 x1876037604955008/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.298412:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d843c0 with x1876037604955008 ext(1048576->2097151) 00002000:00010000:2.0:1789130212.298419:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d843c0 00000100:00100000:2.0:1789130212.298456:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789130212.298467:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037604955008:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130212.319068:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604954880:12345-192.168.201.39@tcp:4:dd.0 Request processed in 49497us (50011us total) trans 30064771182 rc 0/0 00000100:00100000:3.0:1789130212.319092:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00002000:00100000:3.0:1789130212.319123:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff90b384b17c00 x1876037604954880/t30064771182(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.319134:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b17c00 with x1876037604954880 ext(0->1048575) 00002000:00010000:3.0:1789130212.319141:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b17c00 00000100:00100000:0.0:1789130212.331319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.331409:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955136 00000100:00100000:1.0:1789130212.331422:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955136 00002000:00100000:1.0:1789130212.331485:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff90b384b161c0 x1876037604955136/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.331497:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b161c0 with x1876037604955136 ext(2097152->3145727) 00002000:00010000:1.0:1789130212.331504:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b161c0 00000100:00100000:1.0:1789130212.333775:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:1.0:1789130212.333804:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2367:x1876037604955136:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130212.341449:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:2367:x1876037604955008:12345-192.168.201.39@tcp:4:dd.0 Request processed in 42973us (44890us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1789130212.341465:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00002000:00100000:1.0:1789130212.341478:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff90b382d843c0 x1876037604955008/t30064771183(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.341490:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d843c0 with x1876037604955008 ext(1048576->2097151) 00002000:00010000:1.0:1789130212.341498:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382d843c0 00000100:00100000:0.0:1789130212.343853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.344704:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955264 00000100:00100000:2.0:1789130212.344717:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955264 00002000:00100000:2.0:1789130212.344778:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff90b384b15a40 x1876037604955264/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.344789:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15a40 with x1876037604955264 ext(3145728->4194303) 00002000:00010000:2.0:1789130212.344796:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15a40 00000100:00100000:2.0:1789130212.344830:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:2.0:1789130212.344840:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:2368:x1876037604955264:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.362579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.362644:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955392 00000100:00100000:0.0:1789130212.362655:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955392 00002000:00100000:0.0:1789130212.362700:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff90b384b14780 x1876037604955392/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.362712:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b14780 with x1876037604955392 ext(4194304->5242879) 00002000:00010000:0.0:1789130212.362719:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b14780 00000100:00100000:0.0:1789130212.362744:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130212.363202:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:2369:x1876037604955392:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130212.365070:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+20:2367:x1876037604955136:12345-192.168.201.39@tcp:4:dd.0 Request processed in 31267us (33749us total) trans 30064771184 rc 0/0 00000100:00100000:3.0:1789130212.365088:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00002000:00100000:3.0:1789130212.365104:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff90b384b161c0 x1876037604955136/t30064771184(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.365116:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b161c0 with x1876037604955136 ext(2097152->3145727) 00002000:00010000:3.0:1789130212.365124:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b161c0 00000100:00100000:3.0:1789130212.382480:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+20:2368:x1876037604955264:12345-192.168.201.39@tcp:4:dd.0 Request processed in 37630us (38631us total) trans 30064771185 rc 0/0 00000100:00100000:3.0:1789130212.382495:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00002000:00100000:3.0:1789130212.382947:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff90b384b15a40 x1876037604955264/t30064771185(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.382959:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15a40 with x1876037604955264 ext(3145728->4194303) 00002000:00010000:3.0:1789130212.382967:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15a40 00000100:00100000:2.0:1789130212.391647:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604955392:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28405us (29102us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1789130212.391663:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00002000:00100000:2.0:1789130212.391677:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff90b384b14780 x1876037604955392/t30064771186(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.391687:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b14780 with x1876037604955392 ext(4194304->5242879) 00002000:00010000:2.0:1789130212.391694:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b14780 00000100:00100000:0.0:1789130212.401352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.401451:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955520 00000100:00100000:1.0:1789130212.401462:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955520 00002000:00100000:1.0:1789130212.401514:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff90b384b15680 x1876037604955520/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.401526:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15680 with x1876037604955520 ext(5242880->6291455) 00002000:00010000:1.0:1789130212.401532:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15680 00000100:00100000:1.0:1789130212.401564:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:1.0:1789130212.401574:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604955520:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130212.422986:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:2370:x1876037604955520:12345-192.168.201.39@tcp:4:dd.0 Request processed in 21401us (21634us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1789130212.423001:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00002000:00100000:1.0:1789130212.423013:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff90b384b15680 x1876037604955520/t30064771187(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.423025:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15680 with x1876037604955520 ext(5242880->6291455) 00002000:00010000:1.0:1789130212.423046:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15680 00000100:00100000:2.0:1789130212.463043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.463156:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955648 00000100:00100000:0.0:1789130212.463176:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955648 00002000:00100000:0.0:1789130212.463229:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff90b4876bfc00 x1876037604955648/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.463241:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bfc00 with x1876037604955648 ext(6291456->7340031) 00002000:00010000:0.0:1789130212.463248:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876bfc00 00000100:00100000:0.0:1789130212.463292:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:0.0:1789130212.463303:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+22:2370:x1876037604955648:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.537205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.537263:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955776 00000100:00100000:0.0:1789130212.537272:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955776 00002000:00100000:0.0:1789130212.537323:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff90b384b143c0 x1876037604955776/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.537334:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b143c0 with x1876037604955776 ext(7340032->8388607) 00002000:00010000:0.0:1789130212.537340:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b143c0 00000100:00100000:0.0:1789130212.537368:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:0.0:1789130212.537377:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604955776:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130212.553876:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037604955648:12345-192.168.201.39@tcp:4:dd.0 Request processed in 90562us (90844us total) trans 30064771188 rc 0/0 00000100:00100000:1.0:1789130212.553907:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00002000:00100000:1.0:1789130212.553921:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff90b4876bfc00 x1876037604955648/t30064771188(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.553931:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bfc00 with x1876037604955648 ext(6291456->7340031) 00002000:00010000:1.0:1789130212.553938:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876bfc00 00000100:00100000:0.0:1789130212.556304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.557560:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604955904 00000100:00100000:3.0:1789130212.557573:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604955904 00002000:00100000:3.0:1789130212.557664:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff90b384b16940 x1876037604955904/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.557677:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b16940 with x1876037604955904 ext(8388608->9437183) 00002000:00010000:3.0:1789130212.557683:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b16940 00000100:00100000:3.0:1789130212.557805:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1789130212.557816:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604955904:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130212.571743:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037604955776:12345-192.168.201.39@tcp:4:dd.0 Request processed in 34353us (34539us total) trans 30064771189 rc 0/0 00000100:00100000:3.0:1789130212.571759:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00002000:00100000:3.0:1789130212.571955:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff90b384b143c0 x1876037604955776/t30064771189(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.571966:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b143c0 with x1876037604955776 ext(7340032->8388607) 00002000:00010000:3.0:1789130212.571973:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b143c0 00000100:00100000:1.0:1789130212.575437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.575527:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956032 00000100:00100000:3.0:1789130212.575537:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956032 00002000:00100000:3.0:1789130212.575585:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff90b48e6e1680 x1876037604956032/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.575596:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e1680 with x1876037604956032 ext(9437184->10485759) 00002000:00010000:3.0:1789130212.575623:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e1680 00000100:00100000:3.0:1789130212.575694:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:3.0:1789130212.575705:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037604956032:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.583038:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+30:2367:x1876037604955904:12345-192.168.201.39@tcp:4:dd.0 Request processed in 25203us (26724us total) trans 30064771190 rc 0/0 00000100:00100000:0.0:1789130212.583052:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00002000:00100000:0.0:1789130212.583068:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff90b384b16940 x1876037604955904/t30064771190(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.583093:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b16940 with x1876037604955904 ext(8388608->9437183) 00002000:00010000:0.0:1789130212.583100:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b16940 00000100:00100000:0.0:1789130212.588314:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604956032:12345-192.168.201.39@tcp:4:dd.0 Request processed in 12601us (12875us total) trans 30064771191 rc 0/0 00000100:00100000:0.0:1789130212.588328:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00002000:00100000:0.0:1789130212.588340:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff90b48e6e1680 x1876037604956032/t30064771191(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.588351:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e1680 with x1876037604956032 ext(9437184->10485759) 00002000:00010000:0.0:1789130212.588358:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e1680 00000100:00100000:3.0:1789130212.616364:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626828544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130212.616660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130212.617131:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626828544 00000100:00100000:1.0:1789130212.617150:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626828544 00000100:00100000:1.0:1789130212.617211:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789130212.617222:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626828544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130212.617247:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 216334336 pending 17039360 free 3772776448 avail 3770679296 00000100:00100000:1.0:1789130212.617310:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626828544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130212.617318:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130212.617371:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626828544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130212.622580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.623075:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956160 00000100:00100000:1.0:1789130212.623086:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956160 00002000:00100000:1.0:1789130212.623138:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff90b384b152c0 x1876037604956160/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.623176:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b152c0 with x1876037604956160 ext(10485760->11534335) 00002000:00010000:1.0:1789130212.623183:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b152c0 00000100:00100000:1.0:1789130212.623219:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1789130212.623230:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604956160:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.651331:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:2369:x1876037604956160:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28092us (28747us total) trans 30064771192 rc 0/0 00000100:00100000:2.0:1789130212.651361:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00002000:00100000:2.0:1789130212.651375:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff90b384b152c0 x1876037604956160/t30064771192(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.651386:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b152c0 with x1876037604956160 ext(10485760->11534335) 00002000:00010000:2.0:1789130212.651393:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b152c0 00000100:00100000:0.0:1789130212.660806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.660924:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956288 00000100:00100000:3.0:1789130212.660935:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956288 00002000:00100000:3.0:1789130212.660993:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff90b384b16580 x1876037604956288/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.661005:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b16580 with x1876037604956288 ext(11534336->12582911) 00002000:00010000:3.0:1789130212.661013:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b16580 00000100:00100000:3.0:1789130212.661067:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:3.0:1789130212.661079:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:2370:x1876037604956288:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.678793:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:2370:x1876037604956288:12345-192.168.201.39@tcp:4:dd.0 Request processed in 17707us (17990us total) trans 30064771193 rc 0/0 00000100:00100000:2.0:1789130212.678804:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00002000:00100000:2.0:1789130212.678815:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff90b384b16580 x1876037604956288/t30064771193(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.678822:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b16580 with x1876037604956288 ext(11534336->12582911) 00002000:00010000:2.0:1789130212.678828:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b16580 00000100:00100000:1.0:1789130212.690840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.690930:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956416 00000100:00100000:0.0:1789130212.690939:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956416 00002000:00100000:0.0:1789130212.690990:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff90b48e6e2580 x1876037604956416/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.690998:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2580 with x1876037604956416 ext(12582912->13631487) 00002000:00010000:0.0:1789130212.691004:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e2580 00000100:00100000:0.0:1789130212.691033:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:0.0:1789130212.691040:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+34:2369:x1876037604956416:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.698283:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+36:2369:x1876037604956416:12345-192.168.201.39@tcp:4:dd.0 Request processed in 7231us (7440us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1789130212.698312:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00002000:00100000:0.0:1789130212.698326:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff90b48e6e2580 x1876037604956416/t30064771194(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.698336:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2580 with x1876037604956416 ext(12582912->13631487) 00002000:00010000:0.0:1789130212.698344:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e2580 00000100:00100000:1.0:1789130212.710870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.719334:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956544 00000100:00100000:2.0:1789130212.719352:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956544 00002000:00100000:2.0:1789130212.719409:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff90b48e6e2d00 x1876037604956544/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.719419:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2d00 with x1876037604956544 ext(13631488->14680063) 00002000:00010000:2.0:1789130212.719425:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e2d00 00000100:00100000:2.0:1789130212.719462:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:2.0:1789130212.719469:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:2370:x1876037604956544:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.721114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.721447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.721553:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956928 00000100:00100000:2.0:1789130212.721565:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956928 00000100:00100000:2.0:1789130212.721640:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789130212.721668:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+25:36206:x1876037604956928:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130212.721890:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604956672 00000100:00100000:0.0:1789130212.721899:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604956672 00002000:00100000:0.0:1789130212.721955:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff90b48e6e0b40 x1876037604956672/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:2.0:1789130212.721963:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771351 00002000:00100000:0.0:1789130212.721978:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e0b40 with x1876037604956672 ext(14680064->15728639) 00002000:00010000:0.0:1789130212.721987:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e0b40 00000100:00100000:0.0:1789130212.722074:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:0.0:1789130212.722085:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:2370:x1876037604956672:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.723379:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:36206:x1876037604956928:12345-192.168.201.39@tcp:35:dd.0 Request processed in 1712us (2265us total) trans 30064771352 rc 0/0 00000100:00100000:2.0:1789130212.723389:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000020:00080000:2.0:1789130212.723394:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130212.736370:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037604956544:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16878us (25490us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1789130212.736391:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00002000:00100000:2.0:1789130212.736408:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff90b48e6e2d00 x1876037604956544/t30064771195(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.736422:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2d00 with x1876037604956544 ext(13631488->14680063) 00002000:00010000:2.0:1789130212.736431:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e2d00 00000100:00100000:2.0:1789130212.751879:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037604956672:12345-192.168.201.39@tcp:4:dd.0 Request processed in 29779us (30422us total) trans 30064771196 rc 0/0 00000100:00100000:2.0:1789130212.751899:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00002000:00100000:2.0:1789130212.751918:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff90b48e6e0b40 x1876037604956672/t30064771196(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.751931:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e0b40 with x1876037604956672 ext(14680064->15728639) 00002000:00010000:2.0:1789130212.751940:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e0b40 00000100:00100000:1.0:1789130212.755135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.755251:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957184 00000100:00100000:0.0:1789130212.755265:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957184 00000100:00100000:0.0:1789130212.755353:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:0.0:1789130212.755365:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:36207:x1876037604957184:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130212.755426:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130212.755461:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d52 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abed9 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755694:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755743:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755757:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755779:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755907:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.755915:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130212.765190:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc9:0x0], index 1: 0 00010000:00010000:0.0:1789130212.765435:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9d67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765455:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9d67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765468:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9d67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765508:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765516:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765524:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765556:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.765561:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765569:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765583:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130212.765586:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.765590:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.765596:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9d59 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130212.765819:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003c9103f8 reply state 00000000d6c9f24a transno 30064771353 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130212.765971:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130212.766017:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d52 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed9 expref: 30 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.766045:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9d67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed9 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.766053:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130212.766056:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130212.766058:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:0.0:1789130212.766201:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+30:36207:x1876037604957184:12345-192.168.201.39@tcp:101:dd.0 Request processed in 10836us (11082us total) trans 30064771353 rc 0/0 00000100:00100000:0.0:1789130212.766218:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:1.0:1789130212.775942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130212.776085:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.776092:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957312 00010000:00010000:0.0:1789130212.776109:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.776113:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957312 00010000:00010000:0.0:1789130212.776129:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.776150:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130212.776167:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.776179:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.776202:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff90b4a2a08900) 00010000:00010000:0.0:1789130212.776207:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130212.776214:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130212.776222:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d60 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130212.776246:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130212.776263:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+6:36207:x1876037604957312:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130212.776301:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130212.776325:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce9d75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abee0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130212.776491:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130212.776516:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=1375s v=(0 0) 00010000:00010000:2.0:1789130212.776521:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130212.776544:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce9d75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee0 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.776563:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce9d75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee0 expref: 7 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130212.776578:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:2.0:1789130212.776765:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:36207:x1876037604957312:12345-192.168.201.39@tcp:101:dd.0 Request processed in 506us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130212.776775:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00080000:3.0:1789130212.777143:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130212.806141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130212.806538:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130212.810808:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957440 00000100:00100000:0.0:1789130212.810833:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957440 00002000:00100000:0.0:1789130212.810929:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff90b48e6e2940 x1876037604957440/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.810944:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2940 with x1876037604957440 ext(0->1048575) 00002000:00010000:0.0:1789130212.810975:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e2940 00000100:00100000:0.0:1789130212.811031:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:0.0:1789130212.811043:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2370:x1876037604957440:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.840193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130212.840380:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957568 00000100:00100000:3.0:1789130212.840396:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957568 00002000:00100000:3.0:1789130212.840469:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff90b384a04f00 x1876037604957568/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.840484:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04f00 with x1876037604957568 ext(1048576->2097151) 00002000:00010000:3.0:1789130212.840492:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a04f00 00000100:00100000:3.0:1789130212.840543:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:3.0:1789130212.840556:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037604957568:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.842462:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604957440:12345-192.168.201.39@tcp:4:dd.0 Request processed in 31409us (36324us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1789130212.842480:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00002000:00100000:2.0:1789130212.842493:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff90b48e6e2940 x1876037604957440/t30064771149(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.844564:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e2940 with x1876037604957440 ext(0->1048575) 00002000:00010000:2.0:1789130212.844577:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e2940 00000100:00100000:3.0:1789130212.865094:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604957568:12345-192.168.201.39@tcp:4:dd.0 Request processed in 24524us (24901us total) trans 30064771150 rc 0/0 00000100:00100000:3.0:1789130212.865125:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00002000:00100000:3.0:1789130212.865144:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff90b384a04f00 x1876037604957568/t30064771150(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.865165:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04f00 with x1876037604957568 ext(1048576->2097151) 00002000:00010000:3.0:1789130212.865175:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a04f00 00000100:00100000:1.0:1789130212.875482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.875657:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957696 00000100:00100000:2.0:1789130212.875670:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957696 00002000:00100000:2.0:1789130212.875740:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff90b48e6e3c00 x1876037604957696/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.875754:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e3c00 with x1876037604957696 ext(2097152->3145727) 00002000:00010000:2.0:1789130212.875762:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e3c00 00000100:00100000:2.0:1789130212.875813:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:2.0:1789130212.875824:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604957696:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130212.903894:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037604957696:12345-192.168.201.39@tcp:4:dd.0 Request processed in 27259us (27615us total) trans 30064771151 rc 0/0 00000100:00100000:3.0:1789130212.903922:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00002000:00100000:3.0:1789130212.903943:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff90b48e6e3c00 x1876037604957696/t30064771151(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.903954:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e3c00 with x1876037604957696 ext(2097152->3145727) 00002000:00010000:3.0:1789130212.903987:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48e6e3c00 00000100:00100000:2.0:1789130212.904257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.904377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.904415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.904517:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957824 00000100:00100000:1.0:1789130212.904529:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957824 00000100:00100000:1.0:1789130212.904589:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:1.0:1789130212.904618:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604957824:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130212.904711:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604957824:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 113us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130212.904719:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130212.906466:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958080 00000100:00100000:3.0:1789130212.906481:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958080 00002000:00100000:3.0:1789130212.906538:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff90b4876be580 x1876037604958080/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.906552:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876be580 with x1876037604958080 ext(3145728->4194303) 00002000:00010000:3.0:1789130212.906559:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876be580 00000100:00100000:3.0:1789130212.906596:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:3.0:1789130212.906626:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037604958080:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130212.906941:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604957952 00000100:00100000:0.0:1789130212.906946:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604957952 00000100:00100000:0.0:1789130212.907085:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:0.0:1789130212.907092:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604957952:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130212.907140:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604957952:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130212.907145:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130212.915248:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604958080:12345-192.168.201.39@tcp:4:dd.0 Request processed in 8614us (10821us total) trans 30064771152 rc 0/0 00000100:00100000:3.0:1789130212.915266:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00002000:00100000:3.0:1789130212.915281:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff90b4876be580 x1876037604958080/t30064771152(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130212.915292:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876be580 with x1876037604958080 ext(3145728->4194303) 00002000:00010000:3.0:1789130212.915300:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876be580 00000100:00100000:1.0:1789130212.930816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130212.931205:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958208 00000100:00100000:2.0:1789130212.931231:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958208 00002000:00100000:2.0:1789130212.931299:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff90b384a57840 x1876037604958208/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.931313:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57840 with x1876037604958208 ext(4194304->5242879) 00002000:00010000:2.0:1789130212.931322:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a57840 00000100:00100000:2.0:1789130212.931360:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:2.0:1789130212.931373:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037604958208:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.952366:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037604958208:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20978us (21546us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1789130212.952394:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00002000:00100000:2.0:1789130212.952413:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff90b384a57840 x1876037604958208/t30064771153(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.952450:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57840 with x1876037604958208 ext(4194304->5242879) 00002000:00010000:2.0:1789130212.952460:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a57840 00000100:00100000:1.0:1789130212.963374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130212.963520:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958336 00000100:00100000:0.0:1789130212.963536:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958336 00002000:00100000:0.0:1789130212.963660:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff90b384a561c0 x1876037604958336/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130212.963676:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a561c0 with x1876037604958336 ext(5242880->6291455) 00002000:00010000:0.0:1789130212.963685:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a561c0 00000100:00100000:1.0:1789130212.963877:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:1.0:1789130212.963895:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604958336:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130212.980210:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604958336:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16304us (16837us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1789130212.980229:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00002000:00100000:2.0:1789130212.980282:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff90b384a561c0 x1876037604958336/t30064771154(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130212.980295:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a561c0 with x1876037604958336 ext(5242880->6291455) 00002000:00010000:2.0:1789130212.980306:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a561c0 00000100:00100000:0.0:1789130212.983029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130212.983176:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958464 00000100:00100000:1.0:1789130212.983191:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958464 00002000:00100000:1.0:1789130212.983270:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff90b384a04780 x1876037604958464/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/0 e 0 to 0 dl 1789130223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130212.983284:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04780 with x1876037604958464 ext(6291456->7340031) 00002000:00010000:1.0:1789130212.983295:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a04780 00000100:00100000:1.0:1789130212.983343:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:1.0:1789130212.983356:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037604958464:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130213.005070:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:2370:x1876037604958464:12345-192.168.201.39@tcp:4:dd.0 Request processed in 21702us (22042us total) trans 30064771155 rc 0/0 00000100:00100000:0.0:1789130213.005087:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00002000:00100000:0.0:1789130213.005103:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff90b384a04780 x1876037604958464/t30064771155(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:683/0 lens 488/448 e 0 to 0 dl 1789130223 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130213.005115:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04780 with x1876037604958464 ext(6291456->7340031) 00002000:00010000:0.0:1789130213.005123:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a04780 00000100:00100000:3.0:1789130213.010549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.010772:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958592 00000100:00100000:1.0:1789130213.010819:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958592 00002000:00100000:1.0:1789130213.010894:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff90b382d87840 x1876037604958592/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.010908:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87840 with x1876037604958592 ext(7340032->8388607) 00002000:00010000:1.0:1789130213.010916:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382d87840 00000100:00100000:1.0:1789130213.010962:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:1.0:1789130213.010975:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2369:x1876037604958592:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130213.028413:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604958592:12345-192.168.201.39@tcp:4:dd.0 Request processed in 17422us (17861us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1789130213.028432:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00002000:00100000:1.0:1789130213.028450:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff90b382d87840 x1876037604958592/t30064771156(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.028462:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d87840 with x1876037604958592 ext(7340032->8388607) 00002000:00010000:1.0:1789130213.028470:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382d87840 00000100:00100000:2.0:1789130213.039507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.039648:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958720 00000100:00100000:3.0:1789130213.039660:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958720 00002000:00100000:3.0:1789130213.039739:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff90b4876bde00 x1876037604958720/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130213.039753:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bde00 with x1876037604958720 ext(8388608->9437183) 00002000:00010000:3.0:1789130213.039763:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876bde00 00000100:00100000:3.0:1789130213.039818:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789130213.039828:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:2370:x1876037604958720:12345-192.168.201.39@tcp:4:dd.0 00000040:00080000:1.0:1789130213.062664:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130213.062679:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130213.062727:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 4 00000040:00080000:1.0:1789130213.062737:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130213.070027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.070337:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958848 00000100:00100000:3.0:1789130213.070352:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958848 00002000:00100000:3.0:1789130213.070421:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff90b384a56580 x1876037604958848/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130213.070435:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a56580 with x1876037604958848 ext(9437184->10485759) 00002000:00010000:3.0:1789130213.070443:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a56580 00000100:00100000:3.0:1789130213.070484:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:3.0:1789130213.070495:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604958848:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130213.073273:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037604958720:12345-192.168.201.39@tcp:4:dd.0 Request processed in 33428us (33764us total) trans 30064771157 rc 0/0 00000100:00100000:1.0:1789130213.073290:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00002000:00100000:1.0:1789130213.073306:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff90b4876bde00 x1876037604958720/t30064771157(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.073318:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bde00 with x1876037604958720 ext(8388608->9437183) 00002000:00010000:1.0:1789130213.073347:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876bde00 00000100:00100000:3.0:1789130213.096836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.097002:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604958976 00000100:00100000:2.0:1789130213.097016:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604958976 00002000:00100000:2.0:1789130213.097081:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff90b382d861c0 x1876037604958976/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.097094:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d861c0 with x1876037604958976 ext(10485760->11534335) 00002000:00010000:2.0:1789130213.097111:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382d861c0 00000100:00100000:2.0:1789130213.097169:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:2.0:1789130213.097184:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604958976:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130213.098141:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604958848:12345-192.168.201.39@tcp:4:dd.0 Request processed in 27642us (28124us total) trans 30064771158 rc 0/0 00000100:00100000:1.0:1789130213.098163:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00002000:00100000:1.0:1789130213.098173:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff90b384a56580 x1876037604958848/t30064771158(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.098184:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a56580 with x1876037604958848 ext(9437184->10485759) 00002000:00010000:1.0:1789130213.098189:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a56580 00000100:00100000:2.0:1789130213.117901:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:2368:x1876037604958976:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20704us (21071us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1789130213.117920:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00002000:00100000:2.0:1789130213.117937:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff90b382d861c0 x1876037604958976/t30064771159(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.117974:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382d861c0 with x1876037604958976 ext(10485760->11534335) 00002000:00010000:2.0:1789130213.117983:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382d861c0 00000100:00100000:1.0:1789130213.130657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.130959:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959104 00000100:00100000:2.0:1789130213.130972:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959104 00002000:00100000:2.0:1789130213.131043:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff90b384a55e00 x1876037604959104/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.131058:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a55e00 with x1876037604959104 ext(11534336->12582911) 00002000:00010000:2.0:1789130213.131066:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a55e00 00000100:00100000:2.0:1789130213.131115:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:2.0:1789130213.131127:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:2368:x1876037604959104:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130213.149523:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:2368:x1876037604959104:12345-192.168.201.39@tcp:4:dd.0 Request processed in 18379us (18907us total) trans 30064771160 rc 0/0 00000100:00100000:2.0:1789130213.149543:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00002000:00100000:2.0:1789130213.149561:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff90b384a55e00 x1876037604959104/t30064771160(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.149573:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a55e00 with x1876037604959104 ext(11534336->12582911) 00002000:00010000:2.0:1789130213.149583:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a55e00 00000100:00100000:1.0:1789130213.154058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.154247:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959232 00000100:00100000:3.0:1789130213.154262:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959232 00002000:00100000:3.0:1789130213.154344:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff90b384a56d00 x1876037604959232/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130213.154358:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a56d00 with x1876037604959232 ext(12582912->13631487) 00002000:00010000:3.0:1789130213.154368:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a56d00 00000100:00100000:3.0:1789130213.154407:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:3.0:1789130213.154420:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:2370:x1876037604959232:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130213.176720:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604959232:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22284us (22668us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1789130213.176738:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00002000:00100000:1.0:1789130213.176756:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff90b384a56d00 x1876037604959232/t30064771161(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.176768:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a56d00 with x1876037604959232 ext(12582912->13631487) 00002000:00010000:1.0:1789130213.176985:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a56d00 00000100:00100000:0.0:1789130213.182243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.182412:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959360 00000100:00100000:1.0:1789130213.182426:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959360 00002000:00100000:1.0:1789130213.182500:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff90b384a05680 x1876037604959360/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.182514:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05680 with x1876037604959360 ext(13631488->14680063) 00002000:00010000:1.0:1789130213.182522:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a05680 00000100:00100000:1.0:1789130213.182566:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1789130213.182579:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+33:2369:x1876037604959360:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130213.215444:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+35:2369:x1876037604959360:12345-192.168.201.39@tcp:4:dd.0 Request processed in 32845us (33197us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1789130213.215466:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00002000:00100000:2.0:1789130213.215486:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff90b384a05680 x1876037604959360/t30064771162(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.215531:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a05680 with x1876037604959360 ext(13631488->14680063) 00002000:00010000:2.0:1789130213.215541:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a05680 00000100:00100000:0.0:1789130213.218470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.218555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.218650:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959488 00000100:00100000:1.0:1789130213.218662:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959488 00002000:00100000:1.0:1789130213.218733:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff90b384a07c00 x1876037604959488/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/0 e 0 to 0 dl 1789130224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130213.218747:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07c00 with x1876037604959488 ext(14680064->15728639) 00002000:00010000:1.0:1789130213.218754:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a07c00 00000100:00100000:1.0:1789130213.219058:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:1.0:1789130213.219071:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604959488:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130213.221436:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959744 00000100:00100000:3.0:1789130213.221457:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959744 00000100:00100000:0.0:1789130213.223540:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130213.223559:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:36207:x1876037604959744:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130213.224092:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:36207:x1876037604959744:12345-192.168.201.39@tcp:35:dd.0 Request processed in 535us (5634us total) trans 30064771354 rc 0/0 00000100:00100000:0.0:1789130213.225095:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130213.235447:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2370:x1876037604959488:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16363us (16875us total) trans 30064771163 rc 0/0 00000100:00100000:2.0:1789130213.235465:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00002000:00100000:2.0:1789130213.235482:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff90b384a07c00 x1876037604959488/t30064771163(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:684/0 lens 488/448 e 0 to 0 dl 1789130224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130213.235494:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a07c00 with x1876037604959488 ext(14680064->15728639) 00002000:00010000:2.0:1789130213.235503:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a07c00 00000100:00100000:1.0:1789130213.256368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.257477:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604959872 00000100:00100000:0.0:1789130213.257497:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604959872 00000100:00100000:0.0:1789130213.257597:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 322 00000100:00100000:0.0:1789130213.257665:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:36208:x1876037604959872:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130213.257698:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130213.257726:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d7c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abee7 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.257889:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.257907:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.257924:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.258062:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d7c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 32 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.258596:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.258644:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130213.258647:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130213.258651:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:1.0:1789130213.258837:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+31:36208:x1876037604959872:12345-192.168.201.39@tcp:101:chown.0 Request processed in 1175us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.258846:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 322 00000100:00100000:1.0:1789130213.263345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.263696:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960128 00000100:00100000:0.0:1789130213.263711:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960128 00000100:00100000:0.0:1789130213.263809:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 323 00000100:00100000:0.0:1789130213.263822:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:36208:x1876037604960128:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:0.0:1789130213.263895:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130213.263932:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9d3d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abecb expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.263956:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130213.263962:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130213.264002:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.264019:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.264032:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130213.264842:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].10, 88 off9000 00000004:00080000:0.0:1789130213.264858:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1376362255317ns, next at 1377362251662ns, rc = 0 00000004:00010000:0.0:1789130213.264973:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000080810e79 reply state 00000000ee263c1e transno 30064771355 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130213.264984:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130213.266152:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+32:36208:x1876037604960128:12345-192.168.201.39@tcp:36:chown.0 Request processed in 2315us (2805us total) trans 30064771355 rc 0/0 00000100:00100000:0.0:1789130213.266165:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 323 00010000:00010000:2.0:1789130213.268910:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.268933:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.268942:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.268949:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.268954:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.268964:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.268986:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130213.268990:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130213.269016:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.269024:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9d8a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130213.269969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.270253:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960256 00000100:00100000:0.0:1789130213.270268:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960256 00000100:00100000:0.0:1789130213.270341:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 324 00000100:00100000:0.0:1789130213.270353:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:36208:x1876037604960256:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130213.270387:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130213.270412:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abeee expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.270493:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.270508:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.270533:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130213.270537:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130213.270541:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:0.0:1789130213.270657:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36208:x1876037604960256:12345-192.168.201.39@tcp:101:chown.0 Request processed in 305us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130213.270665:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 324 00000100:00100000:0.0:1789130213.274038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.274301:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960384 00000100:00100000:1.0:1789130213.274315:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960384 00000100:00100000:1.0:1789130213.274393:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:1.0:1789130213.274406:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037604960384:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:1.0:1789130213.274729:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1789130213.274733:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1789130212 00002000:00010000:1.0:1789130213.274736:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130213.274738:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 0 -> 1789130213 00002000:00010000:1.0:1789130213.274740:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130213.274836:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604960384:12345-192.168.201.39@tcp:2:chown.0 Request processed in 431us (814us total) trans 30064771197 rc 0/0 00000100:00100000:1.0:1789130213.274856:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:2.0:1789130213.295706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.295925:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960512 00000100:00100000:1.0:1789130213.295939:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960512 00000100:00100000:1.0:1789130213.296024:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:1.0:1789130213.296037:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:36209:x1876037604960512:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130213.296067:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.296104:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9d98 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abef5 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296164:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce9d9f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296181:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce9d9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296196:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce9d9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296348:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9d98 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abef5 expref: 34 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296370:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce9d9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abef5 expref: 33 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.296380:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130213.296383:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130213.296387:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:1.0:1789130213.296525:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:36209:x1876037604960512:12345-192.168.201.39@tcp:101:chown.0 Request processed in 490us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.296542:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:2.0:1789130213.301248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.301540:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960768 00000100:00100000:0.0:1789130213.301555:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960768 00000100:00100000:0.0:1789130213.301682:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 326 00000100:00100000:0.0:1789130213.301701:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:36209:x1876037604960768:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:0.0:1789130213.301778:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130213.301819:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9d67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed9 expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.301842:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130213.301849:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130213.301887:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.301902:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.301912:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130213.303558:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].12, 88 off9080 00000004:00080000:0.0:1789130213.303581:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1376400977998ns, next at 1377400973417ns, rc = 0 00000004:00010000:0.0:1789130213.303757:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000008d867d2 reply state 000000007961c35c transno 30064771356 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130213.303770:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130213.304085:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:36209:x1876037604960768:12345-192.168.201.39@tcp:36:chown.0 Request processed in 2385us (2844us total) trans 30064771356 rc 0/0 00000100:00100000:0.0:1789130213.304106:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 326 00000100:00100000:0.0:1789130213.308221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.309085:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604960896 00000100:00100000:1.0:1789130213.309115:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604960896 00000100:00100000:1.0:1789130213.309216:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:1.0:1789130213.309229:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:36209:x1876037604960896:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130213.309266:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.309297:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9dad lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abefc expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.309395:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9dad lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abefc expref: 35 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.309412:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9dad lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abefc expref: 35 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.309437:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130213.309441:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130213.309447:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:1.0:1789130213.309669:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:36209:x1876037604960896:12345-192.168.201.39@tcp:101:chown.0 Request processed in 442us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.309677:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 327 00010000:00010000:2.0:1789130213.309958:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.309970:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.309978:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.309984:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.309990:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.309998:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.310029:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:2.0:1789130213.310033:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130213.310037:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.310045:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9da6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130213.313540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.313682:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961024 00000100:00100000:3.0:1789130213.313697:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961024 00000100:00100000:3.0:1789130213.313938:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:3.0:1789130213.313953:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604961024:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:3.0:1789130213.314248:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789130213.314263:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1789130212 00002000:00010000:3.0:1789130213.314265:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130213.314267:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 0 -> 1789130213 00002000:00010000:3.0:1789130213.314269:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789130213.314353:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604961024:12345-192.168.201.39@tcp:2:chown.0 Request processed in 403us (827us total) trans 30064771164 rc 0/0 00000100:00100000:3.0:1789130213.323276:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789130213.373058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.373414:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961152 00000100:00100000:3.0:1789130213.373428:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961152 00000100:00100000:3.0:1789130213.373509:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 328 00000100:00100000:3.0:1789130213.373522:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+34:36215:x1876037604961152:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:3.0:1789130213.373551:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130213.373581:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf03 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373725:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373744:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373757:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130213.373847:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00000004:00200000:3.0:1789130213.373852:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130213.373882:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373917:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf03 expref: 36 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373960:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf03 expref: 35 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.373969:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130213.373973:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130213.373977:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86600, rc 0) 00000100:00100000:3.0:1789130213.375439:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:36215:x1876037604961152:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1909us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130213.375456:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 328 00000100:00100000:1.0:1789130213.378265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.378353:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961280 00000100:00100000:1.0:1789130213.378365:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961280 00000100:00100000:1.0:1789130213.378448:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:1.0:1789130213.378460:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:36215:x1876037604961280:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130213.378510:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.378538:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9dc2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf0a expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378665:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378683:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378697:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378715:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378722:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378728:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378880:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378890:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378897:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130213.378931:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:1.0:1789130213.378942:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130213.378974:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378988:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.378998:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379004:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379010:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379016:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130213.379021:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379028:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379041:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130213.379044:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130213.379051:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379057:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9dc9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379072:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379092:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379098:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379103:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130213.379106:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379113:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379121:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff90b4909bd500) 00010000:00010000:1.0:1789130213.379124:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130213.379128:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379134:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dd0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379191:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9dc2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 37 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379207:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 36 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.379215:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130213.379217:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130213.379226:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:1.0:1789130213.379305:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:36215:x1876037604961280:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 847us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.379315:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:2.0:1789130213.384036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.384171:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961536 00000100:00100000:1.0:1789130213.384186:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961536 00000100:00100000:1.0:1789130213.384267:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 330 00000100:00100000:1.0:1789130213.384280:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:36215:x1876037604961536:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130213.384309:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.384339:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9dde lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf11 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.384485:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9de5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.384506:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9de5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.384520:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9de5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130213.384534:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1789130213.385079:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9dde lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf11 expref: 39 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.385366:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9de5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf11 expref: 38 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.385377:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130213.385399:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130213.385404:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:1.0:1789130213.385546:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:36215:x1876037604961536:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1267us (1525us total) trans 30064771357 rc 0/0 00000100:00100000:1.0:1789130213.385555:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 330 00000100:00100000:2.0:1789130213.391385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.391438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.391527:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961792 00000100:00100000:1.0:1789130213.391539:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961792 00000100:00100000:1.0:1789130213.391643:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:1.0:1789130213.391656:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+38:36215:x1876037604961792:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130213.391688:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.391714:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9df3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf18 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.391866:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.391884:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.391899:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130213.391913:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1789130213.392080:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce9df3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf18 expref: 41 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.392116:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf18 expref: 40 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.392159:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130213.392162:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130213.392167:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00100000:1.0:1789130213.392242:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:36215:x1876037604961792:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 588us (872us total) trans 30064771358 rc 0/0 00000100:00100000:1.0:1789130213.392251:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:3.0:1789130213.393185:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604961920 00000100:00100000:3.0:1789130213.393200:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604961920 00000100:00100000:3.0:1789130213.393276:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130213.393286:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037604961920:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130213.393305:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130213.393331:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce9de5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf11 expref: 40 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.393349:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130213.393353:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130213.393398:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604961920:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 114us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130213.393406:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789130213.582722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.582913:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962048 00000100:00100000:0.0:1789130213.582926:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962048 00000100:00100000:0.0:1789130213.583008:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789130213.583019:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604962048:12345-192.168.201.39@tcp:1:lfs.500 00010000:00010000:0.0:1789130213.583083:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.583117:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 41 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.583127:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789130213.583131:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130213.583137:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.583190:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 41 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.583207:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 41 pid: 37658 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130213.583233:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a052c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626828672:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130213.583358:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130213.591863:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a052c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626828672:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130213.591912:0:37276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130213.609721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.610229:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962176 00000100:00100000:0.0:1789130213.610244:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962176 00010000:00010000:0.0:1789130213.610298:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 42 pid: 37658 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130213.610343:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130213.610352:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:2368:x1876037604962176:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130213.610368:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130213.610398:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 42 pid: 37658 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.610413:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 42 pid: 37658 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.610444:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9d4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abed2 expref: 42 pid: 37658 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.610463:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130213.610466:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130213.610472:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.610479:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.610571:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130213.610662:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604962176:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 312us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130213.610668:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:1.0:1789130213.612368:0:37276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612389:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612434:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612444:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612453:0:37276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612461:0:37276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130213.612466:0:37276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612507:0:37276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612530:0:37276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.612538:0:37276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45c3bcc/0x5c74554e47ce9e08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130213.612702:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037604962048:12345-192.168.201.39@tcp:1:lfs.500 Request processed in 29681us (29991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.612713:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:2.0:1789130213.616208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.616313:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962432 00000100:00100000:3.0:1789130213.616326:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962432 00000100:00100000:3.0:1789130213.616400:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789130213.616433:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:36215:x1876037604962432:12345-192.168.201.39@tcp:35:lfs.500 00000004:00010000:3.0:1789130213.616532:0:36590:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf18 expref: 39 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130213.616939:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771359 00000001:00080000:3.0:1789130213.616992:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771360 00000001:00080000:3.0:1789130213.617788:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771361 00010000:00010000:3.0:1789130213.617863:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617883:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 43 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617892:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 43 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617899:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 43 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617907:0:36590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617950:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 43 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.617969:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 43 pid: 36588 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130213.617985:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626828800:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130213.618112:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 43 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.618123:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 43 pid: 38734 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130213.618132:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d84780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626828928:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130213.618182:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 43 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.618191:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 43 pid: 38723 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130213.618201:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626829056:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130213.618227:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0cb5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130213.622340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.622421:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.622505:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626828800:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130213.622522:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d84780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626828928:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130213.622531:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626829056:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130213.622570:0:36590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130213.623582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.623917:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962560 00000100:00100000:1.0:1789130213.623927:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962560 00010000:00010000:1.0:1789130213.625500:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 44 pid: 36588 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130213.625562:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962816 00000100:00100000:1.0:1789130213.625570:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962816 00010000:00010000:1.0:1789130213.625591:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 45 pid: 38723 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130213.625643:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1789130213.625655:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:2369:x1876037604962560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130213.625676:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130213.625703:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 45 pid: 36588 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.625720:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 45 pid: 36588 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.625748:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9d91 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abeee expref: 45 pid: 36588 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.625782:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00000100:00100000:3.0:1789130213.625926:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789130213.625937:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037604962816:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130213.625946:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130213.625958:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 44 pid: 38723 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.625981:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.625995:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.626002:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130213.626086:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037604962560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 433us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.626107:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1789130213.627595:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962688 00000100:00100000:1.0:1789130213.627626:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962688 00010000:00010000:1.0:1789130213.627672:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 44 pid: 38734 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130213.627709:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130213.627721:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037604962688:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130213.627744:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130213.627764:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 44 pid: 38734 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.628490:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 44 pid: 38723 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.628521:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9d83 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abee7 expref: 44 pid: 38723 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.628545:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789130213.628552:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.628563:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.628570:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130213.628660:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:2369:x1876037604962816:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 2725us (6237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130213.628669:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00010000:00010000:1.0:1789130213.630530:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 42 pid: 38734 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.630572:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9dd7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf0a expref: 42 pid: 38734 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.630590:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:1.0:1789130213.630596:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.630747:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.630756:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.631434:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130213.631727:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604962688:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4004us (8146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.631743:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00010000:00010000:3.0:1789130213.632059:0:36590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.632071:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130213.632279:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771362 00000001:00080000:3.0:1789130213.632537:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771363 00000100:00100000:3.0:1789130213.632713:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626829184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130213.632796:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130213.632865:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130213.633030:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626829184 00000100:00100000:0.0:1789130213.633041:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626829184 00000100:00100000:0.0:1789130213.633126:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130213.633147:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626829184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130213.633240:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626829184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130213.633248:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789130213.633567:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130213.633731:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626829184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789130213.634573:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771364 00000100:00100000:3.0:1789130213.634703:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626829312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130213.634951:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130213.635056:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0cb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130213.636486:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626829312 00000100:00100000:0.0:1789130213.636502:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626829312 00000100:00100000:0.0:1789130213.637008:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789130213.637027:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626829312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130213.639497:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36590:x1876037626829312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2462us (4718us total) trans 30064771198 rc 0/0 00000100:00100000:0.0:1789130213.639518:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130213.639704:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626829312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130213.641038:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771365 00010000:00010000:2.0:1789130213.641188:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641203:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641212:0:36590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641219:0:36590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.641225:0:36590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641234:0:36590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641258:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130213.641261:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130213.641282:0:36590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.641288:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9e0f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130213.641737:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130213.643315:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].11, 64 off9064 00000001:00080000:2.0:1789130213.643342:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771366 00010000:00010000:2.0:1789130213.643424:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789130213.643429:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130213.643443:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce9dfa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf18 expref: 45 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130213.643631:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:36215:x1876037604962432:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 27200us (27438us total) trans 30064771367 rc 0/0 00000100:00100000:2.0:1789130213.643643:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000020:00080000:2.0:1789130213.643651:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789130213.655922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.656035:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604962944 00000100:00100000:2.0:1789130213.656047:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604962944 00000100:00100000:2.0:1789130213.656120:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 332 00000100:00100000:2.0:1789130213.656131:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:36215:x1876037604962944:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130213.656169:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130213.656196:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9e16 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf1f expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.656282:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9e16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf1f expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.656315:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9e16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf1f expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.656338:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130213.656341:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130213.656346:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130213.656408:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:36215:x1876037604962944:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 279us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130213.656417:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 332 00000100:00100000:2.0:1789130213.665396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.665720:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604963200 00000100:00100000:3.0:1789130213.665736:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604963200 00000100:00100000:3.0:1789130213.665815:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130213.665827:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:36215:x1876037604963200:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:3.0:1789130213.666165:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:36215:x1876037604963200:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 338us (782us total) trans 30064771368 rc 0/0 00000100:00100000:3.0:1789130213.666174:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000001:00080000:1.0:1789130213.757359:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771356 is committed 00000004:00080000:1.0:1789130213.757374:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:1.0:1789130213.757394:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:2.0:1789130213.757633:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130213.757660:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626829440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789130213.757750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130213.757996:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626829440 00000100:00100000:0.0:1789130213.758004:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626829440 00000100:00100000:0.0:1789130213.758080:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789130213.758100:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626829440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789130213.758305:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1789130213.758309:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 1789130212 -> 1789130212 00002000:00010000:0.0:1789130213.758312:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130213.758315:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1789130213 -> 1789130213 00002000:00010000:0.0:1789130213.758317:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130213.758363:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626829440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (613us total) trans 30064771165 rc 0/0 00000100:00100000:0.0:1789130213.758371:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789130213.758571:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626829568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130213.758630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789130213.758671:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383f28b40/2, rc 0, transno 30064771165 00000100:00100000:2.0:1789130213.758676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626829440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789130213.758786:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626829568 00000100:00100000:0.0:1789130213.758876:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626829568 00000100:00100000:0.0:1789130213.758914:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789130213.758921:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626829568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789130213.759114:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626829568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (510us total) trans 30064771199 rc 0/0 00000100:00100000:0.0:1789130213.759121:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789130213.759318:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789130213.759402:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771358 is committed 00000001:00080000:1.0:1789130213.759433:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771365 is committed 00000020:00080000:1.0:1789130213.759440:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b489c2a180 refcount 2 committed 0 result 0 batchid 25769803909 00000020:00080000:1.0:1789130213.759446:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b489c2ae40 00000020:00080000:1.0:1789130213.759472:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4c197ac00 00000020:00080000:3.0:1789130213.759554:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803909 committed batchid 25769803908 00000020:00080000:3.0:1789130213.759757:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000004:00080000:2.0:1789130213.762999:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384a052c0/2, rc 0, transno 30064771199 00000100:00100000:2.0:1789130213.763182:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626829568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130213.765309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.765414:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604963328 00000100:00100000:1.0:1789130213.765428:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604963328 00000100:00100000:1.0:1789130213.765501:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:1.0:1789130213.765513:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:36221:x1876037604963328:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130213.765548:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130213.765582:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9e1d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf26 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765712:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765729:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765742:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765759:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765766:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.765773:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766655:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766669:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766686:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130213.766722:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000004:00200000:1.0:1789130213.766728:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130213.766754:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766769:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766778:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766786:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766854:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766861:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130213.766866:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766875:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766890:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130213.766893:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130213.766899:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766917:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce9e24 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766934:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766940:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766946:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766951:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130213.766954:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766959:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766967:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff90b4909bd500) 00010000:00010000:1.0:1789130213.766970:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130213.766972:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.766977:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47ce9e2b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.767015:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce9e1d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf26 expref: 30 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.767040:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf26 expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.767048:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130213.767051:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130213.767053:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362400, rc 0) 00000100:00100000:0.0:1789130213.768219:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:36221:x1876037604963328:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 2698us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130213.768233:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:2.0:1789130213.773132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.773277:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604963584 00000100:00100000:0.0:1789130213.773294:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604963584 00000100:00100000:0.0:1789130213.773372:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 334 00000100:00100000:0.0:1789130213.773385:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:36221:x1876037604963584:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130213.773414:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130213.773442:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9e39 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf2d expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.773599:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9e40 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.773664:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9e40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.773683:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9e40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130213.773699:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:0.0:1789130213.773898:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9e39 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf2d expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.773920:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9e40 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf2d expref: 31 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.773929:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130213.773933:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130213.773938:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:0.0:1789130213.774021:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:36221:x1876037604963584:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 639us (906us total) trans 30064771369 rc 0/0 00000100:00100000:0.0:1789130213.774030:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 334 00000100:00100000:2.0:1789130213.778939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.778996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.779276:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604963840 00000100:00100000:0.0:1789130213.779290:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604963840 00000100:00100000:0.0:1789130213.779359:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00100000:0.0:1789130213.779373:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:36221:x1876037604963840:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130213.779410:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130213.779439:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9e4e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf34 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.779580:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9e55 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.779642:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9e55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.779658:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9e55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130213.779676:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:0.0:1789130213.779876:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9e4e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf34 expref: 34 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.779902:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9e55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf34 expref: 33 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.779911:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:0.0:1789130213.779914:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130213.779919:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:0.0:1789130213.780002:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:36221:x1876037604963840:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 633us (1078us total) trans 30064771370 rc 0/0 00000100:00100000:0.0:1789130213.780011:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00100000:1.0:1789130213.780436:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604963968 00000100:00100000:1.0:1789130213.780443:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604963968 00000100:00100000:1.0:1789130213.780500:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1789130213.780510:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604963968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130213.780521:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130213.780540:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9e40 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf2d expref: 33 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130213.780554:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130213.780557:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130213.780580:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:2370:x1876037604963968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 74us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130213.780587:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00010000:00010000:2.0:1789130213.830055:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130213.832657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.832764:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604964096 00000100:00100000:3.0:1789130213.832778:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604964096 00000100:00100000:3.0:1789130213.832911:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789130213.832924:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:36221:x1876037604964096:12345-192.168.201.39@tcp:103:lfs.500 00010000:00010000:3.0:1789130213.832945:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130213.832978:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9e55 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf34 expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130213.833003:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:3.0:1789130213.833022:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130213.833108:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:36221:x1876037604964096:12345-192.168.201.39@tcp:103:lfs.500 Request processed in 187us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130213.833117:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130213.835540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.835642:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604964352 00000100:00100000:3.0:1789130213.835654:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604964352 00000100:00100000:3.0:1789130213.835720:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130213.835733:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:36221:x1876037604964352:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:3.0:1789130213.836072:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36221:x1876037604964352:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 341us (546us total) trans 30064771371 rc 0/0 00000100:00100000:3.0:1789130213.836082:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1789130213.851889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130213.854246:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604964608 00000100:00100000:3.0:1789130213.854270:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604964608 00000100:00100000:3.0:1789130213.854864:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130213.854881:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36221:x1876037604964608:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:3.0:1789130213.855523:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:36221:x1876037604964608:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 643us (3645us total) trans 30064771372 rc 0/0 00000100:00100000:3.0:1789130213.855536:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130213.946359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130213.946544:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604964864 00000100:00100000:0.0:1789130213.946558:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604964864 00000100:00100000:0.0:1789130213.946682:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 336 00000100:00100000:0.0:1789130213.946694:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:36231:x1876037604964864:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130213.946730:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130213.946770:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf3b expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130213.947154:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 7680 00010000:00010000:0.0:1789130213.947363:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9e63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf3b expref: 35 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.947383:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130213.947387:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130213.947392:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf3b expref: 35 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130213.947410:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:0.0:1789130213.947488:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:36231:x1876037604964864:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 795us (1144us total) trans 30064771373 rc 301/301 00000100:00100000:0.0:1789130213.947496:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 336 00000100:00100000:1.0:1789130213.954743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130213.954964:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604964992 00000100:00100000:2.0:1789130213.954979:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604964992 00000100:00100000:2.0:1789130213.955118:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:2.0:1789130213.955131:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+34:36231:x1876037604964992:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130213.955259:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955282:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955301:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955321:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955329:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955336:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955775:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955785:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955793:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130213.955865:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955881:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955888:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955896:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955903:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.955908:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955917:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955932:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130213.955936:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130213.955942:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955949:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9e71 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955961:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955965:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955974:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955977:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.955979:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955983:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955989:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff90b4976b8c00) 00010000:00010000:2.0:1789130213.955990:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130213.955992:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.955996:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e78 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956006:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956010:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956013:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956016:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130213.956018:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956028:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956033:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130213.956034:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130213.956036:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130213.956039:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e7f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130213.956125:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+34:36231:x1876037604964992:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 995us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130213.956143:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:3.0:1789130213.961305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130213.961449:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604965248 00000100:00100000:1.0:1789130213.961464:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604965248 00000100:00100000:1.0:1789130213.961545:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:1.0:1789130213.961559:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:36231:x1876037604965248:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130213.962421:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:36231:x1876037604965248:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 860us (1126us total) trans 30064771374 rc 0/0 00000100:00100000:1.0:1789130213.962432:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130214.036417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130214.037105:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604965504 00000100:00100000:2.0:1789130214.037119:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604965504 00000100:00100000:2.0:1789130214.037235:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 338 00000100:00100000:2.0:1789130214.037249:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:36241:x1876037604965504:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130214.037281:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130214.037308:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf42 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.037746:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e8d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.037766:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e8d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.037780:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e8d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130214.037804:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 7680 00010000:00010000:2.0:1789130214.038016:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf42 expref: 38 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.038034:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf42 expref: 37 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.038043:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130214.038045:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130214.038048:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130214.038146:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:36241:x1876037604965504:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 888us (1731us total) trans 30064771375 rc 0/0 00000100:00100000:2.0:1789130214.038155:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 338 00000100:00080000:3.0:1789130214.038792:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130214.112359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130214.112831:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604965760 00000100:00100000:3.0:1789130214.112847:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604965760 00000100:00100000:3.0:1789130214.112928:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:3.0:1789130214.112941:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:36247:x1876037604965760:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130214.113000:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130214.113033:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9e9b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf49 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113155:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113175:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113189:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113206:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113214:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113221:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113723:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9eb0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113733:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9eb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113741:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9eb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130214.113752:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:3.0:1789130214.113877:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113885:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113893:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113899:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130214.113904:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113912:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113929:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130214.113932:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130214.113939:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113946:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9ea2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113965:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113973:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113979:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.113995:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130214.113999:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114006:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114015:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff90b488939800) 00010000:00010000:3.0:1789130214.114018:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130214.114021:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114027:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9ea9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114086:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9e9b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf49 expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114103:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9eb0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf49 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.114110:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130214.114112:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130214.114115:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87000, rc 0) 00000100:00100000:3.0:1789130214.115168:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604965760:12345-192.168.201.39@tcp:101:dd.500 Request processed in 2222us (2816us total) trans 30064771376 rc 0/0 00000100:00100000:3.0:1789130214.115181:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:1.0:1789130214.121533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130214.121721:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966016 00000100:00100000:2.0:1789130214.121765:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966016 00000100:00100000:2.0:1789130214.121846:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 340 00000100:00100000:2.0:1789130214.121857:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604966016:12345-192.168.201.39@tcp:36:dd.500 00010000:00010000:2.0:1789130214.121929:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130214.121960:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47ce9eb0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf49 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.121984:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130214.122001:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130214.122653:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.122691:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.122702:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130214.122761:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771377 00000004:00010000:2.0:1789130214.122833:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000000625dbf reply state 000000006e0ff908 transno 30064771378 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130214.122845:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130214.123170:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:36247:x1876037604966016:12345-192.168.201.39@tcp:36:dd.500 Request processed in 1311us (1649us total) trans 30064771378 rc 0/0 00000100:00100000:2.0:1789130214.123180:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 340 00000020:00080000:2.0:1789130214.123187:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130214.128237:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128262:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128271:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128278:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130214.128284:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128293:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128319:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130214.128323:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130214.128330:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.128338:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9ebe lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130214.302842:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771165 is committed 00000001:00080000:1.0:1789130214.302866:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771155 is committed 00000001:00080000:1.0:1789130214.302878:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771161 is committed 00000001:00080000:1.0:1789130214.302901:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771163 is committed 00000001:00080000:1.0:1789130214.302938:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771164 is committed 00000100:00100000:1.0:1789130214.440565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130214.440772:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966272 00000100:00100000:2.0:1789130214.440784:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966272 00000100:00100000:2.0:1789130214.440866:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130214.440875:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:36247:x1876037604966272:12345-192.168.201.39@tcp:103:dd.500 00010000:00010000:2.0:1789130214.440892:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130214.440919:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9e16 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf1f expref: 40 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130214.440939:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130214.440950:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130214.441013:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604966272:12345-192.168.201.39@tcp:103:dd.500 Request processed in 139us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130214.441018:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130214.443380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130214.443504:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966400 00000100:00100000:0.0:1789130214.443515:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966400 00000100:00100000:0.0:1789130214.443582:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:0.0:1789130214.443591:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604966400:12345-192.168.201.39@tcp:58:dd.500 00010000:00010000:0.0:1789130214.443738:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.443761:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130214.443772:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130214.444400:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].9, 136 off9416 00000100:00100000:0.0:1789130214.444536:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604966400:12345-192.168.201.39@tcp:58:dd.500 Request processed in 943us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130214.444546:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:1.0:1789130214.451846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130214.452196:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966528 00000100:00100000:3.0:1789130214.452534:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966528 00000100:00100000:3.0:1789130214.453943:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 342 00000100:00100000:3.0:1789130214.453970:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:36247:x1876037604966528:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130214.454004:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130214.454034:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf50 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454174:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454192:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454226:0:36589:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454242:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454260:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:3.0:1789130214.454264:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130214.454269:0:36589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130214.454277:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87200, rc 0) 00000100:00100000:3.0:1789130214.454375:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:36247:x1876037604966528:12345-192.168.201.39@tcp:101:dd.500 Request processed in 419us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130214.454384:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 342 00010000:00010000:2.0:1789130214.854323:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130215.110697:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130215.110711:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130215.110778:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:1.0:1789130215.110789:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130215.110989:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e670c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626829696:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130215.111151:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130215.124586:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e670c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626829696:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130215.125534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.126146:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966656 00000100:00100000:0.0:1789130215.126160:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966656 00000100:00100000:0.0:1789130215.126254:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:0.0:1789130215.126268:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:36249:x1876037604966656:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130215.126327:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130215.126478:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:36249:x1876037604966656:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 213us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130215.126488:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:1.0:1789130215.144675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.144849:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604966784 00000100:00100000:2.0:1789130215.144863:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604966784 00000100:00100000:2.0:1789130215.144945:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 344 00000100:00100000:2.0:1789130215.144958:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:36249:x1876037604966784:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789130215.145075:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145098:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145123:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145144:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145152:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145159:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145187:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145196:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145203:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130215.145506:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00000004:00200000:2.0:1789130215.145513:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130215.145535:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145567:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145575:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145583:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145590:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130215.145595:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145647:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145665:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130215.145667:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130215.145675:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145682:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9ed3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145700:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145719:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145725:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145731:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130215.145734:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145740:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145748:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xcbfe478c (ffff90b4976b8f00) 00010000:00010000:2.0:1789130215.145751:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130215.145754:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145760:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9eda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145778:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145783:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145788:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145793:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130215.145803:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145810:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145818:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130215.145820:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130215.145823:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.145829:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9ee1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130215.146468:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:36249:x1876037604966784:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1499us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130215.146484:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 344 00000100:00100000:1.0:1789130215.162820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.162922:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604967040 00000100:00100000:2.0:1789130215.162946:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604967040 00000100:00100000:2.0:1789130215.163026:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:2.0:1789130215.163039:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:36249:x1876037604967040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130215.163078:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130215.163121:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ee8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf57 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163267:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163300:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163338:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130215.163353:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00010000:00010000:2.0:1789130215.163525:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163535:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163542:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163549:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130215.163554:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163563:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163580:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130215.163584:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130215.163590:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163597:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9eef lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163698:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ee8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf57 expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163722:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130215.163724:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130215.163729:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9ee8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf57 expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.163740:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:2.0:1789130215.163820:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 784us (1015us total) trans 30064771379 rc 301/301 00000100:00100000:2.0:1789130215.163830:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:3.0:1789130215.169138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.169518:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604967168 00000100:00100000:2.0:1789130215.169533:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604967168 00000100:00100000:2.0:1789130215.169662:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 346 00000100:00100000:2.0:1789130215.169676:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967168:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130215.169736:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130215.169890:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967168:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 217us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130215.169899:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 346 00000100:00100000:1.0:1789130215.173539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.174054:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604967424 00000100:00100000:2.0:1789130215.174076:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604967424 00000100:00100000:2.0:1789130215.174165:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:2.0:1789130215.174177:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130215.174206:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130215.174210:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130215.174249:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47ce9dbb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf03 expref: 41 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.174706:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130215.174712:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130215.174731:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9efd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf5e expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130215.176126:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc9:0x0], index 0: 0 00010000:00010000:2.0:1789130215.176410:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9f04 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.176442:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9f04 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.176457:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9f04 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.176560:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9efd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf5e expref: 43 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.176584:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9f04 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf5e expref: 42 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.176593:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130215.176597:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130215.176654:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130215.176764:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:36249:x1876037604967424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2588us (3243us total) trans 30064771380 rc 0/0 00000100:00100000:2.0:1789130215.176777:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:1.0:1789130215.184325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.184459:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604967680 00000100:00100000:0.0:1789130215.184473:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604967680 00000100:00100000:0.0:1789130215.184555:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:0.0:1789130215.184569:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+42:36249:x1876037604967680:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130215.184693:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130215.184734:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9f04 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf5e expref: 42 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184760:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130215.184775:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130215.184806:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184823:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184836:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184856:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184863:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.184874:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185275:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185285:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185294:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185301:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130215.185307:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185316:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185328:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130215.185331:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130215.185336:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185343:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce9f12 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185355:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185361:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185368:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185374:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130215.185377:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185383:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185391:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x84dd3ab (ffff90b4a2a08500) 00010000:00010000:0.0:1789130215.185393:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130215.185396:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.185401:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f19 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x84dd3ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130215.185513:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967680:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 945us (1203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130215.185523:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:3.0:1789130215.188345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.188517:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604967808 00000100:00100000:0.0:1789130215.188532:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604967808 00000100:00100000:0.0:1789130215.190751:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 349 00000100:00100000:0.0:1789130215.190774:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:36249:x1876037604967808:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130215.190806:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130215.190845:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9f20 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf65 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.190904:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.190922:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.190937:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.191077:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9f20 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 43 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.191102:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 42 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.191122:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130215.191125:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130215.191130:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:0.0:1789130215.193310:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+42:36249:x1876037604967808:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2526us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130215.193327:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 349 00000100:00100000:1.0:1789130215.216545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.217469:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968064 00000100:00100000:2.0:1789130215.217488:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968064 00000100:00100000:2.0:1789130215.217578:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 350 00000100:00100000:2.0:1789130215.217592:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:36249:x1876037604968064:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130215.217769:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.217793:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.217809:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130215.224549:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].12, 88 off9152 00000004:00080000:2.0:1789130215.224579:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1378321975500ns, next at 1379321969182ns, rc = 0 00000004:00010000:2.0:1789130215.224749:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000626e5e35 reply state 0000000073b7f8c9 transno 30064771381 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130215.224763:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130215.224942:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:36249:x1876037604968064:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 7347us (8407us total) trans 30064771381 rc 0/0 00000100:00100000:2.0:1789130215.224954:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 350 00000100:00100000:2.0:1789130215.230768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130215.231026:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231041:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231050:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231058:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130215.231072:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231080:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231102:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130215.231106:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130215.231121:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.231128:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ce9f2e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130215.234758:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968192 00000100:00100000:3.0:1789130215.234783:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968192 00000100:00100000:3.0:1789130215.234895:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 351 00000100:00100000:3.0:1789130215.234908:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:36249:x1876037604968192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130215.234943:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130215.234974:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf6c expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.235057:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 44 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.235076:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 44 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.235102:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:3.0:1789130215.235106:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130215.235123:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87800, rc 0) 00000100:00100000:3.0:1789130215.235218:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:36249:x1876037604968192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 310us (4461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130215.235226:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 351 00000100:00100000:3.0:1789130215.242249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.242718:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968320 00000100:00100000:1.0:1789130215.242734:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968320 00000100:00100000:1.0:1789130215.242834:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:1.0:1789130215.242849:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037604968320:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789130215.242939:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130215.243785:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:2369:x1876037604968320:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 561us (1172us total) trans 30064771200 rc 0/0 00000100:00100000:1.0:1789130215.243803:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:1.0:1789130215.247315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.247736:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968576 00000100:00100000:0.0:1789130215.247750:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968576 00000100:00100000:0.0:1789130215.247825:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:0.0:1789130215.247838:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:36249:x1876037604968576:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.248384:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:36249:x1876037604968576:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 546us (1082us total) trans 30064771382 rc 0/0 00000100:00100000:0.0:1789130215.248395:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130215.269860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.271598:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968832 00000100:00100000:0.0:1789130215.271643:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968832 00000100:00100000:2.0:1789130215.271866:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 352 00000100:00100000:2.0:1789130215.271878:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:36249:x1876037604968832:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.272045:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:36249:x1876037604968832:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 167us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130215.272080:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 352 00000100:00100000:2.0:1789130215.275272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.275400:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604968960 00000100:00100000:0.0:1789130215.275413:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604968960 00000100:00100000:0.0:1789130215.275493:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 353 00000100:00100000:0.0:1789130215.275505:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:36249:x1876037604968960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130215.275536:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130215.275564:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9f3c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf73 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275687:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275705:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275720:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130215.275765:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130215.275789:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275826:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce9f3c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf73 expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275848:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf73 expref: 46 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.275858:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130215.275862:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789130215.275866:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ac00, rc 0) 00000100:00100000:0.0:1789130215.275939:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:36249:x1876037604968960:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 435us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130215.275947:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 353 00000100:00100000:1.0:1789130215.285303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.285406:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969088 00000100:00100000:0.0:1789130215.285420:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969088 00000100:00100000:0.0:1789130215.285507:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789130215.285519:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604969088:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130215.285543:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130215.285572:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf7a expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130215.285646:0:38727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f5e6, blocks: 0x1 00010000:00010000:0.0:1789130215.285675:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=1378s v=(0 0) 00010000:00010000:0.0:1789130215.285680:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130215.285693:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 42 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.285716:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 42 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130215.285733:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:0.0:1789130215.285819:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037604969088:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 300us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130215.285830:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:2.0:1789130215.296818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.298689:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969344 00000100:00100000:3.0:1789130215.298710:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969344 00000100:00100000:3.0:1789130215.298846:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 354 00000100:00100000:3.0:1789130215.298858:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:36249:x1876037604969344:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130215.299184:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:36249:x1876037604969344:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 326us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130215.299193:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 354 00000100:00100000:2.0:1789130215.308554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.310888:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969472 00000100:00100000:1.0:1789130215.310908:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969472 00000100:00100000:1.0:1789130215.311022:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:1.0:1789130215.311034:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:36249:x1876037604969472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130215.311074:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130215.311106:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf81 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130215.311162:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 43 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130215.311173:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130215.311179:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130215.311185:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 43 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130215.311233:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 43 pid: 38727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130215.311252:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 43 pid: 38727 timeout: 1478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130215.311307:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626829824:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130215.312648:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130215.327797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.327904:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969600 00000100:00100000:3.0:1789130215.327916:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969600 00010000:00010000:3.0:1789130215.327976:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 44 pid: 38727 timeout: 1478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130215.328022:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130215.328035:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037604969600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130215.328073:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130215.328117:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 44 pid: 38727 timeout: 1478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.328135:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 44 pid: 38727 timeout: 1478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.328175:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130215.328181:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130215.328191:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 44 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.328204:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 44 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130215.328298:0:36574:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 44 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130215.328317:0:36574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626829952:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130215.328741:0:36574:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba59c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130215.328947:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e707cda4/0x5c74554e47ce9f4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf7a expref: 44 pid: 38727 timeout: 1478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130215.328969:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626829824:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130215.329004:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 43 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130215.329017:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:2.0:1789130215.329078:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:36249:x1876037604969472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 18045us (20540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130215.329088:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789130215.330865:0:36574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:36574:1876037626829952:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130215.330899:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130215.331030:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037604969600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 2995us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130215.331042:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:1.0:1789130215.370920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.371028:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969728 00000100:00100000:3.0:1789130215.371043:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969728 00002000:00100000:3.0:1789130215.371135:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff90b4876dd2c0 x1876037604969728/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.371148:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dd2c0 with x1876037604969728 ext(0->1048575) 00002000:00010000:3.0:1789130215.371155:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dd2c0 00000100:00100000:3.0:1789130215.371193:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:3.0:1789130215.371204:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+42:2367:x1876037604969728:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.394435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.395117:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969856 00000100:00100000:3.0:1789130215.395135:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969856 00002000:00100000:3.0:1789130215.395205:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff90b384a04000 x1876037604969856/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.395219:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04000 with x1876037604969856 ext(1048576->2097151) 00002000:00010000:3.0:1789130215.395264:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a04000 00000100:00100000:3.0:1789130215.395307:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789130215.395319:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604969856:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.412151:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:2367:x1876037604969728:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 40928us (41228us total) trans 30064771201 rc 0/0 00000100:00100000:0.0:1789130215.412172:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00002000:00100000:0.0:1789130215.412189:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff90b4876dd2c0 x1876037604969728/t30064771201(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130215.412203:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dd2c0 with x1876037604969728 ext(0->1048575) 00002000:00010000:0.0:1789130215.412212:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dd2c0 00000100:00100000:0.0:1789130215.431265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.432621:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604969984 00000100:00100000:3.0:1789130215.432640:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604969984 00002000:00100000:3.0:1789130215.432698:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff90b384a06940 x1876037604969984/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.432709:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a06940 with x1876037604969984 ext(2097152->3145727) 00002000:00010000:3.0:1789130215.432715:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a06940 00000100:00100000:3.0:1789130215.432755:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:3.0:1789130215.432765:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:2369:x1876037604969984:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130215.434011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.434162:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970112 00000100:00100000:1.0:1789130215.434169:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970112 00002000:00100000:1.0:1789130215.434205:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff90b48e6e12c0 x1876037604970112/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130215.434216:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e12c0 with x1876037604970112 ext(3145728->4194303) 00002000:00010000:1.0:1789130215.434221:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e12c0 00000100:00100000:1.0:1789130215.434251:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:1.0:1789130215.434259:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:2368:x1876037604970112:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130215.445422:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+50:2370:x1876037604969856:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 50089us (50993us total) trans 30064771202 rc 0/0 00000100:00100000:3.0:1789130215.445441:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00002000:00100000:3.0:1789130215.445456:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff90b384a04000 x1876037604969856/t30064771202(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.445468:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a04000 with x1876037604969856 ext(1048576->2097151) 00002000:00010000:3.0:1789130215.445476:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a04000 00000100:00100000:2.0:1789130215.452985:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:2369:x1876037604969984:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20212us (21726us total) trans 30064771203 rc 0/0 00000100:00100000:2.0:1789130215.453000:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00002000:00100000:2.0:1789130215.453012:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff90b384a06940 x1876037604969984/t30064771203(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.453023:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a06940 with x1876037604969984 ext(2097152->3145727) 00002000:00010000:2.0:1789130215.453029:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a06940 00000100:00100000:2.0:1789130215.455093:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:2368:x1876037604970112:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20826us (21080us total) trans 30064771204 rc 0/0 00000100:00100000:2.0:1789130215.455129:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00002000:00100000:2.0:1789130215.455141:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff90b48e6e12c0 x1876037604970112/t30064771204(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.455151:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e12c0 with x1876037604970112 ext(3145728->4194303) 00002000:00010000:2.0:1789130215.455676:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e12c0 00000100:00100000:0.0:1789130215.506722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.506856:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970240 00000100:00100000:1.0:1789130215.506874:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970240 00002000:00100000:1.0:1789130215.506961:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff90b384a043c0 x1876037604970240/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130215.506975:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a043c0 with x1876037604970240 ext(4194304->5242879) 00002000:00010000:1.0:1789130215.506982:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a043c0 00000100:00100000:1.0:1789130215.507029:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:1.0:1789130215.507039:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:2369:x1876037604970240:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130215.518196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.518878:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970368 00000100:00100000:2.0:1789130215.518892:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970368 00002000:00100000:2.0:1789130215.518970:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff90b48e6e0f00 x1876037604970368/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.518986:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e0f00 with x1876037604970368 ext(5242880->6291455) 00002000:00010000:2.0:1789130215.518996:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e0f00 00000100:00100000:2.0:1789130215.519045:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:2.0:1789130215.519064:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+52:2370:x1876037604970368:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.548404:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:2369:x1876037604970240:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 41345us (41676us total) trans 30064771205 rc 0/0 00000100:00100000:2.0:1789130215.548432:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00002000:00100000:2.0:1789130215.548452:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff90b384a043c0 x1876037604970240/t30064771205(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.548465:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a043c0 with x1876037604970240 ext(4194304->5242879) 00002000:00010000:2.0:1789130215.548474:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a043c0 00000100:00100000:3.0:1789130215.559774:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+54:2370:x1876037604970368:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 40706us (41582us total) trans 30064771206 rc 0/0 00000100:00100000:3.0:1789130215.559790:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00002000:00100000:3.0:1789130215.560327:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff90b48e6e0f00 x1876037604970368/t30064771206(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.560338:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48e6e0f00 with x1876037604970368 ext(5242880->6291455) 00002000:00010000:3.0:1789130215.560346:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b48e6e0f00 00000100:00100000:0.0:1789130215.564328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.564927:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970496 00000100:00100000:2.0:1789130215.564938:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970496 00002000:00100000:2.0:1789130215.564996:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff90b387353840 x1876037604970496/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.565022:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387353840 with x1876037604970496 ext(6291456->7340031) 00002000:00010000:2.0:1789130215.565029:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387353840 00000100:00100000:2.0:1789130215.565067:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789130215.565079:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2370:x1876037604970496:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.582092:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+56:2370:x1876037604970496:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 17003us (18296us total) trans 30064771207 rc 0/0 00000100:00100000:2.0:1789130215.582120:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00002000:00100000:2.0:1789130215.582136:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff90b387353840 x1876037604970496/t30064771207(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.582147:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387353840 with x1876037604970496 ext(6291456->7340031) 00002000:00010000:2.0:1789130215.582154:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387353840 00000100:00100000:0.0:1789130215.594423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.594494:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970624 00000100:00100000:2.0:1789130215.594504:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970624 00002000:00100000:2.0:1789130215.594575:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff90b3873521c0 x1876037604970624/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.594586:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873521c0 with x1876037604970624 ext(7340032->8388607) 00002000:00010000:2.0:1789130215.594593:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3873521c0 00000100:00100000:2.0:1789130215.594659:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:2.0:1789130215.594669:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:2367:x1876037604970624:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.615207:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:2367:x1876037604970624:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 20529us (20794us total) trans 30064771208 rc 0/0 00000100:00100000:0.0:1789130215.615222:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00002000:00100000:0.0:1789130215.615236:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff90b3873521c0 x1876037604970624/t30064771208(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130215.615247:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3873521c0 with x1876037604970624 ext(7340032->8388607) 00002000:00010000:0.0:1789130215.615254:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3873521c0 00000100:00100000:2.0:1789130215.637501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.640789:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970752 00000100:00100000:1.0:1789130215.640806:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970752 00002000:00100000:1.0:1789130215.640884:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff90b3839e0000 x1876037604970752/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130215.640896:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e0000 with x1876037604970752 ext(8388608->9437183) 00002000:00010000:1.0:1789130215.640902:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e0000 00000100:00100000:1.0:1789130215.640942:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:1.0:1789130215.640962:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+58:2370:x1876037604970752:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.666303:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+60:2370:x1876037604970752:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 25330us (28817us total) trans 30064771209 rc 0/0 00000100:00100000:0.0:1789130215.666317:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00002000:00100000:0.0:1789130215.666331:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff90b3839e0000 x1876037604970752/t30064771209(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130215.666342:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e0000 with x1876037604970752 ext(8388608->9437183) 00002000:00010000:0.0:1789130215.666349:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e0000 00000100:00100000:0.0:1789130215.679343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130215.679992:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604970880 00000100:00100000:1.0:1789130215.680005:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604970880 00002000:00100000:1.0:1789130215.680070:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff90b387352940 x1876037604970880/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130215.680083:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352940 with x1876037604970880 ext(9437184->10485759) 00002000:00010000:1.0:1789130215.680090:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352940 00000100:00100000:1.0:1789130215.680142:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:1.0:1789130215.680153:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:2370:x1876037604970880:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.695446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.696580:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971008 00000100:00100000:3.0:1789130215.696597:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971008 00002000:00100000:3.0:1789130215.696723:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff90b387351e00 x1876037604971008/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.696748:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387351e00 with x1876037604971008 ext(10485760->11534335) 00002000:00010000:3.0:1789130215.696756:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387351e00 00000100:00100000:3.0:1789130215.696854:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:3.0:1789130215.696868:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387351e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+62:2367:x1876037604971008:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130215.699579:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+64:2370:x1876037604970880:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 19415us (20235us total) trans 30064771210 rc 0/0 00000100:00100000:0.0:1789130215.699595:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00002000:00100000:0.0:1789130215.699634:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff90b387352940 x1876037604970880/t30064771210(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130215.699648:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352940 with x1876037604970880 ext(9437184->10485759) 00002000:00010000:0.0:1789130215.699655:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352940 00000100:00100000:3.0:1789130215.727529:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387351e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:2367:x1876037604971008:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 30639us (32075us total) trans 30064771211 rc 0/0 00000100:00100000:3.0:1789130215.728795:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00002000:00100000:3.0:1789130215.728825:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff90b387351e00 x1876037604971008/t30064771211(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.728837:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387351e00 with x1876037604971008 ext(10485760->11534335) 00002000:00010000:3.0:1789130215.728844:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387351e00 00000100:00100000:2.0:1789130215.736847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.736985:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971136 00000100:00100000:3.0:1789130215.737002:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971136 00002000:00100000:3.0:1789130215.737082:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff90b3839e3840 x1876037604971136/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.737097:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e3840 with x1876037604971136 ext(11534336->12582911) 00002000:00010000:3.0:1789130215.737134:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e3840 00000100:00100000:3.0:1789130215.737180:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:3.0:1789130215.737194:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+64:2369:x1876037604971136:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.780842:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+66:2369:x1876037604971136:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 43637us (43992us total) trans 30064771212 rc 0/0 00000100:00100000:2.0:1789130215.780874:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00002000:00100000:2.0:1789130215.780902:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff90b3839e3840 x1876037604971136/t30064771212(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.780913:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e3840 with x1876037604971136 ext(11534336->12582911) 00002000:00010000:2.0:1789130215.780921:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e3840 00000100:00100000:0.0:1789130215.802116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.802477:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971264 00000100:00100000:2.0:1789130215.802490:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971264 00002000:00100000:2.0:1789130215.802569:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff90b387350f00 x1876037604971264/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.802583:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350f00 with x1876037604971264 ext(12582912->13631487) 00002000:00010000:2.0:1789130215.802591:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387350f00 00000100:00100000:2.0:1789130215.802672:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:2.0:1789130215.802683:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+66:2370:x1876037604971264:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.827972:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+68:2370:x1876037604971264:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 25273us (25862us total) trans 30064771213 rc 0/0 00000100:00100000:2.0:1789130215.827991:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00002000:00100000:2.0:1789130215.828010:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff90b387350f00 x1876037604971264/t30064771213(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.828023:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387350f00 with x1876037604971264 ext(12582912->13631487) 00002000:00010000:2.0:1789130215.828032:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387350f00 00000100:00100000:0.0:1789130215.848355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.848481:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971392 00000100:00100000:2.0:1789130215.848495:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971392 00002000:00100000:2.0:1789130215.848566:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff90b387352d00 x1876037604971392/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.848598:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352d00 with x1876037604971392 ext(13631488->14680063) 00002000:00010000:2.0:1789130215.848699:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352d00 00000100:00100000:2.0:1789130215.848790:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:2.0:1789130215.848802:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+68:2367:x1876037604971392:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130215.862870:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+70:2367:x1876037604971392:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 14054us (14516us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1789130215.862889:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00002000:00100000:1.0:1789130215.862908:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff90b387352d00 x1876037604971392/t30064771214(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130215.862924:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352d00 with x1876037604971392 ext(13631488->14680063) 00002000:00010000:1.0:1789130215.862935:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352d00 00000100:00100000:0.0:1789130215.877157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.877665:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971520 00000100:00100000:3.0:1789130215.877681:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971520 00002000:00100000:3.0:1789130215.879962:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff90b387352580 x1876037604971520/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.879983:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352580 with x1876037604971520 ext(14680064->15728639) 00002000:00010000:3.0:1789130215.879993:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352580 00000100:00100000:2.0:1789130215.880204:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1789130215.880235:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+70:2368:x1876037604971520:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1789130215.890219:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130215.898462:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+72:2368:x1876037604971520:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 18230us (21305us total) trans 30064771215 rc 0/0 00000100:00100000:3.0:1789130215.898485:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00002000:00100000:3.0:1789130215.898503:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff90b387352580 x1876037604971520/t30064771215(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.898517:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387352580 with x1876037604971520 ext(14680064->15728639) 00002000:00010000:3.0:1789130215.898525:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387352580 00000100:00100000:1.0:1789130215.903851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130215.903998:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971648 00000100:00100000:0.0:1789130215.904012:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971648 00002000:00100000:0.0:1789130215.904091:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (15728640->16777215) req@ffff90b4876de1c0 x1876037604971648/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130215.904113:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876de1c0 with x1876037604971648 ext(15728640->16777215) 00002000:00010000:0.0:1789130215.904121:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876de1c0 00000100:00100000:0.0:1789130215.904161:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:0.0:1789130215.904175:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+72:2369:x1876037604971648:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130215.957839:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:2369:x1876037604971648:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 53645us (53981us total) trans 30064771216 rc 0/0 00000100:00100000:3.0:1789130215.957862:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00002000:00100000:3.0:1789130215.957885:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (15728640->16777215) req@ffff90b4876de1c0 x1876037604971648/t30064771216(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.957898:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876de1c0 with x1876037604971648 ext(15728640->16777215) 00002000:00010000:3.0:1789130215.957907:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876de1c0 00000100:00100000:1.0:1789130215.958504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130215.960675:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971776 00000100:00100000:3.0:1789130215.960697:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971776 00002000:00100000:3.0:1789130215.960785:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (16777216->17825791) req@ffff90b4876dc780 x1876037604971776/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130215.960800:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dc780 with x1876037604971776 ext(16777216->17825791) 00002000:00010000:3.0:1789130215.960809:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dc780 00000100:00100000:3.0:1789130215.960857:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:3.0:1789130215.960869:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+74:2369:x1876037604971776:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130215.978736:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+76:2369:x1876037604971776:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 17852us (20217us total) trans 30064771217 rc 0/0 00000100:00100000:2.0:1789130215.978755:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00002000:00100000:2.0:1789130215.978771:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (16777216->17825791) req@ffff90b4876dc780 x1876037604971776/t30064771217(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.978782:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dc780 with x1876037604971776 ext(16777216->17825791) 00002000:00010000:2.0:1789130215.978792:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dc780 00000100:00100000:3.0:1789130215.979921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130215.981252:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604971904 00000100:00100000:2.0:1789130215.981269:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604971904 00002000:00100000:2.0:1789130215.981344:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (17825792->18874367) req@ffff90b4876bcb40 x1876037604971904/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/0 e 0 to 0 dl 1789130226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130215.981358:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bcb40 with x1876037604971904 ext(17825792->18874367) 00002000:00010000:2.0:1789130215.981366:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876bcb40 00000100:00100000:2.0:1789130215.981405:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789130215.981417:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+76:2367:x1876037604971904:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130216.000429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.000810:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972032 00000100:00100000:2.0:1789130216.000821:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972032 00002000:00100000:2.0:1789130216.000876:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (18874368->19922943) req@ffff90b489049a40 x1876037604972032/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130216.000886:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049a40 with x1876037604972032 ext(18874368->19922943) 00002000:00010000:2.0:1789130216.000892:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489049a40 00000100:00100000:2.0:1789130216.000917:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:2.0:1789130216.000924:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:2369:x1876037604972032:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130216.033909:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+80:2367:x1876037604971904:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 52478us (53980us total) trans 30064771218 rc 0/0 00000100:00100000:2.0:1789130216.033929:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00002000:00100000:2.0:1789130216.033948:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (17825792->18874367) req@ffff90b4876bcb40 x1876037604971904/t30064771218(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:686/0 lens 488/448 e 0 to 0 dl 1789130226 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130216.033960:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bcb40 with x1876037604971904 ext(17825792->18874367) 00002000:00010000:2.0:1789130216.033968:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876bcb40 00000100:00100000:2.0:1789130216.042742:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+80:2369:x1876037604972032:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 41789us (42297us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1789130216.042762:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00002000:00100000:2.0:1789130216.042779:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (18874368->19922943) req@ffff90b489049a40 x1876037604972032/t30064771219(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130216.042792:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489049a40 with x1876037604972032 ext(18874368->19922943) 00002000:00010000:2.0:1789130216.042801:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489049a40 00000100:00100000:1.0:1789130216.044346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.045967:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972160 00000100:00100000:2.0:1789130216.046011:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972160 00002000:00100000:2.0:1789130216.046146:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (19922944->20971519) req@ffff90b4876de940 x1876037604972160/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130216.046159:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876de940 with x1876037604972160 ext(19922944->20971519) 00002000:00010000:2.0:1789130216.046167:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876de940 00000100:00100000:2.0:1789130216.046269:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:2.0:1789130216.046282:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+80:2369:x1876037604972160:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130216.056688:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+82:2369:x1876037604972160:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 10390us (12337us total) trans 30064771220 rc 0/0 00000100:00100000:2.0:1789130216.056706:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00002000:00100000:2.0:1789130216.056723:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (19922944->20971519) req@ffff90b4876de940 x1876037604972160/t30064771220(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130216.058369:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876de940 with x1876037604972160 ext(19922944->20971519) 00002000:00010000:2.0:1789130216.058380:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876de940 00000100:00100000:2.0:1789130216.059327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.059418:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972288 00000100:00100000:3.0:1789130216.059430:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972288 00000100:00100000:3.0:1789130216.059510:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 355 00000100:00100000:3.0:1789130216.059522:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:36249:x1876037604972288:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1789130216.062509:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130216.092902:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:36249:x1876037604972288:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 33367us (33565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130216.092919:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 355 00000001:00080000:2.0:1789130216.092970:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771382 is committed 00000004:00080000:2.0:1789130216.093004:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:2.0:1789130216.093066:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803909 batchid updated 00000020:00080000:2.0:1789130216.093376:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000020:00080000:2.0:1789130216.093389:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000100:00100000:2.0:1789130216.093406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626830080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789130216.093496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130216.093561:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130216.093568:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626830208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130216.093590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130216.093664:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626830080 00000100:00100000:2.0:1789130216.093673:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626830080 00000100:00100000:2.0:1789130216.093736:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626830208 00000100:00100000:2.0:1789130216.093739:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626830208 00000100:00100000:2.0:1789130216.093764:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789130216.093774:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1876037626830080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789130216.093810:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:200 count 1 00002000:00010000:2.0:1789130216.093857:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 15728640, mtime: 0x6aa3f5e4, atime: 0x0, ctime: 0x6aa3f5e5, blocks: 0x1 00010000:00010000:2.0:1789130216.093867:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.093888:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=1379s v=(0 0) 00010000:00010000:2.0:1789130216.093893:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130216.093902:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.093923:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.093935:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.093943:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.093969:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130216.094867:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3306:x1876037626830080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1091us (1367us total) trans 30064771221 rc 0/0 00000100:00100000:2.0:1789130216.094877:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789130216.094907:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789130216.094916:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1876037626830208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130216.095022:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1789130216.095025:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1789130215 00002000:00010000:2.0:1789130216.095028:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130216.095029:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1789130214 -> 1789130215 00002000:00010000:2.0:1789130216.095031:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130216.095057:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3306:x1876037626830208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (1466us total) trans 30064771222 rc 0/0 00000100:00100000:2.0:1789130216.095064:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789130216.095104:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130216.095129:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130216.095137:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.095147:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130216.095152:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.095163:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.095199:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.095207:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47ce9f58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.095229:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130216.095231:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130216.095233:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130216.095275:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3839e1e00/2, rc 0, transno 30064771222 00000100:00100000:2.0:1789130216.095282:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626830208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1789130216.095293:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3839e3c00/2, rc 0, transno 30064771221 00000100:00100000:2.0:1789130216.095297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626830080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789130216.097754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.097895:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972416 00000100:00100000:3.0:1789130216.097911:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972416 00000100:00100000:3.0:1789130216.097988:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789130216.098000:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+82:2370:x1876037604972416:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1789130216.142473:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130216.142485:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130216.142894:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:1.0:1789130216.142906:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000001:00080000:2.0:1789130216.212264:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771210 is committed 00000001:00080000:2.0:1789130216.212304:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771199 is committed 00000001:00080000:2.0:1789130216.212341:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771214 is committed 00000001:00080000:2.0:1789130216.212367:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771222 is committed 00000001:00080000:2.0:1789130216.212376:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771220 is committed 00000100:00100000:1.0:1789130216.213624:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037604972416:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 115588us (115847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130216.213642:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789130216.236685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130216.236848:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972672 00000100:00100000:0.0:1789130216.236863:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972672 00000100:00100000:0.0:1789130216.236935:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 356 00000100:00100000:0.0:1789130216.236947:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:36249:x1876037604972672:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130216.237019:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130216.237069:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce9f43 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf73 expref: 29 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.237117:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130216.237124:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130216.237166:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.237184:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.237195:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130216.237444:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000659cd649 reply state 00000000e0390c8e transno 30064771383 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130216.237455:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130216.237590:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:36249:x1876037604972672:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 644us (919us total) trans 30064771383 rc 0/0 00000100:00100000:0.0:1789130216.237599:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 356 00010000:00010000:0.0:1789130216.244433:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244457:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244466:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244473:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130216.244478:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244487:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244519:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130216.244523:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130216.244529:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.244536:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9f5f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.247039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.247546:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604972800 00000100:00100000:3.0:1789130216.247562:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604972800 00000100:00100000:3.0:1789130216.247680:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1789130216.247694:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037604972800:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789130216.248040:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:3.0:1789130216.248290:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 1789130215 -> 1789130213 00002000:00010000:3.0:1789130216.248297:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 1789130213 00002000:00010000:3.0:1789130216.248319:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1789130215 -> 1789130213 00002000:00010000:3.0:1789130216.248322:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:2.0:1789130216.250260:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604972800:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 2551us (3217us total) trans 30064771223 rc 0/0 00000100:00100000:2.0:1789130216.250281:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:1.0:1789130216.255365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.255886:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973056 00000100:00100000:2.0:1789130216.255900:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973056 00000100:00100000:2.0:1789130216.256004:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 357 00000100:00100000:2.0:1789130216.256015:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:36249:x1876037604973056:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130216.256237:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.256259:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.256270:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.256316:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 29 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.256333:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 29 pid: 36589 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.256351:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626830336:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130216.256522:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130216.262238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.262869:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626830336:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130216.262921:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.263278:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973184 00000100:00100000:3.0:1789130216.263287:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973184 00010000:00010000:3.0:1789130216.263348:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 30 pid: 36589 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.263399:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789130216.263413:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604973184:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130216.263440:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130216.263453:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 30 pid: 36589 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263472:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 30 pid: 36589 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263508:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce9f27 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf65 expref: 30 pid: 36589 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263527:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:3.0:1789130216.263533:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263543:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263553:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.263681:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130216.263832:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263844:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263894:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263906:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263914:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263926:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130216.263930:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263939:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263965:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:1.0:1789130216.263968:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789130216.263973:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130216.263983:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f66 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.264110:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604973184:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 700us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.264121:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1789130216.266447:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:36249:x1876037604973056:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 10414us (11076us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789130216.266469:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 357 00000100:00100000:0.0:1789130216.272345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.272534:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973312 00000100:00100000:2.0:1789130216.272548:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973312 00000100:00100000:2.0:1789130216.272645:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:2.0:1789130216.272659:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037604973312:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130216.272747:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.272775:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 11 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.272785:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130216.272790:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130216.272794:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.272830:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 11 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.272843:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 11 pid: 37273 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.272857:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626830464:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130216.272951:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130216.281679:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626830464:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130216.281727:0:37276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130216.305572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.305946:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973440 00000100:00100000:3.0:1789130216.305960:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973440 00010000:00010000:3.0:1789130216.306007:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 12 pid: 37273 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.306054:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789130216.306062:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604973440:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130216.306083:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130216.306121:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 12 pid: 37273 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.306138:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 12 pid: 37273 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.306165:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002363ee97/0x5c74554e47ce9f51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf81 expref: 12 pid: 37273 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.306184:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130216.306188:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130216.306194:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.306220:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.306265:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130216.306344:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604973440:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 280us (786us total) trans 0 rc 0/0 00010000:00010000:2.0:1789130216.306346:0:37276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.306353:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00010000:00010000:2.0:1789130216.306367:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306397:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306405:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306414:0:37276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306422:0:37276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130216.306426:0:37276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306436:0:37276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306449:0:37276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.306459:0:37276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47ce9f6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.306534:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037604973312:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 33878us (34308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130216.306543:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:1.0:1789130216.309744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.309843:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973696 00000100:00100000:2.0:1789130216.309857:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973696 00000100:00100000:2.0:1789130216.309938:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 358 00000100:00100000:2.0:1789130216.309951:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+28:36249:x1876037604973696:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130216.310058:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310078:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310104:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310406:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310418:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310427:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310470:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.310512:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 29 pid: 36587 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.310531:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626830592:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130216.310692:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130216.314272:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626830592:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130216.314314:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130216.318146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.318403:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973824 00000100:00100000:3.0:1789130216.318416:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973824 00010000:00010000:3.0:1789130216.318472:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 30 pid: 36587 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.318526:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130216.318539:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604973824:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130216.318558:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130216.318566:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 30 pid: 36587 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318583:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 30 pid: 36587 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318645:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87800/0x5c74554e47ce9f35 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf6c expref: 30 pid: 36587 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318671:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:3.0:1789130216.318694:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318706:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318715:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.318761:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130216.318827:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604973824:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 290us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.318836:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:2.0:1789130216.319683:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.319697:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130216.320024:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771384 00000001:00080000:2.0:1789130216.320306:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771385 00000001:00080000:2.0:1789130216.320354:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771386 00000100:00100000:2.0:1789130216.320458:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626830720:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130216.320533:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130216.320579:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130216.321007:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626830720 00000100:00100000:3.0:1789130216.321016:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626830720 00000100:00100000:3.0:1789130216.321076:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130216.321086:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626830720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789130216.321200:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626830720:12345-0@lo:1000:mdt00_003.0 Request processed in 116us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.321208:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130216.322265:0:38723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771222 gen 2 00000004:00080000:2.0:1789130216.322276:0:38723:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771198 committed transno 30064771222 00000004:00080000:2.0:1789130216.322309:0:38723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384a052c0, transno 30064771199 00000004:00080000:2.0:1789130216.322320:0:38723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3839e3c00, transno 30064771221 00000004:00080000:2.0:1789130216.322323:0:38723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3839e1e00, transno 30064771222 00000100:00100000:2.0:1789130216.322332:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626830720:0@lo:1000:mdt00_003.0 00000004:00080000:0.0:1789130216.323300:0:36609:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:2.0:1789130216.324297:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771387 00000100:00100000:2.0:1789130216.324413:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626830848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130216.324507:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130216.324553:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130216.325034:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626830848 00000100:00100000:3.0:1789130216.325056:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626830848 00000100:00100000:3.0:1789130216.325125:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789130216.325137:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38723:x1876037626830848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789130216.325443:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38723:x1876037626830848:12345-0@lo:1000:mdt00_003.0 Request processed in 308us (936us total) trans 30064771224 rc 0/0 00000100:00100000:3.0:1789130216.325453:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130216.325975:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626830848:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789130216.326033:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326053:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326061:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326069:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130216.326074:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326083:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326112:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130216.326116:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130216.326123:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326129:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ce9f7b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326167:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326193:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326199:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326205:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130216.326208:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326214:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326224:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130216.326226:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130216.326234:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326249:0:38723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326259:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.326301:0:38723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 32 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.326317:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383221a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626830976:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130216.326476:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130216.335531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.335765:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383221a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626830976:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130216.335811:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335825:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce9ec5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335874:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335892:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335905:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335916:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335922:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335929:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335935:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130216.335939:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335946:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335981:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130216.335985:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130216.335990:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.335996:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ce9f82 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336007:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336013:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336018:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336023:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130216.336026:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336031:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336038:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:2.0:1789130216.336053:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130216.336056:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.336062:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47ce9f74 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130216.336435:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+32:36249:x1876037604973696:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 26484us (26717us total) trans 30064771388 rc 0/0 00000100:00100000:2.0:1789130216.336448:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 358 00000020:00080000:2.0:1789130216.336455:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789130216.337128:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130216.337135:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130216.337863:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:1.0:1789130216.337876:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130216.339393:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604973952 00000100:00100000:3.0:1789130216.339412:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604973952 00000100:00100000:2.0:1789130216.339687:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789130216.339702:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36247:x1876037604973952:12345-192.168.201.39@tcp:49:dd.500 00000100:00100000:2.0:1789130216.339908:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36247:x1876037604973952:12345-192.168.201.39@tcp:49:dd.500 Request processed in 209us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130216.339917:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789130216.351512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.352876:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974080 00000100:00100000:3.0:1789130216.352893:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974080 00000100:00100000:3.0:1789130216.352988:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130216.353001:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:36247:x1876037604974080:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130216.353025:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130216.353358:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961c8938/0x5c74554e47ce9f89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf88 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130216.353395:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc9:0x0] initial LVB size: 20971520, mtime: 0x6aa3f5e5, atime: 0x6aa3f5e5, ctime: 0x6aa3f5e5, blocks: 0xa007 00010000:00010000:3.0:1789130216.353426:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=1379s v=(0 0) 00010000:00010000:3.0:1789130216.353431:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130216.353444:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961c8938/0x5c74554e47ce9f89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf88 expref: 11 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.353463:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000961c8938/0x5c74554e47ce9f89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf88 expref: 11 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.353479:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87800, rc 0) 00000100:00100000:3.0:1789130216.353566:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:36247:x1876037604974080:12345-192.168.201.39@tcp:101:dd.500 Request processed in 567us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.353575:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789130216.394920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.395022:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974208 00000100:00100000:3.0:1789130216.395034:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974208 00002000:00100000:3.0:1789130216.395116:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (20971520->22020095) req@ffff90b4876df0c0 x1876037604974208/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.395129:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876df0c0 with x1876037604974208 ext(20971520->22020095) 00002000:00010000:3.0:1789130216.395148:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876df0c0 00000100:00100000:3.0:1789130216.395190:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1789130216.395201:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604974208:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130216.421846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.421976:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974336 00000100:00100000:2.0:1789130216.421991:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974336 00002000:00100000:2.0:1789130216.422076:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (22020096->23068671) req@ffff90b384a061c0 x1876037604974336/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.422100:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a061c0 with x1876037604974336 ext(22020096->23068671) 00002000:00010000:2.0:1789130216.422109:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a061c0 00000100:00100000:2.0:1789130216.422157:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:2.0:1789130216.422169:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037604974336:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130216.457512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.459062:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974464 00000100:00100000:3.0:1789130216.459084:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974464 00002000:00100000:3.0:1789130216.459160:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (23068672->24117247) req@ffff90b384a052c0 x1876037604974464/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.459175:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a052c0 with x1876037604974464 ext(23068672->24117247) 00002000:00010000:3.0:1789130216.459182:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a052c0 00000100:00100000:3.0:1789130216.459221:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1789130216.459232:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604974464:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:3.0:1789130216.473022:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604974208:12345-192.168.201.39@tcp:4:dd.500 Request processed in 77808us (78101us total) trans 30064771225 rc 0/0 00000100:00100000:3.0:1789130216.473041:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00002000:00100000:3.0:1789130216.473058:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (20971520->22020095) req@ffff90b4876df0c0 x1876037604974208/t30064771225(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.473072:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876df0c0 with x1876037604974208 ext(20971520->22020095) 00002000:00010000:3.0:1789130216.473081:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876df0c0 00000100:00100000:2.0:1789130216.475649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.476697:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974592 00000100:00100000:3.0:1789130216.476714:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974592 00002000:00100000:3.0:1789130216.476893:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (24117248->25165823) req@ffff90b383221a40 x1876037604974592/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.476907:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383221a40 with x1876037604974592 ext(24117248->25165823) 00002000:00010000:3.0:1789130216.476916:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383221a40 00000100:00100000:3.0:1789130216.476996:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:3.0:1789130216.477007:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037604974592:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:0.0:1789130216.486773:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:2368:x1876037604974336:12345-192.168.201.39@tcp:4:dd.500 Request processed in 64589us (64929us total) trans 30064771226 rc 0/0 00000100:00100000:0.0:1789130216.486791:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00002000:00100000:0.0:1789130216.486808:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (22020096->23068671) req@ffff90b384a061c0 x1876037604974336/t30064771226(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130216.486822:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a061c0 with x1876037604974336 ext(22020096->23068671) 00002000:00010000:0.0:1789130216.486831:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a061c0 00000100:00100000:2.0:1789130216.490998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130216.492935:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974720 00000100:00100000:0.0:1789130216.492954:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974720 00002000:00100000:0.0:1789130216.493047:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (25165824->26214399) req@ffff90b383222d00 x1876037604974720/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130216.493068:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383222d00 with x1876037604974720 ext(25165824->26214399) 00002000:00010000:0.0:1789130216.493075:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383222d00 00000100:00100000:0.0:1789130216.493118:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:0.0:1789130216.493130:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604974720:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:3.0:1789130216.501986:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037604974464:12345-192.168.201.39@tcp:4:dd.500 Request processed in 42738us (44482us total) trans 30064771227 rc 0/0 00000100:00100000:3.0:1789130216.502005:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00002000:00100000:3.0:1789130216.502021:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (23068672->24117247) req@ffff90b384a052c0 x1876037604974464/t30064771227(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.502033:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a052c0 with x1876037604974464 ext(23068672->24117247) 00002000:00010000:3.0:1789130216.502041:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a052c0 00000100:00100000:1.0:1789130216.515128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130216.515876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130216.515919:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975104 00000100:00100000:1.0:1789130216.515932:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975104 00002000:00100000:1.0:1789130216.516000:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (26214400->27262975) req@ffff90b3832b4780 x1876037604975104/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130216.516015:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b4780 with x1876037604975104 ext(26214400->27262975) 00002000:00010000:1.0:1789130216.516035:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b4780 00000100:00100000:1.0:1789130216.516070:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:1.0:1789130216.516083:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+21:2368:x1876037604975104:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130216.519429:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604974976 00000100:00100000:2.0:1789130216.519453:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604974976 00000100:00100000:2.0:1789130216.519551:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130216.519565:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36249:x1876037604974976:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789130216.523980:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130216.524134:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771389 00010000:00010000:2.0:1789130216.524238:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524261:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524275:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524286:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524292:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524299:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130216.524333:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130216.524496:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:36249:x1876037604974976:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 4928us (9380us total) trans 30064771390 rc 0/0 00000100:00100000:2.0:1789130216.524509:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000020:00080000:2.0:1789130216.524518:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130216.525514:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130216.525529:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.525542:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130216.525547:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.525558:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.525578:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789130216.525582:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130216.525588:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.525595:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ce9f90 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130216.525652:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130216.525655:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130216.525657:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130216.529734:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037604974592:12345-192.168.201.39@tcp:4:dd.500 Request processed in 52711us (54082us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1789130216.529757:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00002000:00100000:0.0:1789130216.529775:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (24117248->25165823) req@ffff90b383221a40 x1876037604974592/t30064771228(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130216.529788:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383221a40 with x1876037604974592 ext(24117248->25165823) 00002000:00010000:0.0:1789130216.529796:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383221a40 00000100:00100000:0.0:1789130216.534333:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:2367:x1876037604974720:12345-192.168.201.39@tcp:4:dd.500 Request processed in 41187us (43331us total) trans 30064771229 rc 0/0 00000100:00100000:0.0:1789130216.534353:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00002000:00100000:0.0:1789130216.534370:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (25165824->26214399) req@ffff90b383222d00 x1876037604974720/t30064771229(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789130216.534383:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383222d00 with x1876037604974720 ext(25165824->26214399) 00002000:00010000:0.0:1789130216.534392:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383222d00 00000100:00100000:1.0:1789130216.547999:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037604975104:12345-192.168.201.39@tcp:4:dd.500 Request processed in 31899us (32107us total) trans 30064771230 rc 0/0 00000100:00100000:1.0:1789130216.548019:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00002000:00100000:1.0:1789130216.548049:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (26214400->27262975) req@ffff90b3832b4780 x1876037604975104/t30064771230(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130216.548063:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b4780 with x1876037604975104 ext(26214400->27262975) 00002000:00010000:1.0:1789130216.548072:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b4780 00000100:00100000:3.0:1789130216.555241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.555448:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975232 00000100:00100000:2.0:1789130216.555462:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975232 00002000:00100000:2.0:1789130216.555541:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (27262976->28311551) req@ffff90b489048780 x1876037604975232/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.555555:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489048780 with x1876037604975232 ext(27262976->28311551) 00002000:00010000:2.0:1789130216.555581:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489048780 00000100:00100000:2.0:1789130216.555666:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1789130216.555678:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2367:x1876037604975232:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130216.571831:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+25:2367:x1876037604975232:12345-192.168.201.39@tcp:4:dd.500 Request processed in 16138us (16603us total) trans 30064771231 rc 0/0 00000100:00100000:2.0:1789130216.571850:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00002000:00100000:2.0:1789130216.571867:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xc9:0x0] (27262976->28311551) req@ffff90b489048780 x1876037604975232/t30064771231(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.571880:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b489048780 with x1876037604975232 ext(27262976->28311551) 00002000:00010000:2.0:1789130216.571889:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b489048780 00000100:00100000:0.0:1789130216.587840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130216.587977:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975360 00000100:00100000:1.0:1789130216.587991:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975360 00002000:00100000:1.0:1789130216.588075:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (28311552->29360127) req@ffff90b3839e3c00 x1876037604975360/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130216.588100:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e3c00 with x1876037604975360 ext(28311552->29360127) 00002000:00010000:1.0:1789130216.588109:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e3c00 00000100:00100000:1.0:1789130216.588150:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:1.0:1789130216.588162:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037604975360:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:1.0:1789130216.617657:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604975360:12345-192.168.201.39@tcp:4:dd.500 Request processed in 29469us (29806us total) trans 30064771232 rc 0/0 00000100:00100000:1.0:1789130216.617679:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 230 00002000:00100000:1.0:1789130216.617701:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (28311552->29360127) req@ffff90b3839e3c00 x1876037604975360/t30064771232(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789130216.617746:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e3c00 with x1876037604975360 ext(28311552->29360127) 00002000:00010000:1.0:1789130216.617756:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e3c00 00000100:00100000:0.0:1789130216.623793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.624145:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975488 00000100:00100000:2.0:1789130216.624158:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975488 00002000:00100000:2.0:1789130216.624231:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (29360128->30408703) req@ffff90b3839e1e00 x1876037604975488/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.624244:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e1e00 with x1876037604975488 ext(29360128->30408703) 00002000:00010000:2.0:1789130216.624252:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e1e00 00000100:00100000:2.0:1789130216.624298:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:2.0:1789130216.624311:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604975488:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130216.635244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130216.635368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130216.635506:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975872 00000100:00100000:0.0:1789130216.635520:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975872 00000100:00100000:0.0:1789130216.635635:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130216.635647:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:36247:x1876037604975872:12345-192.168.201.39@tcp:35:dd.500 00000001:00080000:0.0:1789130216.636004:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771391 00000001:00080000:0.0:1789130216.636081:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771392 00000100:00100000:0.0:1789130216.636226:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:36247:x1876037604975872:12345-192.168.201.39@tcp:35:dd.500 Request processed in 580us (860us total) trans 30064771393 rc 0/0 00000100:00100000:0.0:1789130216.636235:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000020:00080000:0.0:1789130216.636240:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789130216.641141:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604975616 00000100:00100000:3.0:1789130216.641162:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604975616 00002000:00100000:3.0:1789130216.641235:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (30408704->31457279) req@ffff90b383221e00 x1876037604975616/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/0 e 0 to 0 dl 1789130227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789130216.641249:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383221e00 with x1876037604975616 ext(30408704->31457279) 00002000:00010000:3.0:1789130216.641257:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383221e00 00000100:00100000:3.0:1789130216.641297:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:3.0:1789130216.641309:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:2368:x1876037604975616:12345-192.168.201.39@tcp:4:dd.500 00000100:00100000:2.0:1789130216.653190:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604975488:12345-192.168.201.39@tcp:4:dd.500 Request processed in 28865us (29396us total) trans 30064771233 rc 0/0 00000100:00100000:2.0:1789130216.653206:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00002000:00100000:2.0:1789130216.653224:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (29360128->30408703) req@ffff90b3839e1e00 x1876037604975488/t30064771233(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.653255:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839e1e00 with x1876037604975488 ext(29360128->30408703) 00002000:00010000:2.0:1789130216.653264:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839e1e00 00000100:00100000:2.0:1789130216.702535:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+31:2368:x1876037604975616:12345-192.168.201.39@tcp:4:dd.500 Request processed in 61211us (67995us total) trans 30064771234 rc 0/0 00000100:00100000:2.0:1789130216.702554:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00002000:00100000:2.0:1789130216.702571:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (30408704->31457279) req@ffff90b383221e00 x1876037604975616/t30064771234(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:687/0 lens 488/448 e 0 to 0 dl 1789130227 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789130216.702584:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383221e00 with x1876037604975616 ext(30408704->31457279) 00002000:00010000:2.0:1789130216.702593:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383221e00 00000100:00100000:3.0:1789130216.712033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626831488:0@lo:400:kworker.0 00000100:00100000:3.0:1789130216.712152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130216.712251:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130216.712258:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626831360:0@lo:400:kworker.0 00000100:00100000:3.0:1789130216.712291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130216.712333:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831488 00000100:00100000:3.0:1789130216.712358:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831488 00000100:00100000:3.0:1789130216.712416:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130216.712426:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626831488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130216.712484:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626831488:12345-0@lo:400:kworker.0 Request processed in 59us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.712492:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130216.712520:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831360 00000100:00100000:3.0:1789130216.712524:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831360 00000100:00100000:3.0:1789130216.712564:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130216.712571:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626831360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130216.712632:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626831360:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.712638:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130216.712676:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771165 gen 2 00000004:00080000:3.0:1789130216.712683:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383f28b40, transno 30064771165 00000100:00100000:3.0:1789130216.712700:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626831360:0@lo:400:kworker.0 00000100:00100000:3.0:1789130216.712712:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626831488:0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626831104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130216.713280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130216.713323:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626831616:0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130216.713373:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789130216.713381:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4890492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626831232:0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130216.713437:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626831744:0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130216.713501:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831616 00000100:00100000:1.0:1789130216.713506:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831616 00000100:00100000:1.0:1789130216.713557:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831744 00000100:00100000:1.0:1789130216.713561:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831744 00000100:00100000:0.0:1789130216.713568:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831232 00000100:00100000:0.0:1789130216.713574:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831232 00000100:00100000:1.0:1789130216.713590:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789130216.713631:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626831616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130216.713638:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789130216.713648:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626831232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713686:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626831616:12345-0@lo:400:kworker.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130216.713695:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789130216.713704:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626831232:12345-0@lo:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130216.713713:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789130216.713729:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789130216.713739:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713777:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626831744:12345-0@lo:400:kworker.0 Request processed in 40us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130216.713796:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789130216.713802:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626831232:0@lo:400:kworker.0 00000100:00100000:0.0:1789130216.713821:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626831744:0@lo:400:kworker.0 00000100:00100000:1.0:1789130216.713865:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626831616:0@lo:400:kworker.0 00000100:00080000:2.0:1789130216.713953:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130216.713960:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130216.714082:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831104 00000100:00100000:3.0:1789130216.714096:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831104 00000100:00100000:3.0:1789130216.714136:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130216.714144:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626831104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130216.714178:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 146472960 pending 0 free 3804233728 avail 3802136576 00000100:00100000:3.0:1789130216.714324:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626831104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.714332:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130216.724925:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626831104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130216.733805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130216.733958:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976000 00000100:00100000:3.0:1789130216.733990:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976000 00000100:00100000:3.0:1789130216.734073:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 359 00000100:00100000:3.0:1789130216.734095:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:36259:x1876037604976000:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130216.734207:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734240:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734256:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734277:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734284:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734290:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734802:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734813:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734822:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130216.734876:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734904:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734911:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734919:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734927:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130216.734932:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734941:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734956:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130216.734959:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130216.734965:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734973:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9f97 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734990:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.734997:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735003:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735014:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130216.735018:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735025:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735033:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff90b488939600) 00010000:00010000:3.0:1789130216.735036:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130216.735039:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735045:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47ce9f9e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735062:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735070:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735076:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735080:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130216.735094:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735101:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735119:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:3.0:1789130216.735122:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130216.735126:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130216.735132:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47ce9fa5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130216.735250:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:36259:x1876037604976000:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1163us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130216.735261:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 359 00010000:00010000:2.0:1789130216.902026:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130217.735075:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38866c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626831872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130217.735194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130217.735319:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626831872 00000100:00100000:3.0:1789130217.735330:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626831872 00000100:00100000:3.0:1789130217.735408:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130217.735419:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626831872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130217.735469:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 275972096 pending 17039360 free 3751804928 avail 3749707776 00000100:00100000:3.0:1789130217.735544:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626831872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130217.735552:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789130217.735596:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38866c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626831872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130217.937991:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130218.010835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130218.010887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130218.010916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130218.010940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130218.010969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130218.011011:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976384 00000100:00100000:2.0:1789130218.011023:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976384 00000100:00100000:2.0:1789130218.011116:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976512 00000100:00100000:2.0:1789130218.011126:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976512 00000100:00100000:2.0:1789130218.011156:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789130218.011168:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604976384:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130218.011269:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604976384:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130218.011276:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789130218.011295:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130218.011302:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604976512:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130218.011330:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+7:2367:x1876037604976512:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130218.011336:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130218.011357:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976640 00000100:00100000:2.0:1789130218.011361:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976640 00000100:00100000:2.0:1789130218.011395:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976256 00000100:00100000:2.0:1789130218.011398:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976256 00000100:00100000:2.0:1789130218.011419:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130218.011426:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604976640:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130218.011454:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604976640:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130218.011460:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130218.011471:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:2.0:1789130218.011477:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2367:x1876037604976256:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130218.011520:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383221680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2367:x1876037604976256:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130218.011525:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00080000:2.0:1789130218.011555:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130218.011561:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130218.011563:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130218.011670:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976128 00000100:00100000:3.0:1789130218.011675:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976128 00000100:00100000:3.0:1789130218.011714:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130218.011721:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604976128:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130218.011747:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604976128:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130218.011753:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00010000:00010000:2.0:1789130218.959041:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130219.986894:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130220.997806:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130221.417340:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771393 is committed 00000020:00080000:0.0:1789130221.417380:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b49c061240 refcount 2 committed 0 result 0 batchid 25769803910 00000020:00080000:0.0:1789130221.417386:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b485119600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b49c061180 00000020:00080000:0.0:1789130221.417389:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b485119200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b384b09400 00000020:00080000:2.0:1789130221.417715:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803910 committed batchid 25769803909 00000020:00080000:2.0:1789130221.418032:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000001:00080000:1.0:1789130221.467385:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771229 is committed 00000001:00080000:0.0:1789130221.467513:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771232 is committed 00000001:00080000:0.0:1789130221.467527:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771234 is committed 00000001:00080000:0.0:1789130221.467551:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771224 is committed 00000100:00100000:2.0:1789130221.830200:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626832384:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830368:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789130221.830376:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626832000:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830433:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626832512:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830483:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832256:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830544:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789130221.830550:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832128:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4890492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626832640:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830640:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130221.830667:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832384 00000100:00100000:2.0:1789130221.830674:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832384 00000100:00100000:2.0:1789130221.830715:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832512 00000100:00100000:2.0:1789130221.830718:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832512 00000100:00100000:2.0:1789130221.830742:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832640 00000100:00100000:2.0:1789130221.830744:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832640 00000100:00100000:2.0:1789130221.830761:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130221.830785:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626832384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830848:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626832384:12345-0@lo:400:kworker.0 Request processed in 59us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.830856:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130221.830873:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789130221.830879:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626832512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.830904:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626832512:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.830910:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789130221.830921:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789130221.830927:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626832640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831106:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626832640:12345-0@lo:400:kworker.0 Request processed in 179us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.831113:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789130221.831134:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832000 00000100:00100000:2.0:1789130221.831137:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832000 00000100:00100000:2.0:1789130221.831162:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789130221.831169:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831199:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626832000:12345-0@lo:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.831205:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789130221.831235:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832256 00000100:00100000:2.0:1789130221.831238:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832256 00000100:00100000:2.0:1789130221.831265:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832128 00000100:00100000:2.0:1789130221.831268:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832128 00000100:00100000:2.0:1789130221.831286:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130221.831292:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831329:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832256:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.831335:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130221.831347:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130221.831353:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831378:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832128:12345-0@lo:400:kworker.0 Request processed in 27us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130221.831384:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789130221.831410:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130221.831414:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130221.831417:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130221.831452:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771224 gen 2 00000004:00080000:2.0:1789130221.831459:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771224 committed transno 30064771224 00000100:00100000:2.0:1789130221.831481:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832128:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831494:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4890492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626832640:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831503:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832256:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831532:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626832000:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831542:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626832512:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.831551:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626832384:0@lo:400:kworker.0 00000100:00100000:2.0:1789130221.832111:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130221.832147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130221.832316:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832768 00000100:00100000:3.0:1789130221.832322:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832768 00000100:00100000:3.0:1789130221.832359:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130221.832367:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130221.832399:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 146472960 pending 0 free 3804233728 avail 3802136576 00000100:00100000:3.0:1789130221.832447:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626832768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130221.832454:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789130221.832746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626832768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130221.860850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130221.861040:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604976768 00000100:00100000:0.0:1789130221.861051:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604976768 00000100:00100000:0.0:1789130221.861186:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 360 00000100:00100000:0.0:1789130221.861197:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:36190:x1876037604976768:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130221.861316:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:36190:x1876037604976768:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130221.861325:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 360 00000100:00080000:2.0:1789130221.866838:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130221.873049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130221.873152:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977024 00000100:00100000:0.0:1789130221.873164:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977024 00000100:00100000:0.0:1789130221.873229:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:0.0:1789130221.873239:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:36190:x1876037604977024:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130221.873856:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:36190:x1876037604977024:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 615us (814us total) trans 30064771394 rc 0/0 00000100:00100000:0.0:1789130221.873866:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:3.0:1789130222.022040:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130222.047037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130222.047224:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977152 00000100:00100000:2.0:1789130222.047236:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977152 00000100:00100000:2.0:1789130222.047427:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 361 00000100:00100000:2.0:1789130222.047438:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:36700:x1876037604977152:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1789130222.047463:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130222.047486:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf8f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.047573:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.047588:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.047598:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130222.047945:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130222.047950:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130222.048037:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.048065:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ce9fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.048082:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 6 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130222.048089:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:2.0:1789130222.048100:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130222.048104:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130222.048181:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:36700:x1876037604977152:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 746us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130222.048187:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 361 00000100:00080000:0.0:1789130222.050402:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130222.853993:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38866f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626832896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130222.854106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130222.854475:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626832896 00000100:00100000:0.0:1789130222.854486:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626832896 00000100:00100000:0.0:1789130222.854551:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789130222.854563:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626832896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130222.854639:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 258932736 pending 0 free 3741319168 avail 3739222016 00000100:00100000:0.0:1789130222.854716:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626832896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130222.854725:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789130222.854873:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38866f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626832896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130223.046056:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130223.130926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130223.130987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130223.131034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130223.131064:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977280 00000100:00100000:3.0:1789130223.131073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130223.131083:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977280 00000100:00100000:3.0:1789130223.131102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130223.131143:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977536 00000100:00100000:3.0:1789130223.131152:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977536 00000100:00100000:2.0:1789130223.131177:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130223.131193:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604977280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130223.131299:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037604977280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130223.131307:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130223.131357:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977792 00000100:00100000:2.0:1789130223.131362:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977792 00000100:00100000:2.0:1789130223.131401:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977408 00000100:00100000:2.0:1789130223.131404:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977408 00000100:00100000:2.0:1789130223.131431:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:2.0:1789130223.131437:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604977792:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130223.131469:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037604977792:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130223.131477:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:2.0:1789130223.131495:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789130223.131521:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604977408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789130223.131560:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130223.131568:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604977408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (499us total) trans 0 rc 0/0 00000100:00080000:1.0:1789130223.131569:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130223.131583:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789130223.132235:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604977664 00000100:00100000:0.0:1789130223.132244:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604977664 00000100:00100000:0.0:1789130223.132319:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1789130223.132330:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604977664:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130223.132428:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+7:2368:x1876037604977664:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 99us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130223.132437:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789130223.132953:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130223.132964:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604977536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130223.133027:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037604977536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 66us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130223.133034:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00080000:1.0:1789130223.133593:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789130224.070868:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130224.739449:0:40176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 08:37:03 (1789130223) 00010000:00010000:2.0:1789130225.093877:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130226.118912:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130226.449737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130226.449821:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978048 00000100:00100000:3.0:1789130226.449831:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978048 00000100:00100000:3.0:1789130226.449925:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 362 00000100:00080000:2.0:1789130226.450025:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130226.450080:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+27:36983:x1876037604978048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130226.450101:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130226.450121:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9fba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf96 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450196:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450211:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450222:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450237:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450244:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450251:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450721:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9fcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450731:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450738:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130226.450758:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789130226.450952:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450960:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450967:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450973:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130226.450977:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450985:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.450997:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:3.0:1789130226.451000:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.451005:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451012:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9fc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451023:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451028:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451042:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451048:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130226.451051:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451057:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451066:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b488939100) 00010000:00010000:3.0:1789130226.451069:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.451072:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451078:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9fc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451454:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9fba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf96 expref: 30 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451470:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf96 expref: 29 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.451477:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130226.451480:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.451482:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86800, rc 0) 00000100:00100000:3.0:1789130226.451550:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:36983:x1876037604978048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1820us total) trans 30064771395 rc 0/0 00000100:00100000:3.0:1789130226.458289:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 362 00000100:00100000:1.0:1789130226.470711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130226.470759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130226.470788:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978304 00000100:00100000:1.0:1789130226.470797:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978304 00000100:00100000:1.0:1789130226.470853:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130226.470863:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037604978304:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130226.470884:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130226.470908:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47ce9fcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf96 expref: 29 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130226.471168:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978176 00000100:00100000:3.0:1789130226.471173:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978176 00000100:00100000:3.0:1789130226.471205:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 363 00000100:00100000:3.0:1789130226.471213:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:36983:x1876037604978176:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130226.471304:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+29:36983:x1876037604978176:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 91us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130226.471311:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 363 00010000:00010000:1.0:1789130226.471581:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130226.471588:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130226.471646:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:2370:x1876037604978304:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 783us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130226.471655:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000001:00080000:2.0:1789130226.475798:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771394 is committed 00000020:00080000:2.0:1789130226.475817:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803910 batchid updated 00000020:00080000:3.0:1789130226.475883:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000020:00080000:3.0:1789130226.475894:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000040:00080000:0.0:1789130226.568355:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130226.568366:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130226.568835:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 4 00000040:00080000:0.0:1789130226.568843:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130226.641453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.641656:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978560 00000100:00100000:0.0:1789130226.641670:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978560 00000100:00100000:0.0:1789130226.641745:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 364 00000100:00100000:0.0:1789130226.641758:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+27:36998:x1876037604978560:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789130226.641850:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130226.641900:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151bc00/0x5c74554e47ce9d05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abebd expref: 27 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.641937:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130226.641943:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130226.642407:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.642424:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.642434:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.642723:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.642743:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 5 pid: 36589 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130226.642761:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38866f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626833024:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130226.643019:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130226.646303:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38866f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626833024:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130226.646354:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130226.651782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.651921:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978688 00000100:00100000:0.0:1789130226.651935:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978688 00010000:00010000:0.0:1789130226.652018:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 6 pid: 36589 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130226.652073:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130226.652086:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037604978688:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130226.652107:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130226.652117:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 6 pid: 36589 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652133:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 6 pid: 36589 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652160:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ce9fb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592abf8f expref: 6 pid: 36589 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652180:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:0.0:1789130226.652186:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652198:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652206:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130226.652247:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130226.652315:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604978688:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 231us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130226.652324:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:1.0:1789130226.652650:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.652677:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.652708:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.652719:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.652728:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789130226.654099:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789130226.655644:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:1.0:1789130226.655671:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655684:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655693:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655699:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130226.655705:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655715:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655735:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:1.0:1789130226.655738:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130226.655753:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.655760:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce9fdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130226.655786:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000077f451ec reply state 000000002d7e9d24 transno 30064771396 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130226.655796:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130226.655946:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:36998:x1876037604978560:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 14184us (14501us total) trans 30064771396 rc 0/0 00000100:00100000:1.0:1789130226.655957:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 364 00010000:00010000:3.0:1789130226.667515:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667547:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667555:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667563:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130226.667570:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667580:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667640:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff90b4909bd600) 00010000:00010000:3.0:1789130226.667644:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.667671:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.667678:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce9fe4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130226.667954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130226.668348:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978816 00000100:00100000:3.0:1789130226.668362:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978816 00000100:00100000:3.0:1789130226.668428:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 365 00000100:00100000:3.0:1789130226.668438:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+27:36999:x1876037604978816:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130226.668469:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130226.668494:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abf9d expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668590:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668645:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668659:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130226.668739:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130226.668744:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130226.668782:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668822:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce9feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf9d expref: 29 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668840:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf9d expref: 28 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.668871:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789130226.668874:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130226.668877:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:3.0:1789130226.668963:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+28:36999:x1876037604978816:12345-192.168.201.39@tcp:101:dd.0 Request processed in 525us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130226.668972:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 365 00000100:00100000:1.0:1789130226.675257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130226.675346:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604978944 00000100:00100000:3.0:1789130226.675361:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604978944 00000100:00100000:3.0:1789130226.675432:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 366 00000100:00100000:3.0:1789130226.675443:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+28:36999:x1876037604978944:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130226.675469:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130226.675495:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfa4 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.675591:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676009:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676026:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676045:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676052:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676075:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676222:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676230:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676237:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130226.676274:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00000004:00200000:3.0:1789130226.676278:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130226.676306:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676320:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676327:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676334:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676341:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130226.676345:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676353:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676373:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789130226.676376:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.676382:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676388:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676401:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676407:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676412:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676417:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130226.676420:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676425:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676431:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff90b488939b00) 00010000:00010000:3.0:1789130226.676434:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130226.676436:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676442:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676490:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce9ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfa4 expref: 30 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676503:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfa4 expref: 29 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130226.676511:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130226.676513:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130226.676515:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00000100:00100000:3.0:1789130226.676633:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:36999:x1876037604978944:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1191us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130226.676643:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 366 00000100:00100000:0.0:1789130226.690718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130226.690837:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979200 00000100:00100000:1.0:1789130226.690852:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979200 00000100:00100000:1.0:1789130226.690942:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 367 00000100:00100000:1.0:1789130226.690956:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+29:36999:x1876037604979200:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130226.690994:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130226.691026:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea015 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfab expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691231:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691251:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691266:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691311:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691319:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.691326:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130226.692130:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xca:0x0], index 1: 0 00010000:00010000:1.0:1789130226.692342:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47cea02a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692355:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47cea02a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692364:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47cea02a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692407:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692415:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692421:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692428:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130226.692433:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692454:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692469:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:1.0:1789130226.692472:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130226.692478:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692486:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea01c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130226.692502:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003f41141b reply state 0000000012642f6f transno 30064771397 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130226.692512:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130226.692553:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea015 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfab expref: 32 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692570:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47cea02a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfab expref: 31 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130226.692578:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130226.692581:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130226.692584:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00100000:1.0:1789130226.692744:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:36999:x1876037604979200:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1791us (2042us total) trans 30064771397 rc 0/0 00000100:00100000:1.0:1789130226.692755:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 367 00010000:00010000:2.0:1789130226.697659:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.697681:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.697689:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.697697:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130226.697703:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.697712:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.697738:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff90b4909bdb00) 00010000:00010000:2.0:1789130226.697741:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130226.697771:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.698001:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47cea023 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130226.706781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130226.707457:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979328 00000100:00100000:2.0:1789130226.707475:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979328 00000100:00100000:2.0:1789130226.707591:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:2.0:1789130226.707620:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+7:36999:x1876037604979328:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130226.707645:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130226.707679:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cea038 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfb2 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130226.707715:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130226.707743:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=1389s v=(0 0) 00010000:00010000:2.0:1789130226.707748:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130226.707760:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cea038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb2 expref: 8 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.707782:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cea038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb2 expref: 8 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130226.707800:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:2.0:1789130226.707917:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:36999:x1876037604979328:12345-192.168.201.39@tcp:101:dd.0 Request processed in 306us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.707926:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00080000:1.0:1789130226.708012:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130226.761740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130226.761841:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979456 00000100:00100000:1.0:1789130226.761853:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979456 00002000:00100000:1.0:1789130226.761919:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff90b38866c000 x1876037604979456/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130226.761943:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866c000 with x1876037604979456 ext(0->1048575) 00002000:00010000:1.0:1789130226.761951:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38866c000 00000100:00100000:1.0:1789130226.762027:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:1.0:1789130226.762038:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604979456:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130226.810248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.810340:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979584 00000100:00100000:0.0:1789130226.810351:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979584 00002000:00100000:0.0:1789130226.810415:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff90b3839b7c00 x1876037604979584/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.810428:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7c00 with x1876037604979584 ext(1048576->2097151) 00002000:00010000:0.0:1789130226.810437:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b7c00 00000100:00100000:0.0:1789130226.810470:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:0.0:1789130226.810481:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037604979584:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130226.820830:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604979456:12345-192.168.201.39@tcp:4:dd.0 Request processed in 58760us (59067us total) trans 30064771166 rc 0/0 00000100:00100000:1.0:1789130226.820852:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00002000:00100000:1.0:1789130226.823678:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff90b38866c000 x1876037604979456/t30064771166(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130226.823698:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38866c000 with x1876037604979456 ext(0->1048575) 00002000:00010000:1.0:1789130226.823708:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38866c000 00000100:00100000:3.0:1789130226.839933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.840675:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979712 00000100:00100000:0.0:1789130226.840935:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979712 00002000:00100000:0.0:1789130226.841001:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff90b48904a580 x1876037604979712/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.841015:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904a580 with x1876037604979712 ext(2097152->3145727) 00002000:00010000:0.0:1789130226.841021:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904a580 00000100:00100000:0.0:1789130226.841063:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1789130226.841073:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037604979712:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130226.850490:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+14:2368:x1876037604979584:12345-192.168.201.39@tcp:4:dd.0 Request processed in 40001us (40249us total) trans 30064771167 rc 0/0 00000100:00100000:0.0:1789130226.850505:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00002000:00100000:0.0:1789130226.850518:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff90b3839b7c00 x1876037604979584/t30064771167(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.850529:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7c00 with x1876037604979584 ext(1048576->2097151) 00002000:00010000:0.0:1789130226.850536:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b7c00 00000100:00100000:3.0:1789130226.866179:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604979712:12345-192.168.201.39@tcp:4:dd.0 Request processed in 25097us (26252us total) trans 30064771168 rc 0/0 00000100:00100000:3.0:1789130226.866194:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00002000:00100000:3.0:1789130226.866206:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff90b48904a580 x1876037604979712/t30064771168(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130226.866216:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b48904a580 with x1876037604979712 ext(2097152->3145727) 00002000:00010000:3.0:1789130226.866223:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b48904a580 00000100:00100000:2.0:1789130226.875199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.875276:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979840 00000100:00100000:0.0:1789130226.875287:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979840 00002000:00100000:0.0:1789130226.875337:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff90b38685e580 x1876037604979840/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.875350:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e580 with x1876037604979840 ext(3145728->4194303) 00002000:00010000:0.0:1789130226.875355:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685e580 00000100:00100000:0.0:1789130226.875395:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:0.0:1789130226.875405:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037604979840:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130226.889053:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:2369:x1876037604979840:12345-192.168.201.39@tcp:4:dd.0 Request processed in 13635us (13850us total) trans 30064771169 rc 0/0 00000100:00100000:0.0:1789130226.889069:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00002000:00100000:0.0:1789130226.889084:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff90b38685e580 x1876037604979840/t30064771169(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.889095:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38685e580 with x1876037604979840 ext(3145728->4194303) 00002000:00010000:0.0:1789130226.889102:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38685e580 00000100:00100000:2.0:1789130226.908129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130226.908246:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604979968 00000100:00100000:1.0:1789130226.908257:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604979968 00002000:00100000:1.0:1789130226.908313:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff90b38295de00 x1876037604979968/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130226.908326:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295de00 with x1876037604979968 ext(4194304->5242879) 00002000:00010000:1.0:1789130226.908334:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295de00 00000100:00100000:1.0:1789130226.908373:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:1.0:1789130226.908383:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037604979968:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130226.927291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130226.927728:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980096 00000100:00100000:2.0:1789130226.927739:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980096 00002000:00100000:2.0:1789130226.927787:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff90b383f28b40 x1876037604980096/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130226.927798:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f28b40 with x1876037604980096 ext(5242880->6291455) 00002000:00010000:2.0:1789130226.927804:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f28b40 00000100:00100000:2.0:1789130226.927834:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:2.0:1789130226.927842:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+18:2368:x1876037604980096:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130226.950960:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38295cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626833152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130226.951041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.951127:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833152 00000100:00100000:2.0:1789130226.951134:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833152 00000100:00100000:2.0:1789130226.951204:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789130226.951214:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626833152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130226.951236:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 166920192 pending 10223616 free 3804233728 avail 3802136576 00000100:00100000:2.0:1789130226.951281:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626833152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.951289:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789130226.951335:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38295cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626833152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130226.955173:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38295cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626833280:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.955279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486df6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626833792:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955303:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.955348:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130226.955354:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38295da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.955446:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833280 00000100:00100000:2.0:1789130226.955453:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833280 00000100:00100000:2.0:1789130226.955503:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130226.955511:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955559:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626833280:12345-0@lo:400:kworker.0 Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.955567:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130226.955619:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833792 00000100:00100000:2.0:1789130226.955623:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833792 00000100:00100000:2.0:1789130226.955663:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789130226.955669:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626833792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955699:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626833792:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.955704:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789130226.955723:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626833536:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.955760:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130226.955764:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486df61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626833664:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130226.955799:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833536 00000100:00100000:2.0:1789130226.955803:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833536 00000100:00100000:2.0:1789130226.955823:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833664 00000100:00100000:2.0:1789130226.955825:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833664 00000100:00100000:2.0:1789130226.955840:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789130226.955845:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626833536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955892:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626833536:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.955899:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789130226.955920:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789130226.955926:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955948:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626833664:12345-0@lo:400:kworker.0 Request processed in 23us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130226.955953:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789130226.955985:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486df61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626833664:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.955994:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626833536:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.956022:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38295cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626833280:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.956030:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486df6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626833792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130226.958334:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604979968:12345-192.168.201.39@tcp:4:dd.0 Request processed in 49940us (50203us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1789130226.958350:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00002000:00100000:0.0:1789130226.958365:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff90b38295de00 x1876037604979968/t30064771170(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.958376:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295de00 with x1876037604979968 ext(4194304->5242879) 00002000:00010000:0.0:1789130226.958383:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38295de00 00000100:00100000:0.0:1789130226.958425:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833408 00000100:00100000:0.0:1789130226.958432:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833408 00000100:00100000:0.0:1789130226.958476:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130226.958484:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626833408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130226.958570:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626833408:12345-0@lo:400:kworker.0 Request processed in 86us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130226.958576:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789130226.958644:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130226.958650:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130226.958652:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130226.958925:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38295da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789130226.973941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130226.973977:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980224 00000100:00100000:2.0:1789130226.973986:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980224 00002000:00100000:2.0:1789130226.974030:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff90b486df6580 x1876037604980224/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130226.974040:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df6580 with x1876037604980224 ext(6291456->7340031) 00002000:00010000:2.0:1789130226.974046:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df6580 00000100:00100000:2.0:1789130226.974070:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:2.0:1789130226.974080:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604980224:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130226.975094:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+22:2368:x1876037604980096:12345-192.168.201.39@tcp:4:dd.0 Request processed in 47246us (47806us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1789130226.975105:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00002000:00100000:0.0:1789130226.975114:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff90b383f28b40 x1876037604980096/t30064771171(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.975124:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f28b40 with x1876037604980096 ext(5242880->6291455) 00002000:00010000:0.0:1789130226.975130:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f28b40 00000100:00100000:3.0:1789130226.976973:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130226.978038:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980352 00000100:00100000:0.0:1789130226.978057:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980352 00002000:00100000:0.0:1789130226.978114:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff90b383f2a1c0 x1876037604980352/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/0 e 0 to 0 dl 1789130237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.978127:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a1c0 with x1876037604980352 ext(7340032->8388607) 00002000:00010000:0.0:1789130226.978135:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a1c0 00000100:00100000:0.0:1789130226.978171:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:0.0:1789130226.978181:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+22:2369:x1876037604980352:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130226.999130:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604980224:12345-192.168.201.39@tcp:4:dd.0 Request processed in 25041us (25187us total) trans 30064771172 rc 0/0 00000100:00100000:0.0:1789130226.999144:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00002000:00100000:0.0:1789130226.999155:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff90b486df6580 x1876037604980224/t30064771172(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130226.999165:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df6580 with x1876037604980224 ext(6291456->7340031) 00002000:00010000:0.0:1789130226.999171:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df6580 00000100:00100000:0.0:1789130227.003431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.004085:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980480 00000100:00100000:1.0:1789130227.004107:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980480 00002000:00100000:1.0:1789130227.004396:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b4000 x1876037604980480/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.004409:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b4000 with x1876037604980480 ext(8388608->9437183) 00002000:00010000:1.0:1789130227.004419:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b4000 00000100:00100000:1.0:1789130227.004452:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:1.0:1789130227.004462:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2367:x1876037604980480:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.007068:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+26:2369:x1876037604980352:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28879us (30095us total) trans 30064771173 rc 0/0 00000100:00100000:0.0:1789130227.007083:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00002000:00100000:0.0:1789130227.007094:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff90b383f2a1c0 x1876037604980352/t30064771173(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:697/0 lens 488/448 e 0 to 0 dl 1789130237 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.007105:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a1c0 with x1876037604980352 ext(7340032->8388607) 00002000:00010000:0.0:1789130227.007111:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a1c0 00000100:00100000:1.0:1789130227.024582:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604980480:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20110us (21149us total) trans 30064771174 rc 0/0 00000100:00100000:1.0:1789130227.024598:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00002000:00100000:1.0:1789130227.024661:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b4000 x1876037604980480/t30064771174(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.024672:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b4000 with x1876037604980480 ext(8388608->9437183) 00002000:00010000:1.0:1789130227.024680:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b4000 00000100:00100000:0.0:1789130227.036406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.039790:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980608 00000100:00100000:2.0:1789130227.039813:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980608 00002000:00100000:0.0:1789130227.043353:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b6580 x1876037604980608/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.043372:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6580 with x1876037604980608 ext(9437184->10485759) 00002000:00010000:0.0:1789130227.043383:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b6580 00000100:00100000:0.0:1789130227.043513:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:0.0:1789130227.043534:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604980608:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130227.060030:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+28:2367:x1876037604980608:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16075us (23207us total) trans 30064771175 rc 0/0 00000100:00100000:1.0:1789130227.060048:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00002000:00100000:1.0:1789130227.060065:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b6580 x1876037604980608/t30064771175(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.060077:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6580 with x1876037604980608 ext(9437184->10485759) 00002000:00010000:1.0:1789130227.060086:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b6580 00000100:00100000:0.0:1789130227.061456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.061559:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980736 00000100:00100000:2.0:1789130227.061571:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980736 00002000:00100000:2.0:1789130227.061676:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff90b3839b52c0 x1876037604980736/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130227.061688:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b52c0 with x1876037604980736 ext(10485760->11534335) 00002000:00010000:2.0:1789130227.061694:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b52c0 00000100:00100000:2.0:1789130227.061721:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:2.0:1789130227.061732:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:2370:x1876037604980736:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130227.088333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.088473:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980864 00000100:00100000:1.0:1789130227.088485:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980864 00002000:00100000:1.0:1789130227.088560:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff90b383f2a940 x1876037604980864/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.088581:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a940 with x1876037604980864 ext(11534336->12582911) 00002000:00010000:1.0:1789130227.088590:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a940 00000100:00100000:1.0:1789130227.088666:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:1.0:1789130227.088678:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604980864:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130227.093395:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+32:2370:x1876037604980736:12345-192.168.201.39@tcp:4:dd.0 Request processed in 31649us (31933us total) trans 30064771176 rc 0/0 00000100:00100000:2.0:1789130227.093412:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00002000:00100000:2.0:1789130227.093429:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff90b3839b52c0 x1876037604980736/t30064771176(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130227.093442:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b52c0 with x1876037604980736 ext(10485760->11534335) 00002000:00010000:2.0:1789130227.093450:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b52c0 00000100:00100000:3.0:1789130227.118181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.118327:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604980992 00000100:00100000:0.0:1789130227.118341:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604980992 00002000:00100000:0.0:1789130227.118415:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff90b383f292c0 x1876037604980992/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.118430:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f292c0 with x1876037604980992 ext(12582912->13631487) 00002000:00010000:0.0:1789130227.118438:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f292c0 00000100:00100000:0.0:1789130227.118479:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:0.0:1789130227.118491:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:2369:x1876037604980992:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130227.130984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.131185:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604981120 00000100:00100000:0.0:1789130227.131198:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604981120 00002000:00100000:0.0:1789130227.131260:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff90b382e67480 x1876037604981120/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.131272:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e67480 with x1876037604981120 ext(13631488->14680063) 00002000:00010000:0.0:1789130227.131281:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382e67480 00000100:00100000:0.0:1789130227.131321:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 246 00000100:00100000:0.0:1789130227.131332:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+34:2369:x1876037604981120:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:0.0:1789130227.142661:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130227.148729:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:2369:x1876037604980864:12345-192.168.201.39@tcp:4:dd.0 Request processed in 60033us (60392us total) trans 30064771177 rc 0/0 00000100:00100000:0.0:1789130227.148751:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 244 00002000:00100000:0.0:1789130227.148781:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff90b383f2a940 x1876037604980864/t30064771177(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.148794:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f2a940 with x1876037604980864 ext(11534336->12582911) 00002000:00010000:0.0:1789130227.148801:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f2a940 00000100:00100000:0.0:1789130227.159487:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:2369:x1876037604980992:12345-192.168.201.39@tcp:4:dd.0 Request processed in 40982us (41306us total) trans 30064771178 rc 0/0 00000100:00100000:0.0:1789130227.159506:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 245 00002000:00100000:0.0:1789130227.159523:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff90b383f292c0 x1876037604980992/t30064771178(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.159535:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383f292c0 with x1876037604980992 ext(12582912->13631487) 00002000:00010000:0.0:1789130227.159543:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383f292c0 00000100:00100000:0.0:1789130227.166219:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+36:2369:x1876037604981120:12345-192.168.201.39@tcp:4:dd.0 Request processed in 34870us (35232us total) trans 30064771179 rc 0/0 00000100:00100000:0.0:1789130227.166239:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 246 00002000:00100000:0.0:1789130227.166257:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff90b382e67480 x1876037604981120/t30064771179(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.166270:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e67480 with x1876037604981120 ext(13631488->14680063) 00002000:00010000:0.0:1789130227.166280:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382e67480 00000100:00100000:2.0:1789130227.168495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.168599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.168764:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604981504 00000100:00100000:3.0:1789130227.168779:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604981504 00002000:00100000:3.0:1789130227.168862:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff90b486df61c0 x1876037604981504/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.168876:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df61c0 with x1876037604981504 ext(14680064->15728639) 00002000:00010000:3.0:1789130227.168884:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df61c0 00000100:00100000:3.0:1789130227.168922:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:3.0:1789130227.168933:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:2367:x1876037604981504:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130227.179039:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+38:2367:x1876037604981504:12345-192.168.201.39@tcp:4:dd.0 Request processed in 10092us (10423us total) trans 30064771180 rc 0/0 00000100:00100000:1.0:1789130227.179057:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 247 00002000:00100000:1.0:1789130227.179074:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff90b486df61c0 x1876037604981504/t30064771180(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.179087:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486df61c0 with x1876037604981504 ext(14680064->15728639) 00002000:00010000:1.0:1789130227.179095:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486df61c0 00000100:00100000:0.0:1789130227.180110:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604981376 00000100:00100000:0.0:1789130227.180127:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604981376 00000100:00100000:0.0:1789130227.180193:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:0.0:1789130227.180205:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+31:36999:x1876037604981376:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130227.182433:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+32:36999:x1876037604981376:12345-192.168.201.39@tcp:35:dd.0 Request processed in 2213us (13933us total) trans 30064771398 rc 0/0 00000100:00100000:0.0:1789130227.182451:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789130227.191749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.192238:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604981760 00000100:00100000:2.0:1789130227.192252:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604981760 00000100:00100000:2.0:1789130227.192340:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 368 00000100:00100000:2.0:1789130227.192352:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:37000:x1876037604981760:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130227.192387:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.192435:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cea03f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfb9 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.192820:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.192839:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.192974:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.192996:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.193005:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.193012:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130227.195179:0:38734:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xca:0x0], index 0: 0 00010000:00010000:2.0:1789130227.195436:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea054 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195453:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea054 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195467:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea054 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195515:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195554:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195562:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195569:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130227.195574:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195583:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195599:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:2.0:1789130227.195629:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130227.195635:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195643:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea046 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130227.195662:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ba21682b reply state 00000000bae74a3f transno 30064771399 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130227.195674:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130227.195722:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cea03f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb9 expref: 35 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195739:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea054 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb9 expref: 34 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.195757:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:2.0:1789130227.195760:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130227.195763:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130227.198638:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:37000:x1876037604981760:12345-192.168.201.39@tcp:101:dd.0 Request processed in 6246us (6862us total) trans 30064771399 rc 0/0 00000100:00100000:2.0:1789130227.198658:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 368 00010000:00010000:3.0:1789130227.200769:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200803:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200814:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200820:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130227.200826:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200835:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200866:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff90b4976b8300) 00010000:00010000:3.0:1789130227.200870:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130227.200876:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.200918:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea04d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130227.207103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.207430:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604981888 00000100:00100000:2.0:1789130227.207443:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604981888 00000100:00100000:2.0:1789130227.207530:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130227.207543:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:37000:x1876037604981888:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130227.207570:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.207633:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cea062 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfc0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130227.207672:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130227.207705:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=1390s v=(0 0) 00010000:00010000:2.0:1789130227.207711:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130227.207723:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cea062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc0 expref: 11 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.207741:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cea062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc0 expref: 11 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.207756:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:2.0:1789130227.207941:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:37000:x1876037604981888:12345-192.168.201.39@tcp:101:dd.0 Request processed in 400us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130227.207964:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00080000:0.0:1789130227.208101:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130227.219924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.220116:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982016 00000100:00100000:1.0:1789130227.220131:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982016 00002000:00100000:1.0:1789130227.220206:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff90b38295da40 x1876037604982016/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.220220:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295da40 with x1876037604982016 ext(0->1048575) 00002000:00010000:1.0:1789130227.220229:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295da40 00000100:00100000:1.0:1789130227.220334:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:1.0:1789130227.220347:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037604982016:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130227.239188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.239853:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982144 00000100:00100000:0.0:1789130227.239869:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982144 00002000:00100000:0.0:1789130227.239954:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff90b38274b840 x1876037604982144/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.239968:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274b840 with x1876037604982144 ext(1048576->2097151) 00002000:00010000:0.0:1789130227.239976:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274b840 00000100:00100000:0.0:1789130227.240020:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 249 00000100:00100000:0.0:1789130227.240034:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037604982144:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.249993:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604982016:12345-192.168.201.39@tcp:4:dd.0 Request processed in 29627us (30128us total) trans 30064771235 rc 0/0 00000100:00100000:0.0:1789130227.250014:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 248 00002000:00100000:0.0:1789130227.250034:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff90b38295da40 x1876037604982016/t30064771235(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.250047:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295da40 with x1876037604982016 ext(0->1048575) 00002000:00010000:0.0:1789130227.250056:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295da40 00000100:00100000:2.0:1789130227.260491:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2367:x1876037604982144:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20442us (21301us total) trans 30064771236 rc 0/0 00000100:00100000:2.0:1789130227.260510:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 249 00002000:00100000:2.0:1789130227.261012:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff90b38274b840 x1876037604982144/t30064771236(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130227.261028:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274b840 with x1876037604982144 ext(1048576->2097151) 00002000:00010000:2.0:1789130227.261038:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274b840 00000100:00100000:3.0:1789130227.267594:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.267888:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982272 00000100:00100000:1.0:1789130227.267911:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982272 00002000:00100000:1.0:1789130227.267984:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff90b382748000 x1876037604982272/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.268020:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748000 with x1876037604982272 ext(2097152->3145727) 00002000:00010000:1.0:1789130227.268029:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748000 00000100:00100000:1.0:1789130227.268074:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 250 00000100:00100000:1.0:1789130227.268086:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037604982272:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.288376:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037604982272:12345-192.168.201.39@tcp:4:dd.0 Request processed in 20273us (20780us total) trans 30064771237 rc 0/0 00000100:00100000:0.0:1789130227.288395:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 250 00002000:00100000:0.0:1789130227.288412:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff90b382748000 x1876037604982272/t30064771237(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.288426:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748000 with x1876037604982272 ext(2097152->3145727) 00002000:00010000:0.0:1789130227.288435:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748000 00000100:00100000:0.0:1789130227.296356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.296689:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982400 00000100:00100000:3.0:1789130227.296770:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982400 00002000:00100000:3.0:1789130227.296848:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff90b3839b6940 x1876037604982400/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.296864:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6940 with x1876037604982400 ext(3145728->4194303) 00002000:00010000:3.0:1789130227.296873:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b6940 00000100:00100000:3.0:1789130227.296923:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 251 00000100:00100000:3.0:1789130227.296934:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037604982400:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130227.313967:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604982400:12345-192.168.201.39@tcp:4:dd.0 Request processed in 17013us (17606us total) trans 30064771238 rc 0/0 00000100:00100000:3.0:1789130227.313987:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 251 00002000:00100000:3.0:1789130227.314007:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff90b3839b6940 x1876037604982400/t30064771238(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.314020:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6940 with x1876037604982400 ext(3145728->4194303) 00002000:00010000:3.0:1789130227.314031:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b6940 00000100:00100000:1.0:1789130227.320360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.320949:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982528 00000100:00100000:2.0:1789130227.321030:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982528 00002000:00100000:2.0:1789130227.321107:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff90b3832b7480 x1876037604982528/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130227.321120:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b7480 with x1876037604982528 ext(4194304->5242879) 00002000:00010000:2.0:1789130227.321129:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b7480 00000100:00100000:2.0:1789130227.321170:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:2.0:1789130227.321181:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+19:2367:x1876037604982528:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.333018:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037604982528:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11822us (12657us total) trans 30064771239 rc 0/0 00000100:00100000:0.0:1789130227.333040:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 252 00002000:00100000:0.0:1789130227.333057:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff90b3832b7480 x1876037604982528/t30064771239(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.333069:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b7480 with x1876037604982528 ext(4194304->5242879) 00002000:00010000:0.0:1789130227.333078:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b7480 00000100:00100000:1.0:1789130227.333382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.333841:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982656 00000100:00100000:3.0:1789130227.333915:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982656 00002000:00100000:3.0:1789130227.333971:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff90b3832b7840 x1876037604982656/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.334011:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b7840 with x1876037604982656 ext(5242880->6291455) 00002000:00010000:3.0:1789130227.334016:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b7840 00000100:00100000:3.0:1789130227.334053:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:3.0:1789130227.334066:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+21:2370:x1876037604982656:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130227.366191:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+23:2370:x1876037604982656:12345-192.168.201.39@tcp:4:dd.0 Request processed in 32103us (32785us total) trans 30064771240 rc 0/0 00000100:00100000:3.0:1789130227.366214:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 253 00002000:00100000:3.0:1789130227.366238:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff90b3832b7840 x1876037604982656/t30064771240(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.366250:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b7840 with x1876037604982656 ext(5242880->6291455) 00002000:00010000:3.0:1789130227.366261:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b7840 00000100:00100000:1.0:1789130227.377961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.378083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.390759:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982784 00000100:00100000:0.0:1789130227.390781:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982784 00002000:00100000:0.0:1789130227.390871:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff90b3832b70c0 x1876037604982784/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.390885:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b70c0 with x1876037604982784 ext(6291456->7340031) 00002000:00010000:0.0:1789130227.390903:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b70c0 00000100:00100000:0.0:1789130227.390959:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604982912 00000100:00100000:0.0:1789130227.390963:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604982912 00002000:00100000:0.0:1789130227.390985:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff90b382bba940 x1876037604982912/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.390993:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bba940 with x1876037604982912 ext(7340032->8388607) 00002000:00010000:0.0:1789130227.390997:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bba940 00000100:00100000:0.0:1789130227.391022:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 254 00000100:00100000:0.0:1789130227.391034:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+24:2369:x1876037604982784:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.391309:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 255 00000100:00100000:0.0:1789130227.391317:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:2370:x1876037604982912:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.392975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.397652:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983040 00000100:00100000:1.0:1789130227.397676:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983040 00002000:00100000:1.0:1789130227.397757:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b7840 x1876037604983040/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.397770:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7840 with x1876037604983040 ext(8388608->9437183) 00002000:00010000:1.0:1789130227.397778:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b7840 00000100:00100000:1.0:1789130227.397821:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:1.0:1789130227.397832:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037604983040:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.414764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.415793:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983168 00000100:00100000:3.0:1789130227.415809:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983168 00002000:00100000:3.0:1789130227.415878:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b70c0 x1876037604983168/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.415904:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b70c0 with x1876037604983168 ext(9437184->10485759) 00002000:00010000:3.0:1789130227.415915:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b70c0 00000100:00100000:3.0:1789130227.416008:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:1.0:1789130227.416017:0:37279:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1789130227.416020:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037604983168:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130227.416028:0:37279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:3.0:1789130227.442951:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+31:2369:x1876037604982784:12345-192.168.201.39@tcp:4:dd.0 Request processed in 51903us (64988us total) trans 30064771241 rc 0/0 00000100:00100000:3.0:1789130227.442969:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 254 00002000:00100000:3.0:1789130227.442998:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff90b3832b70c0 x1876037604982784/t30064771241(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130227.443009:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b70c0 with x1876037604982784 ext(6291456->7340031) 00002000:00010000:3.0:1789130227.443018:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3832b70c0 00000100:00100000:3.0:1789130227.443116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.443412:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983296 00000100:00100000:0.0:1789130227.443423:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983296 00002000:00100000:0.0:1789130227.443472:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff90b382748b40 x1876037604983296/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.443482:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748b40 with x1876037604983296 ext(10485760->11534335) 00002000:00010000:0.0:1789130227.443486:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748b40 00000100:00100000:0.0:1789130227.443521:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:0.0:1789130227.443532:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604983296:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130227.453488:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604982912:12345-192.168.201.39@tcp:4:dd.0 Request processed in 62154us (75387us total) trans 30064771242 rc 0/0 00000100:00100000:1.0:1789130227.453506:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 255 00002000:00100000:1.0:1789130227.453539:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff90b382bba940 x1876037604982912/t30064771242(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.453578:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bba940 with x1876037604982912 ext(7340032->8388607) 00002000:00010000:1.0:1789130227.453588:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bba940 00000100:00100000:1.0:1789130227.461439:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:2369:x1876037604983040:12345-192.168.201.39@tcp:4:dd.0 Request processed in 63589us (68461us total) trans 30064771243 rc 0/0 00000100:00100000:1.0:1789130227.461769:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 256 00002000:00100000:1.0:1789130227.461789:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b7840 x1876037604983040/t30064771243(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.461803:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7840 with x1876037604983040 ext(8388608->9437183) 00002000:00010000:1.0:1789130227.461813:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b7840 00000100:00100000:0.0:1789130227.469372:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:2369:x1876037604983168:12345-192.168.201.39@tcp:4:dd.0 Request processed in 53339us (54608us total) trans 30064771244 rc 0/0 00000100:00100000:0.0:1789130227.469386:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 257 00002000:00100000:0.0:1789130227.469400:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b70c0 x1876037604983168/t30064771244(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.469410:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b70c0 with x1876037604983168 ext(9437184->10485759) 00002000:00010000:0.0:1789130227.469418:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839b70c0 00000100:00100000:0.0:1789130227.480307:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604983296:12345-192.168.201.39@tcp:4:dd.0 Request processed in 36758us (37173us total) trans 30064771245 rc 0/0 00000100:00100000:0.0:1789130227.480329:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 258 00002000:00100000:0.0:1789130227.480351:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff90b382748b40 x1876037604983296/t30064771245(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.480365:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748b40 with x1876037604983296 ext(10485760->11534335) 00002000:00010000:0.0:1789130227.480375:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748b40 00000100:00100000:3.0:1789130227.481825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.481905:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983424 00000100:00100000:1.0:1789130227.481918:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983424 00002000:00100000:1.0:1789130227.481978:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff90b382748780 x1876037604983424/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.481990:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748780 with x1876037604983424 ext(11534336->12582911) 00002000:00010000:1.0:1789130227.481997:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748780 00000100:00100000:1.0:1789130227.482039:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 259 00000100:00100000:1.0:1789130227.482051:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604983424:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.500092:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604983424:12345-192.168.201.39@tcp:4:dd.0 Request processed in 18027us (18261us total) trans 30064771246 rc 0/0 00000100:00100000:0.0:1789130227.500127:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 259 00002000:00100000:0.0:1789130227.500142:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff90b382748780 x1876037604983424/t30064771246(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.500154:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748780 with x1876037604983424 ext(11534336->12582911) 00002000:00010000:0.0:1789130227.500163:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748780 00000100:00100000:3.0:1789130227.505237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.505882:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983552 00000100:00100000:1.0:1789130227.505907:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983552 00002000:00100000:1.0:1789130227.505985:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff90b382748f00 x1876037604983552/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.505999:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748f00 with x1876037604983552 ext(12582912->13631487) 00002000:00010000:1.0:1789130227.506007:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748f00 00000100:00100000:1.0:1789130227.506121:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:1.0:1789130227.506133:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:2369:x1876037604983552:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.521383:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604983552:12345-192.168.201.39@tcp:4:dd.0 Request processed in 15237us (16146us total) trans 30064771247 rc 0/0 00000100:00100000:0.0:1789130227.521401:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 260 00002000:00100000:0.0:1789130227.521418:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff90b382748f00 x1876037604983552/t30064771247(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.521430:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382748f00 with x1876037604983552 ext(12582912->13631487) 00002000:00010000:0.0:1789130227.521440:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382748f00 00000100:00100000:1.0:1789130227.533487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.533810:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983680 00000100:00100000:0.0:1789130227.533826:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983680 00002000:00100000:0.0:1789130227.533923:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff90b382bbad00 x1876037604983680/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.533936:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbad00 with x1876037604983680 ext(13631488->14680063) 00002000:00010000:0.0:1789130227.533946:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bbad00 00000100:00100000:0.0:1789130227.533997:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:0.0:1789130227.534009:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:2368:x1876037604983680:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130227.547409:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2368:x1876037604983680:12345-192.168.201.39@tcp:4:dd.0 Request processed in 13385us (13921us total) trans 30064771248 rc 0/0 00000100:00100000:0.0:1789130227.547430:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 261 00002000:00100000:0.0:1789130227.547448:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff90b382bbad00 x1876037604983680/t30064771248(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.547461:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbad00 with x1876037604983680 ext(13631488->14680063) 00002000:00010000:0.0:1789130227.547470:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382bbad00 00000100:00100000:2.0:1789130227.560119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.561000:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604983936 00000100:00100000:0.0:1789130227.561017:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604983936 00000100:00100000:0.0:1789130227.561099:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789130227.561110:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:37000:x1876037604983936:12345-192.168.201.39@tcp:35:dd.0 00000001:00080000:0.0:1789130227.561461:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771400 00000100:00100000:0.0:1789130227.561774:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:37000:x1876037604983936:12345-192.168.201.39@tcp:35:dd.0 Request processed in 663us (1667us total) trans 30064771401 rc 0/0 00000100:00100000:0.0:1789130227.561784:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000020:00080000:0.0:1789130227.561790:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130227.566087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.566242:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984064 00000100:00100000:0.0:1789130227.566254:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984064 00002000:00100000:0.0:1789130227.566317:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff90b389698b40 x1876037604984064/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.566331:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698b40 with x1876037604984064 ext(14680064->15728639) 00002000:00010000:0.0:1789130227.566339:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698b40 00000100:00100000:0.0:1789130227.566379:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:0.0:1789130227.566390:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:2368:x1876037604984064:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130227.588545:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604984064:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22131us (22447us total) trans 30064771249 rc 0/0 00000100:00100000:1.0:1789130227.588563:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 262 00002000:00100000:1.0:1789130227.588582:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff90b389698b40 x1876037604984064/t30064771249(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/448 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130227.588595:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698b40 with x1876037604984064 ext(14680064->15728639) 00002000:00010000:1.0:1789130227.588634:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698b40 00000100:00100000:1.0:1789130227.594941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.595068:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984192 00000100:00100000:2.0:1789130227.595083:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984192 00000100:00100000:2.0:1789130227.595207:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 369 00000100:00100000:2.0:1789130227.595219:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+36:37002:x1876037604984192:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130227.595254:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.595311:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea069 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfc7 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595362:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea070 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595379:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea070 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595393:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea070 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595534:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea069 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc7 expref: 38 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595557:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea070 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc7 expref: 37 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.595567:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.595570:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130227.595575:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:2.0:1789130227.595707:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+37:37002:x1876037604984192:12345-192.168.201.39@tcp:101:chown.0 Request processed in 490us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130227.595716:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 369 00000100:00100000:0.0:1789130227.599361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.599477:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984448 00000100:00100000:1.0:1789130227.599490:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984448 00000100:00100000:1.0:1789130227.599576:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 370 00000100:00100000:1.0:1789130227.599589:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:37002:x1876037604984448:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:1.0:1789130227.599706:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130227.599741:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47cea02a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfab expref: 37 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130227.599761:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130227.599767:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130227.599821:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130227.599837:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130227.599874:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130227.600484:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].13, 88 off9168 00000004:00080000:1.0:1789130227.600500:0:36588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1390697897055ns, next at 1391697893261ns, rc = 0 00000004:00010000:1.0:1789130227.600636:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000189c9b7a reply state 00000000cdbffe16 transno 30064771402 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130227.600649:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130227.600797:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+38:37002:x1876037604984448:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1208us (1448us total) trans 30064771402 rc 0/0 00000100:00100000:1.0:1789130227.600807:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 370 00010000:00010000:2.0:1789130227.607978:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608003:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608012:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608040:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130227.608047:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608056:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608078:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.608081:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130227.608088:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.608094:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47cea077 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130227.609961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.610427:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984576 00000100:00100000:2.0:1789130227.610442:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984576 00000100:00100000:2.0:1789130227.610522:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 371 00000100:00100000:2.0:1789130227.610534:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+37:37002:x1876037604984576:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130227.610569:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.610599:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea07e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfce expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.610707:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea07e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfce expref: 38 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.610724:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea07e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfce expref: 38 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.610771:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.610774:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130227.610779:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130227.610882:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+38:37002:x1876037604984576:12345-192.168.201.39@tcp:101:chown.0 Request processed in 350us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130227.610901:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 371 00000100:00100000:1.0:1789130227.613247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.613326:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984704 00000100:00100000:3.0:1789130227.613336:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984704 00000100:00100000:3.0:1789130227.613393:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:3.0:1789130227.613401:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037604984704:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:3.0:1789130227.613666:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789130227.613669:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1789130226 00002000:00010000:3.0:1789130227.613671:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130227.613673:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1789130227 00002000:00010000:3.0:1789130227.613676:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789130227.613754:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604984704:12345-192.168.201.39@tcp:2:chown.0 Request processed in 352us (517us total) trans 30064771181 rc 0/0 00000100:00100000:3.0:1789130227.613763:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1789130227.625719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130227.625830:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604984832 00000100:00100000:3.0:1789130227.625857:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604984832 00000100:00100000:3.0:1789130227.625943:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 372 00000100:00100000:3.0:1789130227.625953:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:37003:x1876037604984832:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:3.0:1789130227.625980:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130227.626006:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea085 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfd5 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626068:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea08c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626084:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea08c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626095:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea08c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626211:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea085 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfd5 expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626227:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea08c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfd5 expref: 39 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.626234:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:3.0:1789130227.626237:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130227.626241:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87600, rc 0) 00000100:00100000:3.0:1789130227.626302:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:37003:x1876037604984832:12345-192.168.201.39@tcp:101:chown.0 Request processed in 351us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130227.626307:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 372 00000100:00100000:2.0:1789130227.633709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.634226:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985088 00000100:00100000:0.0:1789130227.634241:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985088 00000100:00100000:0.0:1789130227.634319:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 373 00000100:00100000:0.0:1789130227.634331:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:37003:x1876037604985088:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:0.0:1789130227.634403:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130227.634442:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea054 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb9 expref: 39 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.634468:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130227.634474:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130227.634514:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.634544:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.634556:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130227.635201:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].13, 88 off9240 00000004:00080000:0.0:1789130227.635216:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1390732613058ns, next at 1391732609220ns, rc = 0 00000004:00010000:0.0:1789130227.635318:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d1c1205 reply state 00000000b143b70e transno 30064771403 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130227.635330:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130227.635462:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:37003:x1876037604985088:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1131us (1766us total) trans 30064771403 rc 0/0 00000100:00100000:0.0:1789130227.635471:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 373 00000100:00100000:1.0:1789130227.641123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.641218:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985216 00000100:00100000:2.0:1789130227.641230:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985216 00000100:00100000:2.0:1789130227.641339:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 374 00000100:00100000:2.0:1789130227.641351:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:37003:x1876037604985216:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130227.641385:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.641418:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea09a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfdc expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.641501:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea09a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfdc expref: 41 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.641529:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea09a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfdc expref: 41 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.641554:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:2.0:1789130227.641558:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130227.641563:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:2.0:1789130227.641663:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:37003:x1876037604985216:12345-192.168.201.39@tcp:101:chown.0 Request processed in 314us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130227.641689:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 374 00010000:00010000:3.0:1789130227.642805:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642823:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642831:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642864:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130227.642870:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642880:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642911:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:3.0:1789130227.642914:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789130227.642919:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130227.642926:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea093 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130227.645463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.645573:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985344 00000100:00100000:2.0:1789130227.645585:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985344 00000100:00100000:2.0:1789130227.645798:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130227.645810:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604985344:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:2.0:1789130227.646234:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789130227.646240:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1789130227 00002000:00010000:2.0:1789130227.646242:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130227.646245:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1789130227 00002000:00010000:2.0:1789130227.646248:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130227.646325:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:2368:x1876037604985344:12345-192.168.201.39@tcp:2:chown.0 Request processed in 515us (876us total) trans 30064771250 rc 0/0 00000100:00100000:2.0:1789130227.646333:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789130227.706389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.706530:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985472 00000100:00100000:0.0:1789130227.706544:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985472 00000100:00100000:0.0:1789130227.706681:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 375 00000100:00100000:0.0:1789130227.706695:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:37009:x1876037604985472:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130227.706725:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130227.706754:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea0a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfe3 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.706976:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.706995:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.707011:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130227.707091:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00000004:00200000:0.0:1789130227.707096:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130227.707126:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.707163:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea0a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfe3 expref: 42 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.707185:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfe3 expref: 41 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130227.707194:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:0.0:1789130227.707198:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130227.707202:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb400, rc 0) 00000100:00100000:0.0:1789130227.707294:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:37009:x1876037604985472:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 602us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130227.707307:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 375 00000100:00100000:1.0:1789130227.712374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.712538:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985600 00000100:00100000:2.0:1789130227.712552:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985600 00000100:00100000:2.0:1789130227.712644:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 376 00000100:00100000:2.0:1789130227.712656:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:37009:x1876037604985600:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130227.712684:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.712714:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfea expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712815:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712833:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712878:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712906:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712915:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.712921:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713052:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713062:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713068:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130227.713100:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:2.0:1789130227.713105:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130227.713127:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713141:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713151:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713168:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713176:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713182:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130227.713187:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713197:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713211:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:2.0:1789130227.713214:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130227.713219:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713226:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0b6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713240:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713246:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713253:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713257:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130227.713264:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713270:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713277:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130227.713279:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130227.713282:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713287:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0bd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713318:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0af lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfea expref: 43 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713331:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfea expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.713338:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.713340:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130227.713342:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdd400, rc 0) 00000100:00100000:2.0:1789130227.713411:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+42:37009:x1876037604985600:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 758us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130227.713419:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 376 00000100:00100000:1.0:1789130227.718515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.718659:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604985856 00000100:00100000:2.0:1789130227.718672:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604985856 00000100:00100000:2.0:1789130227.718738:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 377 00000100:00100000:2.0:1789130227.718750:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:37009:x1876037604985856:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130227.718801:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.718828:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0cb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abff1 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.719088:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47cea0d2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.719110:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47cea0d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.719127:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47cea0d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130227.719142:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:2.0:1789130227.719321:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd800/0x5c74554e47cea0cb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff1 expref: 45 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.719342:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47cea0d2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff1 expref: 44 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.719351:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.719355:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130227.719359:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bfbdc200, rc 0) 00000100:00100000:2.0:1789130227.719443:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:37009:x1876037604985856:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 696us (944us total) trans 30064771404 rc 0/0 00000100:00100000:2.0:1789130227.719452:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 377 00000100:00100000:1.0:1789130227.723152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.723256:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986112 00000100:00100000:2.0:1789130227.723270:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986112 00000100:00100000:2.0:1789130227.723350:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 378 00000100:00100000:2.0:1789130227.723379:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:37009:x1876037604986112:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130227.723413:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130227.723417:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1789130227.723454:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea07e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfce expref: 44 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723481:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc200/0x5c74554e47cea0d2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff1 expref: 43 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723495:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd400/0x5c74554e47cea0c4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfea expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723506:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.723511:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130227.723541:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47cea0e0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abff8 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723650:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723666:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723677:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723695:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723701:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723715:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723722:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130227.723727:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723736:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723745:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.723748:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130227.723753:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723759:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea0e7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.723787:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724177:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724185:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724483:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff8 expref: 44 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724493:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.724503:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130227.724674:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbddc00/0x5c74554e47cea0e0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff8 expref: 44 pid: 38723 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724694:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff8 expref: 43 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130227.724740:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:2.0:1789130227.724744:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130227.724747:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130227.725472:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+43:37009:x1876037604986112:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1462us (1703us total) trans 30064771405 rc 0/0 00000100:00100000:2.0:1789130227.725484:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 378 00000100:00100000:1.0:1789130227.748704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.748830:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986240 00000100:00100000:0.0:1789130227.748851:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986240 00002000:00100000:0.0:1789130227.748928:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff90b382bb8b40 x1876037604986240/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.748941:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8b40 with x1876037604986240 ext(0->1048575) 00002000:00010000:0.0:1789130227.748949:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382bb8b40 00000100:00100000:0.0:1789130227.748991:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 263 00000100:00100000:0.0:1789130227.749005:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604986240:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130227.779295:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604986240:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 30276us (30588us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130227.779315:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 263 00002000:00100000:0.0:1789130227.779335:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff90b382bb8b40 x1876037604986240/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.779348:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bb8b40 with x1876037604986240 ext(0->1048575) 00002000:00010000:0.0:1789130227.779359:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382bb8b40 00000100:00100000:1.0:1789130227.799251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.799353:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986368 00000100:00100000:0.0:1789130227.799366:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986368 00002000:00100000:0.0:1789130227.799429:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff90b382bbb840 x1876037604986368/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.799442:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbb840 with x1876037604986368 ext(1048576->2097151) 00002000:00010000:0.0:1789130227.799450:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382bbb840 00000100:00100000:0.0:1789130227.799492:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:0.0:1789130227.799502:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604986368:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130227.823774:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604986368:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 24261us (24526us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130227.823789:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 264 00002000:00100000:0.0:1789130227.823802:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff90b382bbb840 x1876037604986368/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.823812:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382bbb840 with x1876037604986368 ext(1048576->2097151) 00002000:00010000:0.0:1789130227.823820:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382bbb840 00000100:00100000:1.0:1789130227.860013:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.860123:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986496 00000100:00100000:0.0:1789130227.860135:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986496 00002000:00100000:0.0:1789130227.860196:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff90b384b50b40 x1876037604986496/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.860210:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50b40 with x1876037604986496 ext(2097152->3145727) 00002000:00010000:0.0:1789130227.860216:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50b40 00000100:00100000:0.0:1789130227.860252:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 265 00000100:00100000:0.0:1789130227.860263:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2368:x1876037604986496:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130227.862164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130227.862247:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986624 00000100:00100000:0.0:1789130227.862255:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986624 00002000:00100000:0.0:1789130227.862301:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff90b384b530c0 x1876037604986624/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.862313:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b530c0 with x1876037604986624 ext(3145728->4194303) 00002000:00010000:0.0:1789130227.862319:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b530c0 00000100:00100000:0.0:1789130227.862419:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:0.0:1789130227.862430:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:2367:x1876037604986624:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130227.892235:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604986496:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 31963us (32221us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130227.892250:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 265 00002000:00100000:0.0:1789130227.892263:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff90b384b50b40 x1876037604986496/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.892704:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50b40 with x1876037604986496 ext(2097152->3145727) 00002000:00010000:0.0:1789130227.892714:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b50b40 00000100:00100000:0.0:1789130227.916808:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:2367:x1876037604986624:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 54369us (54642us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130227.916822:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 266 00002000:00100000:0.0:1789130227.916834:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff90b384b530c0 x1876037604986624/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130227.916852:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b530c0 with x1876037604986624 ext(3145728->4194303) 00002000:00010000:0.0:1789130227.916860:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b530c0 00000100:00100000:3.0:1789130227.974231:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130227.974265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626833920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130227.974347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130227.974536:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626833920 00000100:00100000:0.0:1789130227.974545:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626833920 00000100:00100000:0.0:1789130227.974623:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130227.974634:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626833920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130227.974658:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 25559040 free 3741319168 avail 3739222016 00000100:00100000:0.0:1789130227.974717:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626833920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130227.974725:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130227.974994:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626833920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130227.989007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.989046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.989125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130227.993526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130227.999954:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986752 00000100:00100000:2.0:1789130227.999970:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986752 00002000:00100000:2.0:1789130228.000037:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff90b384b53840 x1876037604986752/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.000049:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53840 with x1876037604986752 ext(4194304->5242879) 00002000:00010000:2.0:1789130228.000057:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53840 00000100:00100000:2.0:1789130228.000113:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987008 00000100:00100000:2.0:1789130228.000118:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987008 00002000:00100000:2.0:1789130228.000137:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff90b384b521c0 x1876037604987008/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.000146:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b521c0 with x1876037604987008 ext(6291456->7340031) 00002000:00010000:2.0:1789130228.000150:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b521c0 00000100:00100000:2.0:1789130228.000167:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604986880 00000100:00100000:2.0:1789130228.000171:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604986880 00002000:00100000:2.0:1789130228.000204:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff90b384b512c0 x1876037604986880/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.000212:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b512c0 with x1876037604986880 ext(5242880->6291455) 00002000:00010000:2.0:1789130228.000216:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b512c0 00000100:00100000:2.0:1789130228.000237:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 267 00000100:00100000:2.0:1789130228.000246:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604986752:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.003807:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:2.0:1789130228.003850:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037604987008:12345-192.168.201.39@tcp:3:lfs.0 00000100:00080000:2.0:1789130228.003869:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130228.006408:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987136 00000100:00100000:1.0:1789130228.006421:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987136 00002000:00100000:1.0:1789130228.006464:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff90b384b53c00 x1876037604987136/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/0 e 0 to 0 dl 1789130238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.006475:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53c00 with x1876037604987136 ext(7340032->8388607) 00002000:00010000:1.0:1789130228.006492:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53c00 00000100:00100000:1.0:1789130228.006509:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 269 00000100:00100000:1.0:1789130228.006517:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604986880:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.008257:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:1.0:1789130228.009368:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:2370:x1876037604987136:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130228.055064:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+45:2370:x1876037604986752:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 54809us (66055us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130228.055081:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 267 00002000:00100000:3.0:1789130228.055097:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff90b384b53840 x1876037604986752/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.055108:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53840 with x1876037604986752 ext(4194304->5242879) 00002000:00010000:3.0:1789130228.055116:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53840 00000100:00100000:1.0:1789130228.080983:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+43:2370:x1876037604986880:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 74453us (91844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.080998:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 269 00002000:00100000:1.0:1789130228.081014:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff90b384b512c0 x1876037604986880/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.081025:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b512c0 with x1876037604986880 ext(5242880->6291455) 00002000:00010000:1.0:1789130228.081033:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b512c0 00000100:00100000:2.0:1789130228.087290:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:2370:x1876037604987008:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 83461us (98232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130228.087305:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 268 00002000:00100000:2.0:1789130228.087319:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff90b384b521c0 x1876037604987008/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.087329:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b521c0 with x1876037604987008 ext(6291456->7340031) 00002000:00010000:2.0:1789130228.087335:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b521c0 00000100:00100000:1.0:1789130228.124766:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604987136:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 116487us (131239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.124779:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 270 00002000:00100000:1.0:1789130228.124792:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff90b384b53c00 x1876037604987136/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:698/0 lens 488/440 e 0 to 0 dl 1789130238 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.124802:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b53c00 with x1876037604987136 ext(7340032->8388607) 00002000:00010000:1.0:1789130228.124821:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b53c00 00010000:00010000:0.0:1789130228.172717:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130228.174286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.174336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.174377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.174403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.174428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.174484:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987264 00000100:00100000:0.0:1789130228.174499:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987264 00000100:00100000:2.0:1789130228.174551:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987520 00000100:00100000:2.0:1789130228.174569:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987520 00002000:00100000:2.0:1789130228.174672:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff90b3839b7480 x1876037604987520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.174684:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7480 with x1876037604987520 ext(10485760->11534335) 00002000:00010000:2.0:1789130228.174691:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b7480 00000100:00100000:2.0:1789130228.174719:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987392 00000100:00100000:2.0:1789130228.174723:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987392 00002000:00100000:2.0:1789130228.174756:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b5e00 x1876037604987392/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.174765:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b5e00 with x1876037604987392 ext(9437184->10485759) 00002000:00010000:2.0:1789130228.174768:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b5e00 00000100:00100000:2.0:1789130228.174793:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987648 00000100:00100000:2.0:1789130228.174797:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987648 00002000:00100000:2.0:1789130228.174816:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff90b3839b6d00 x1876037604987648/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.174826:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6d00 with x1876037604987648 ext(11534336->12582911) 00002000:00010000:2.0:1789130228.174829:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b6d00 00000100:00100000:2.0:1789130228.174838:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987904 00000100:00100000:2.0:1789130228.174841:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987904 00002000:00100000:2.0:1789130228.174853:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff90b3879fa1c0 x1876037604987904/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.174860:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa1c0 with x1876037604987904 ext(13631488->14680063) 00002000:00010000:2.0:1789130228.174863:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3879fa1c0 00000100:00100000:2.0:1789130228.174875:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 271 00000100:00100000:2.0:1789130228.174896:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+43:2367:x1876037604987520:12345-192.168.201.39@tcp:3:lfs.0 00002000:00100000:0.0:1789130228.174995:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b4b40 x1876037604987264/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.175008:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b4b40 with x1876037604987264 ext(8388608->9437183) 00002000:00010000:0.0:1789130228.175015:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b4b40 00000100:00100000:0.0:1789130228.175037:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:0.0:1789130228.175047:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+43:2367:x1876037604987392:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.175796:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 273 00000100:00100000:1.0:1789130228.175816:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+45:2367:x1876037604987648:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.175941:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:2.0:1789130228.175955:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:2368:x1876037604987904:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.177157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.177785:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604987776 00000100:00100000:2.0:1789130228.177797:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604987776 00002000:00100000:2.0:1789130228.177838:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff90b384b51680 x1876037604987776/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.177867:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51680 with x1876037604987776 ext(12582912->13631487) 00002000:00010000:2.0:1789130228.177873:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51680 00000100:00100000:2.0:1789130228.177905:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:2.0:1789130228.177916:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:2367:x1876037604987264:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130228.179320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.179375:0:39572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:3.0:1789130228.179387:0:39572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:3.0:1789130228.179809:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988032 00000100:00100000:3.0:1789130228.179821:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988032 00002000:00100000:3.0:1789130228.180144:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff90b38274a1c0 x1876037604988032/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.180157:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a1c0 with x1876037604988032 ext(14680064->15728639) 00002000:00010000:3.0:1789130228.180165:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38274a1c0 00000100:00100000:2.0:1789130228.184864:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:2.0:1789130228.184898:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+50:2368:x1876037604987776:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.208222:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:2367:x1876037604987520:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 33317us (33874us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130228.208236:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 271 00002000:00100000:2.0:1789130228.208248:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff90b3839b7480 x1876037604987520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.208547:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b7480 with x1876037604987520 ext(10485760->11534335) 00002000:00010000:2.0:1789130228.208554:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b7480 00000100:00100000:2.0:1789130228.208586:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:2.0:1789130228.208698:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+49:2368:x1876037604988032:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.226552:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+49:2367:x1876037604987648:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 50737us (52139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.226562:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 273 00002000:00100000:1.0:1789130228.226573:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff90b3839b6d00 x1876037604987648/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.226580:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b6d00 with x1876037604987648 ext(11534336->12582911) 00002000:00010000:1.0:1789130228.226586:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b6d00 00000100:00100000:2.0:1789130228.232168:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+47:2368:x1876037604987904:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 56183us (57704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130228.232187:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 274 00002000:00100000:2.0:1789130228.232206:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff90b3879fa1c0 x1876037604987904/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.232219:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa1c0 with x1876037604987904 ext(13631488->14680063) 00002000:00010000:2.0:1789130228.232248:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3879fa1c0 00000100:00100000:1.0:1789130228.257173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.257344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.258269:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988160 00000100:00100000:3.0:1789130228.258281:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988160 00000100:00100000:0.0:1789130228.258298:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988288 00000100:00100000:0.0:1789130228.258311:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988288 00000100:00100000:3.0:1789130228.258351:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:3.0:1789130228.258367:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604988160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130228.258395:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:0.0:1789130228.258409:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604988288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130228.258454:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037604988160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 90us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130228.258464:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:0.0:1789130228.258484:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037604988288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130228.258493:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00080000:0.0:1789130228.258534:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130228.268464:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:2367:x1876037604987392:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 93405us (94072us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130228.268487:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 272 00002000:00100000:0.0:1789130228.268503:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff90b3839b5e00 x1876037604987392/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.268522:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b5e00 with x1876037604987392 ext(9437184->10485759) 00002000:00010000:0.0:1789130228.268529:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b5e00 00000100:00100000:0.0:1789130228.273705:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:2367:x1876037604987264:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 95780us (99420us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130228.273721:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 275 00002000:00100000:0.0:1789130228.273735:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff90b3839b4b40 x1876037604987264/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.273746:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839b4b40 with x1876037604987264 ext(8388608->9437183) 00002000:00010000:0.0:1789130228.273754:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3839b4b40 00000100:00100000:2.0:1789130228.299912:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037604987776:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 115020us (122748us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130228.299930:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 276 00002000:00100000:2.0:1789130228.299943:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff90b384b51680 x1876037604987776/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.299954:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b51680 with x1876037604987776 ext(12582912->13631487) 00002000:00010000:2.0:1789130228.299961:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b51680 00000100:00100000:2.0:1789130228.321172:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+39:2368:x1876037604988032:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 112563us (141849us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130228.321189:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 277 00002000:00100000:2.0:1789130228.321203:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff90b38274a1c0 x1876037604988032/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.321214:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a1c0 with x1876037604988032 ext(14680064->15728639) 00002000:00010000:2.0:1789130228.321221:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38274a1c0 00000100:00100000:1.0:1789130228.392095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.392203:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988544 00000100:00100000:0.0:1789130228.392222:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988544 00000100:00100000:0.0:1789130228.392438:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1789130228.392452:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48615f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+43:37009:x1876037604988544:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130228.393038:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48615f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:37009:x1876037604988544:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 587us (949us total) trans 30064771406 rc 0/0 00000100:00100000:0.0:1789130228.393048:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00080000:2.0:1789130228.393259:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130228.471264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.471346:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988672 00000100:00100000:2.0:1789130228.471360:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988672 00000100:00100000:2.0:1789130228.471443:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 379 00000100:00100000:2.0:1789130228.471455:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:37015:x1876037604988672:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130228.471492:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130228.471590:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47cea0f5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592abfff expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.471949:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.471987:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472004:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472025:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472033:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472039:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472188:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472199:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472207:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130228.472243:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00000004:00200000:2.0:1789130228.472249:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130228.472274:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472285:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472305:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472312:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472319:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472326:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dae00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130228.472331:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472340:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472355:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:2.0:1789130228.472359:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130228.472365:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472373:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47cea0fc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472390:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472397:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472403:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472413:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130228.472417:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472423:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472431:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130228.472433:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130228.472436:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472441:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da600/0x5c74554e47cea103 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472479:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47cea0f5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfff expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472493:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfff expref: 45 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.472500:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:2.0:1789130228.474319:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130228.474330:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58dba00, rc 0) 00000100:00100000:2.0:1789130228.474458:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:37015:x1876037604988672:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 2998us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130228.474469:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 379 00000100:00100000:3.0:1789130228.481958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.482149:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604988928 00000100:00100000:0.0:1789130228.482163:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604988928 00000100:00100000:0.0:1789130228.482243:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 380 00000100:00100000:0.0:1789130228.482255:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:37015:x1876037604988928:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130228.482284:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130228.482312:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea111 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac006 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.482447:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.482464:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.482478:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130228.482491:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00010000:00010000:0.0:1789130228.482693:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea111 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 48 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.482714:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 47 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.482724:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.482728:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130228.482732:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:0.0:1789130228.482830:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+47:37015:x1876037604988928:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 567us (879us total) trans 30064771407 rc 0/0 00000100:00100000:0.0:1789130228.482838:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 380 00000100:00100000:1.0:1789130228.486389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.486440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.486513:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989312 00000100:00100000:0.0:1789130228.486525:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989312 00000100:00100000:0.0:1789130228.486619:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 381 00000100:00100000:0.0:1789130228.486632:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:37015:x1876037604989312:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130228.486663:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130228.486668:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1789130228.486705:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea09a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfdc expref: 47 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486731:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47cea10a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfff expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486747:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.486753:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130228.486770:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea126 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac00d expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486839:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486856:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486868:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486895:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486902:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486909:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486916:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130228.486922:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486930:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486939:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.486943:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130228.486947:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486952:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea12d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486980:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.486991:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 46 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.487000:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.487039:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 46 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.487055:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 46 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130228.487072:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626834048:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130228.487164:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130228.488329:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989056 00000100:00100000:3.0:1789130228.488343:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989056 00010000:00010000:3.0:1789130228.488389:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 47 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130228.488653:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1789130228.488663:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:2370:x1876037604989056:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130228.488677:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130228.488682:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 47 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.488715:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 47 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.488734:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:3.0:1789130228.488737:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.488747:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.488755:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.488776:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130228.488863:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:2370:x1876037604989056:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 200us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130228.488871:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00010000:00010000:0.0:1789130228.489097:0:36588:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.39@tcp) returned -22 from blocking AST (req@0000000061bd28d4 x1876037626834048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 1/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 46 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489109:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea118 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac006 expref: 46 pid: 38723 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130228.489120:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626834048:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130228.489140:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.489145:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489152:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489156:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489405:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac00d expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489411:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.489413:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130228.489426:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea126 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac00d expref: 47 pid: 36588 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489437:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac00d expref: 46 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130228.489469:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:0.0:1789130228.489471:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130228.489472:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c000, rc 0) 00000100:00100000:0.0:1789130228.489500:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:37015:x1876037604989312:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 2872us (3060us total) trans 30064771408 rc 0/0 00000100:00100000:0.0:1789130228.489507:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 381 00000100:00100000:0.0:1789130228.517573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.517777:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989440 00000100:00100000:3.0:1789130228.517792:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989440 00002000:00100000:3.0:1789130228.517885:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff90b3879fb480 x1876037604989440/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.517899:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb480 with x1876037604989440 ext(0->1048575) 00002000:00010000:3.0:1789130228.517908:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb480 00000100:00100000:3.0:1789130228.517951:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:3.0:1789130228.517964:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:2368:x1876037604989440:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130228.538939:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:2368:x1876037604989440:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 20959us (21364us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130228.538975:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 278 00002000:00100000:3.0:1789130228.538993:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff90b3879fb480 x1876037604989440/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.539005:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fb480 with x1876037604989440 ext(0->1048575) 00002000:00010000:3.0:1789130228.539014:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fb480 00000100:00100000:0.0:1789130228.555728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.555852:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989568 00000100:00100000:1.0:1789130228.555866:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989568 00002000:00100000:1.0:1789130228.555951:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff90b3879fa940 x1876037604989568/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.555964:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa940 with x1876037604989568 ext(1048576->2097151) 00002000:00010000:1.0:1789130228.555973:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fa940 00000100:00100000:1.0:1789130228.556018:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:1.0:1789130228.556031:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+42:2367:x1876037604989568:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.575739:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+42:2367:x1876037604989568:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 19693us (20010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.575760:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 279 00002000:00100000:1.0:1789130228.575777:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff90b3879fa940 x1876037604989568/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.575790:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3879fa940 with x1876037604989568 ext(1048576->2097151) 00002000:00010000:1.0:1789130228.575800:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3879fa940 00000100:00100000:0.0:1789130228.594573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.595336:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989696 00000100:00100000:1.0:1789130228.595350:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989696 00002000:00100000:1.0:1789130228.595424:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff90b4876dda40 x1876037604989696/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.595438:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dda40 with x1876037604989696 ext(2097152->3145727) 00002000:00010000:1.0:1789130228.595447:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dda40 00000100:00100000:1.0:1789130228.595490:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:1.0:1789130228.595511:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037604989696:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.601466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.601646:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989824 00000100:00100000:3.0:1789130228.601659:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989824 00002000:00100000:3.0:1789130228.601727:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff90b38969a940 x1876037604989824/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.601742:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969a940 with x1876037604989824 ext(3145728->4194303) 00002000:00010000:3.0:1789130228.601749:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969a940 00000100:00100000:3.0:1789130228.601786:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:3.0:1789130228.601796:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604989824:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130228.622334:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037604989696:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 26312us (27256us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.622355:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 280 00002000:00100000:1.0:1789130228.622374:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff90b4876dda40 x1876037604989696/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.622388:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876dda40 with x1876037604989696 ext(2097152->3145727) 00002000:00010000:1.0:1789130228.622397:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4876dda40 00000100:00100000:3.0:1789130228.638590:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037604989824:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 36780us (37124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130228.638648:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 281 00002000:00100000:3.0:1789130228.638665:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff90b38969a940 x1876037604989824/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.638677:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969a940 with x1876037604989824 ext(3145728->4194303) 00002000:00010000:3.0:1789130228.638686:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969a940 00000100:00100000:2.0:1789130228.666186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.666320:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604989952 00000100:00100000:0.0:1789130228.666336:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604989952 00002000:00100000:0.0:1789130228.666417:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff90b389698f00 x1876037604989952/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.666432:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698f00 with x1876037604989952 ext(4194304->5242879) 00002000:00010000:0.0:1789130228.666441:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698f00 00000100:00100000:0.0:1789130228.666486:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:0.0:1789130228.666499:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037604989952:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.680180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.680242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.680300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.680356:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990080 00000100:00100000:2.0:1789130228.680369:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990080 00002000:00100000:2.0:1789130228.680440:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff90b389698780 x1876037604990080/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.680455:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698780 with x1876037604990080 ext(5242880->6291455) 00002000:00010000:2.0:1789130228.680465:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698780 00000100:00100000:2.0:1789130228.680496:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990336 00000100:00100000:2.0:1789130228.680512:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990336 00002000:00100000:2.0:1789130228.680529:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff90b38969bc00 x1876037604990336/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130228.680538:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969bc00 with x1876037604990336 ext(7340032->8388607) 00002000:00010000:2.0:1789130228.680541:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969bc00 00000100:00100000:3.0:1789130228.680647:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990208 00000100:00100000:3.0:1789130228.680652:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990208 00002000:00100000:3.0:1789130228.680674:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff90b389699680 x1876037604990208/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/0 e 0 to 0 dl 1789130239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.680696:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699680 with x1876037604990208 ext(6291456->7340031) 00002000:00010000:3.0:1789130228.680699:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699680 00000100:00100000:3.0:1789130228.680725:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:3.0:1789130228.680736:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389698780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:2369:x1876037604990080:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130228.681750:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:2.0:1789130228.681766:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:2370:x1876037604990336:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130228.683131:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 285 00000100:00100000:0.0:1789130228.683153:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+48:2370:x1876037604990208:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130228.703573:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+48:2369:x1876037604989952:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 37059us (37388us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130228.703591:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 282 00002000:00100000:0.0:1789130228.703634:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff90b389698f00 x1876037604989952/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.703648:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698f00 with x1876037604989952 ext(4194304->5242879) 00002000:00010000:0.0:1789130228.703657:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698f00 00000100:00100000:0.0:1789130228.729679:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389698780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:2369:x1876037604990080:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 48926us (49498us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130228.729698:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 283 00002000:00100000:0.0:1789130228.729714:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff90b389698780 x1876037604990080/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130228.729727:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389698780 with x1876037604990080 ext(5242880->6291455) 00002000:00010000:0.0:1789130228.729736:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389698780 00000100:00100000:1.0:1789130228.734539:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+44:2370:x1876037604990208:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 51380us (54223us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130228.735167:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 285 00002000:00100000:1.0:1789130228.735186:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff90b389699680 x1876037604990208/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130228.735200:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389699680 with x1876037604990208 ext(6291456->7340031) 00002000:00010000:1.0:1789130228.735209:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b389699680 00000100:00100000:3.0:1789130228.745234:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037604990336:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 63454us (64972us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130228.745254:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 284 00002000:00100000:3.0:1789130228.745272:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff90b38969bc00 x1876037604990336/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:699/0 lens 488/440 e 0 to 0 dl 1789130239 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130228.745285:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969bc00 with x1876037604990336 ext(7340032->8388607) 00002000:00010000:3.0:1789130228.745295:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969bc00 00000100:00100000:2.0:1789130228.764330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.764483:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990592 00000100:00100000:1.0:1789130228.764624:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990592 00000100:00100000:1.0:1789130228.764744:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130228.764758:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:37015:x1876037604990592:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:1.0:1789130228.765297:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+47:37015:x1876037604990592:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 539us (979us total) trans 30064771409 rc 0/0 00000100:00100000:1.0:1789130228.765306:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789130228.848375:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.848497:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990848 00000100:00100000:3.0:1789130228.848512:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990848 00000100:00100000:3.0:1789130228.848664:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 382 00000100:00100000:3.0:1789130228.848678:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+47:37025:x1876037604990848:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130228.848709:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130228.848736:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea13b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac014 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130228.848908:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:3.0:1789130228.849192:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea13b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac014 expref: 49 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.849212:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789130228.849234:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130228.849242:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac014 expref: 49 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.849260:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb9400, rc 0) 00000100:00100000:3.0:1789130228.849454:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:37025:x1876037604990848:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 779us (1095us total) trans 30064771410 rc 301/301 00000100:00100000:3.0:1789130228.849464:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 382 00000100:00100000:2.0:1789130228.852176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130228.852295:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604990976 00000100:00100000:3.0:1789130228.852310:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604990976 00000100:00100000:3.0:1789130228.852433:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 383 00000100:00100000:3.0:1789130228.852446:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:37025:x1876037604990976:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130228.852557:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852578:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852595:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852661:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852669:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852676:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852847:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852858:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852865:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130228.852923:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852937:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852944:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852951:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852957:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb9800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130228.852962:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852970:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.852984:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130228.852988:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130228.852994:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853024:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea149 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853043:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853049:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853056:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853061:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb9c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130228.853064:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853070:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853078:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff90b488939b00) 00010000:00010000:3.0:1789130228.853082:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130228.853085:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853091:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea150 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853114:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853120:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853131:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853136:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130228.853139:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853145:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853153:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:3.0:1789130228.853156:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130228.853159:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130228.853166:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea157 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130228.853254:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:37025:x1876037604990976:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 809us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130228.853262:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 383 00000100:00100000:2.0:1789130228.856074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130228.856213:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604991232 00000100:00100000:0.0:1789130228.856227:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604991232 00000100:00100000:0.0:1789130228.856346:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130228.856363:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:37025:x1876037604991232:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130228.856781:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:37025:x1876037604991232:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 422us (787us total) trans 30064771411 rc 0/0 00000100:00100000:0.0:1789130228.856790:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130228.959931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130228.960522:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604991488 00000100:00100000:2.0:1789130228.960536:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604991488 00000100:00100000:2.0:1789130228.960643:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 384 00000100:00100000:2.0:1789130228.960656:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:37035:x1876037604991488:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130228.960689:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130228.960735:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac01b expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130228.960933:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:2.0:1789130228.961107:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea15e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac01b expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.961125:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:2.0:1789130228.961128:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130228.961134:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac01b expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130228.961150:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:2.0:1789130228.961233:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:37035:x1876037604991488:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 581us (1321us total) trans 30064771412 rc 301/301 00000100:00100000:2.0:1789130228.961241:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 384 00000100:00100000:2.0:1789130228.967348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.967454:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604991616 00000100:00100000:1.0:1789130228.967466:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604991616 00000100:00100000:1.0:1789130228.967541:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 385 00000100:00100000:1.0:1789130228.967555:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:37035:x1876037604991616:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130228.967692:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.967713:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.967730:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.967750:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.967779:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.967788:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968121:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968132:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968140:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130228.968188:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968203:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968211:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968219:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968226:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130228.968231:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968240:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968263:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:1.0:1789130228.968266:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130228.968272:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968279:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea16c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968293:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968299:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968306:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968311:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130228.968314:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968319:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968326:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff90b4909bd100) 00010000:00010000:1.0:1789130228.968328:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130228.968331:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968338:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea173 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968365:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968371:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968377:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968383:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130228.968386:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968393:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968400:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:1.0:1789130228.968403:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130228.968406:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130228.968412:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea17a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130228.968512:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:37035:x1876037604991616:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 959us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130228.968521:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 385 00000100:00100000:3.0:1789130228.972275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130228.972480:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604991872 00000100:00100000:1.0:1789130228.972495:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604991872 00000100:00100000:1.0:1789130228.972567:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1789130228.972596:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:37035:x1876037604991872:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130228.973393:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:37035:x1876037604991872:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 797us (1130us total) trans 30064771413 rc 0/0 00000100:00100000:1.0:1789130228.973403:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:0.0:1789130229.046800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130229.046924:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992000 00000100:00100000:3.0:1789130229.046937:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992000 00000100:00100000:3.0:1789130229.047025:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 386 00000100:00100000:3.0:1789130229.047038:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:37041:x1876037604992000:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130229.047076:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130229.047104:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea181 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac022 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047219:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047237:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047251:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047268:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047275:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047282:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047410:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047420:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047427:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130229.047467:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:3.0:1789130229.047472:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130229.047494:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047518:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047527:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047533:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047540:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047547:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb9c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130229.047552:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047561:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047575:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130229.047579:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130229.047585:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047592:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea188 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047663:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047669:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047682:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047687:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb9800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130229.047690:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047695:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047703:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff90b488939b00) 00010000:00010000:3.0:1789130229.047705:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130229.047708:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047715:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea18f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047752:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea181 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac022 expref: 53 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047767:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac022 expref: 52 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130229.047775:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:3.0:1789130229.047777:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130229.047780:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb9400, rc 0) 00000100:00100000:3.0:1789130229.047860:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:37041:x1876037604992000:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 824us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130229.047889:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 386 00000100:00100000:2.0:1789130229.053522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130229.053718:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992256 00000100:00100000:0.0:1789130229.053732:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992256 00000100:00100000:0.0:1789130229.053827:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 387 00000100:00100000:0.0:1789130229.053840:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:37041:x1876037604992256:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130229.053880:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130229.053911:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47cea19d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac029 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130229.054303:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea1a4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130229.054322:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea1a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130229.054337:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea1a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130229.054350:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:0.0:1789130229.054529:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47cea19d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac029 expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130229.054554:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea1a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac029 expref: 54 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130229.054565:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789130229.054568:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130229.054573:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:0.0:1789130229.054874:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:37041:x1876037604992256:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1028us (1373us total) trans 30064771414 rc 0/0 00000100:00100000:0.0:1789130229.054883:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 387 00000100:00100000:0.0:1789130229.059417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130229.059472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130229.059656:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992640 00000100:00100000:1.0:1789130229.059670:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992640 00000100:00100000:1.0:1789130229.059754:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130229.059768:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:2370:x1876037604992640:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130229.059791:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130229.059834:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea1a4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac029 expref: 54 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130229.059860:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130229.059876:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130229.059953:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:2370:x1876037604992640:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 187us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130229.059961:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130229.060711:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992512 00000100:00100000:2.0:1789130229.060719:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992512 00000100:00100000:2.0:1789130229.060761:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789130229.060771:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+53:37041:x1876037604992512:12345-192.168.201.39@tcp:35:lfs.0 00000001:00080000:2.0:1789130229.061274:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771415 00000100:00100000:2.0:1789130229.061511:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:37041:x1876037604992512:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 740us (2108us total) trans 30064771416 rc 0/0 00000100:00100000:2.0:1789130229.061520:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000020:00080000:2.0:1789130229.061525:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130229.190934:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130229.595560:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771179 is committed 00000001:00080000:1.0:1789130229.595647:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771180 is committed 00000001:00080000:1.0:1789130229.595685:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771181 is committed 00010000:00010000:0.0:1789130230.219757:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130231.238115:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130231.679794:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771414 is committed 00000004:00080000:3.0:1789130231.679839:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00080000:3.0:1789130231.679883:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000001:00080000:3.0:1789130231.679906:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771416 is committed 00000100:00100000:2.0:1789130231.682444:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626834176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789130231.682541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130231.682650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130231.682657:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626834304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130231.682691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130231.682725:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834176 00000100:00100000:2.0:1789130231.682734:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834176 00000100:00100000:2.0:1789130231.682799:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834304 00000100:00100000:2.0:1789130231.682803:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834304 00000100:00100000:2.0:1789130231.682843:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130231.682853:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626834176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789130231.683125:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1789130231.683130:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 1789130226 -> 1789130226 00002000:00010000:2.0:1789130231.683133:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130231.683135:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 1789130227 -> 1789130227 00002000:00010000:2.0:1789130231.683138:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1789130231.683178:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626834176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 326us (636us total) trans 30064771182 rc 0/0 00000100:00100000:2.0:1789130231.683186:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130231.683204:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130231.683223:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626834304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130231.683347:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1789130231.683350:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 1789130227 -> 1789130227 00002000:00010000:2.0:1789130231.683353:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130231.683355:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 1789130227 -> 1789130227 00002000:00010000:2.0:1789130231.683357:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1789130231.683379:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626834304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (687us total) trans 30064771251 rc 0/0 00000100:00100000:2.0:1789130231.683401:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789130231.683578:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130231.683583:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789130231.683650:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b486ed21c0/2, rc 0, transno 30064771251 00000100:00100000:2.0:1789130231.683657:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626834304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1789130231.683668:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b38274a580/2, rc 0, transno 30064771182 00000100:00100000:2.0:1789130231.683672:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626834176:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1789130231.688594:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771248 is committed 00000001:00080000:0.0:1789130231.688684:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771249 is committed 00000001:00080000:0.0:1789130231.688700:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771250 is committed 00000100:00100000:3.0:1789130232.070299:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626834432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130232.070403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130232.070630:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834432 00000100:00100000:2.0:1789130232.070639:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834432 00000100:00100000:2.0:1789130232.070706:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130232.070717:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626834432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130232.070770:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 172032000 pending 0 free 3788505088 avail 3786407936 00000100:00100000:2.0:1789130232.070871:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626834432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130232.070878:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130232.070932:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626834432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130232.071707:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626834560:0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.071775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130232.071831:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626835072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.071862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130232.071885:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130232.071890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626834944:0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.071910:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130232.071938:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835072 00000100:00100000:0.0:1789130232.071942:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835072 00000100:00100000:0.0:1789130232.071983:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834944 00000100:00100000:0.0:1789130232.071986:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834944 00000100:00100000:0.0:1789130232.072005:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789130232.072011:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.072051:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626835072:12345-0@lo:400:kworker.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130232.072057:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789130232.072068:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789130232.072073:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626834944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.072092:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626834944:12345-0@lo:400:kworker.0 Request processed in 20us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130232.072098:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789130232.072127:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626834944:0@lo:400:kworker.0 00000100:00100000:0.0:1789130232.072136:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626835072:0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072331:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626834816:0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130232.072376:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130232.072379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626834688:0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789130232.072416:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130232.072426:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834816 00000100:00100000:2.0:1789130232.072428:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834816 00000100:00100000:2.0:1789130232.072455:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130232.072483:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626834816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072524:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626834816:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130232.072532:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130232.072558:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834688 00000100:00100000:2.0:1789130232.072561:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834688 00000100:00100000:2.0:1789130232.072596:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130232.072626:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626834688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072658:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626834688:12345-0@lo:400:kworker.0 Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130232.072664:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130232.072690:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626834688:0@lo:400:kworker.0 00000100:00100000:2.0:1789130232.072699:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626834816:0@lo:400:kworker.0 00000100:00100000:1.0:1789130232.072853:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626834560 00000100:00100000:1.0:1789130232.072859:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626834560 00000100:00100000:1.0:1789130232.072913:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789130232.072922:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130232.072979:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626834560:12345-0@lo:400:kworker.0 Request processed in 59us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130232.072998:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789130232.073471:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626834560:0@lo:400:kworker.0 00010000:00010000:3.0:1789130232.266124:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130233.094573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130233.094626:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626835200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130233.094738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130233.095207:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835200 00000100:00100000:0.0:1789130233.095217:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835200 00000100:00100000:0.0:1789130233.095308:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130233.095322:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626835200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130233.095371:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 284491776 pending 0 free 3725590528 avail 3723493376 00000100:00100000:0.0:1789130233.095444:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626835200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130233.095452:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789130233.095558:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130233.096957:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626835200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130233.286410:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130233.376406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130233.376449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130233.376492:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992896 00000100:00100000:0.0:1789130233.376502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130233.376512:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992896 00000100:00100000:0.0:1789130233.376536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130233.376574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130233.376638:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993280 00000100:00100000:3.0:1789130233.376645:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993280 00000100:00100000:0.0:1789130233.376658:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130233.376677:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604992896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130233.376761:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604992896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130233.376769:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130233.376798:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1789130233.376805:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604993280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130233.376830:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037604993280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130233.376836:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:2.0:1789130233.376916:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993152 00000100:00100000:2.0:1789130233.376925:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993152 00000100:00100000:2.0:1789130233.376965:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993024 00000100:00100000:2.0:1789130233.376967:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993024 00000100:00100000:2.0:1789130233.376987:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130233.376993:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604993152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130233.377021:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+8:2367:x1876037604993152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130233.377027:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130233.377055:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:2.0:1789130233.377069:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604993024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130233.377221:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604993024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 152us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130233.377228:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00080000:2.0:1789130233.377249:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130233.377253:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130233.377256:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130233.385116:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604992768 00000100:00100000:1.0:1789130233.385132:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604992768 00000100:00100000:1.0:1789130233.385207:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:1.0:1789130233.385221:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604992768:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130233.385304:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037604992768:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 85us (8806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130233.385311:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:3.0:1789130234.239961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130234.240072:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993408 00000100:00100000:0.0:1789130234.240085:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993408 00000100:00100000:0.0:1789130234.240217:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 388 00000100:00100000:0.0:1789130234.240230:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:36983:x1876037604993408:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130234.240380:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:36983:x1876037604993408:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 151us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130234.240389:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 388 00000100:00100000:1.0:1789130234.245425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130234.245522:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993664 00000100:00100000:0.0:1789130234.245535:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993664 00000100:00100000:0.0:1789130234.245695:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789130234.245707:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:36983:x1876037604993664:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130234.246744:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:36983:x1876037604993664:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1034us (1328us total) trans 30064771417 rc 0/0 00000100:00100000:3.0:1789130234.246756:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00010000:00010000:3.0:1789130234.309962:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130234.411403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130234.411667:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993792 00000100:00100000:0.0:1789130234.411679:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993792 00000100:00100000:0.0:1789130234.411780:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 389 00000100:00100000:0.0:1789130234.411793:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:37481:x1876037604993792:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130234.411822:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130234.411855:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea1b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac030 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.411947:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.411966:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.411986:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130234.412324:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130234.412330:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130234.412432:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.412485:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea1b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 7 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.412510:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 6 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130234.412520:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:0.0:1789130234.412523:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130234.412528:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656e00, rc 0) 00000100:00100000:0.0:1789130234.412699:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:37481:x1876037604993792:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 908us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130234.412707:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 389 00000001:00080000:1.0:1789130234.707430:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771182 is committed 00010000:00010000:1.0:1789130235.334272:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130236.357844:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130236.709285:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771251 is committed 00000001:00080000:3.0:1789130236.738122:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771417 is committed 00000040:00080000:3.0:1789130236.806190:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130236.806199:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130236.806271:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 4 00000040:00080000:3.0:1789130236.806279:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130237.189958:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626835584:0@lo:400:kworker.0 00000100:00100000:3.0:1789130237.190052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130237.190132:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789130237.190139:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626835456:0@lo:400:kworker.0 00000100:00100000:3.0:1789130237.190164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130237.190182:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626835968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130237.190206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130237.190237:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835584 00000100:00100000:3.0:1789130237.190244:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835584 00000100:00100000:3.0:1789130237.190307:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835456 00000100:00100000:3.0:1789130237.190311:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835456 00000100:00100000:3.0:1789130237.190335:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130237.190344:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626835584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130237.190628:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130237.190640:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130237.190700:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626835456:12345-0@lo:400:kworker.0 Request processed in 64us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130237.190708:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130237.190772:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771251 gen 2 00000004:00080000:0.0:1789130237.190778:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b486ed21c0, transno 30064771251 00000100:00100000:0.0:1789130237.190790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626835456:0@lo:400:kworker.0 00000100:00100000:3.0:1789130237.190907:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626835584:12345-0@lo:400:kworker.0 Request processed in 564us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130237.190913:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130237.191116:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771182 gen 2 00000004:00080000:0.0:1789130237.191120:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b38274a580, transno 30064771182 00000100:00100000:0.0:1789130237.191141:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626835584:0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192025:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626835328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130237.192130:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626835840:0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130237.192188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130237.192203:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626835712:0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130237.192545:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835968 00000100:00100000:1.0:1789130237.192552:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835968 00000100:00100000:1.0:1789130237.192592:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835840 00000100:00100000:1.0:1789130237.192596:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835840 00000100:00100000:1.0:1789130237.192638:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835712 00000100:00100000:1.0:1789130237.192647:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835712 00000100:00100000:1.0:1789130237.192667:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789130237.192675:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626835968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192733:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626835968:12345-0@lo:400:kworker.0 Request processed in 58us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130237.192741:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789130237.192756:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789130237.192762:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626835840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192795:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626835840:12345-0@lo:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130237.192802:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789130237.192814:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789130237.192820:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626835712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192856:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626835712:12345-0@lo:400:kworker.0 Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130237.192863:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789130237.192897:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626835712:0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.192908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626835840:0@lo:400:kworker.0 00000100:00080000:2.0:1789130237.198796:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130237.198808:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130237.198811:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130237.198947:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130237.198967:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626836096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130237.199049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130237.199388:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626835328 00000100:00100000:2.0:1789130237.199397:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626835328 00000100:00100000:1.0:1789130237.199414:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836096 00000100:00100000:1.0:1789130237.199418:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836096 00000100:00100000:2.0:1789130237.199452:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789130237.199452:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789130237.199462:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626835328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130237.199462:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626836096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130237.199495:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 172032000 pending 0 free 3788505088 avail 3786407936 00000100:00100000:2.0:1789130237.199515:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626835328:12345-0@lo:400:kworker.0 Request processed in 54us (7436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130237.199522:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789130237.199529:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626836096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130237.199552:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130237.199647:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626835328:0@lo:400:kworker.0 00000100:00100000:2.0:1789130237.199789:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626836096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130237.205271:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626835968:0@lo:400:kworker.0 00010000:00010000:1.0:1789130237.390219:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130237.944830:0:40383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 08:37:16 (1789130236) 00000100:00100000:3.0:1789130238.215476:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130238.215512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626836224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130238.215627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130238.215873:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836224 00000100:00100000:1.0:1789130238.215881:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836224 00000100:00100000:1.0:1789130238.215934:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789130238.215944:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626836224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130238.215982:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 284491776 pending 0 free 3725590528 avail 3723493376 00000100:00100000:1.0:1789130238.216036:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626836224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130238.216043:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130238.216139:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626836224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130238.405953:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130238.502096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130238.502143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130238.502191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130238.502218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130238.502243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130238.502271:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994432 00000100:00100000:1.0:1789130238.502281:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994432 00000100:00100000:1.0:1789130238.502335:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994048 00000100:00100000:1.0:1789130238.502339:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994048 00000100:00100000:1.0:1789130238.502365:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:1.0:1789130238.502375:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604994432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130238.502449:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604994432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130238.502457:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:1.0:1789130238.502474:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:1.0:1789130238.502480:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604994048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130238.502526:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604994048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130238.502533:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:3.0:1789130238.502838:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994176 00000100:00100000:3.0:1789130238.502843:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994176 00000100:00100000:3.0:1789130238.502892:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994304 00000100:00100000:3.0:1789130238.502895:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994304 00000100:00100000:3.0:1789130238.502916:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130238.502922:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604994176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130238.502951:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037604994176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130238.502969:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130238.502981:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1789130238.502987:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604994304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130238.503011:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2370:x1876037604994304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130238.503017:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130238.504054:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604993920 00000100:00100000:2.0:1789130238.504065:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604993920 00000100:00100000:2.0:1789130238.504117:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789130238.504126:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604993920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130238.504433:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037604993920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 306us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130238.504442:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00080000:2.0:1789130238.504486:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130238.504491:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130238.504495:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130239.432232:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130239.991319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130239.991441:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994688 00000100:00100000:0.0:1789130239.991452:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994688 00000100:00100000:0.0:1789130239.991515:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 390 00000100:00100000:0.0:1789130239.991524:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+33:37764:x1876037604994688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130239.991545:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130239.991566:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea1c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac037 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991686:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991701:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991715:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991731:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991737:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.991744:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992253:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea1d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992268:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992276:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130239.992286:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130239.992469:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992477:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992484:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992490:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130239.992495:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992503:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992515:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130239.992518:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130239.992522:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992529:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea1c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992541:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992547:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992552:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992557:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130239.992560:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992566:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992572:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b497c01c00) 00010000:00010000:0.0:1789130239.992575:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130239.992577:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.992583:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.993005:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea1c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac037 expref: 36 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.993021:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac037 expref: 35 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130239.993029:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130239.993032:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130239.993035:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656600, rc 0) 00000100:00100000:0.0:1789130239.993110:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+35:37764:x1876037604994688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1586us (1799us total) trans 30064771418 rc 0/0 00000100:00100000:0.0:1789130239.993119:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 390 00000100:00100000:1.0:1789130239.999821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130239.999863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.000355:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994816 00000100:00100000:3.0:1789130240.000367:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994816 00000100:00100000:3.0:1789130240.000441:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 391 00000100:00100000:3.0:1789130240.000451:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:37764:x1876037604994816:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130240.000577:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:37764:x1876037604994816:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 127us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130240.000584:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 391 00000100:00100000:2.0:1789130240.003276:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604994944 00000100:00100000:2.0:1789130240.003292:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604994944 00000100:00100000:2.0:1789130240.003380:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130240.003390:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+35:2369:x1876037604994944:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130240.003405:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130240.003429:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea1d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac037 expref: 35 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.003446:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130240.003452:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130240.003506:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:2369:x1876037604994944:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 118us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130240.003513:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00080000:0.0:1789130240.004717:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130240.189486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.189576:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995200 00000100:00100000:2.0:1789130240.189586:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995200 00000100:00100000:2.0:1789130240.189681:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 392 00000100:00100000:2.0:1789130240.189692:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+34:37779:x1876037604995200:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:2.0:1789130240.189748:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130240.189776:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce9ff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf9d expref: 34 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.189816:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:2.0:1789130240.189821:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130240.190101:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.190116:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.190126:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.190170:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 5 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.190185:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 5 pid: 36589 timeout: 1503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130240.190199:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626836352:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130240.190300:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130240.194834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.194938:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626836352:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130240.194968:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130240.195085:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995328 00000100:00100000:3.0:1789130240.195094:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995328 00010000:00010000:3.0:1789130240.195163:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 6 pid: 36589 timeout: 1503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130240.195208:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789130240.195217:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037604995328:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130240.195235:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130240.195241:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 6 pid: 36589 timeout: 1503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195276:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 6 pid: 36589 timeout: 1503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195300:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea1b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac030 expref: 6 pid: 36589 timeout: 1503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195317:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:3.0:1789130240.195323:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195335:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195343:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130240.195371:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130240.195438:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037604995328:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 222us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130240.195446:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00010000:00010000:2.0:1789130240.196306:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.196317:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.196352:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.196362:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.196370:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130240.197741:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00010000:00010000:2.0:1789130240.197757:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197766:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197774:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197780:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130240.197785:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197792:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197807:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939100) 00010000:00010000:2.0:1789130240.197810:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130240.197814:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.197832:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea1e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130240.197854:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f97ed32 reply state 000000006710a319 transno 30064771419 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130240.197863:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130240.197962:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+35:37779:x1876037604995200:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 8268us (8481us total) trans 30064771419 rc 0/0 00000100:00100000:2.0:1789130240.197970:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 392 00000100:00080000:0.0:1789130240.203154:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130240.206848:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206866:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206873:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206880:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130240.206884:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206891:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206909:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130240.206913:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130240.206917:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.206944:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea1ea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130240.208559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.208688:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995456 00000100:00100000:0.0:1789130240.208700:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995456 00000100:00100000:0.0:1789130240.208762:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 393 00000100:00100000:0.0:1789130240.208773:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+34:37780:x1876037604995456:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130240.208798:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130240.208821:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea1f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac03e expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.208885:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.208898:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.208909:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130240.208967:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130240.208971:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130240.208993:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.209016:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea1f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac03e expref: 36 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.209032:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac03e expref: 35 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.209040:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130240.209043:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130240.209046:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656a00, rc 0) 00000100:00100000:0.0:1789130240.209111:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+35:37780:x1876037604995456:12345-192.168.201.39@tcp:101:dd.0 Request processed in 341us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130240.209119:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 393 00000100:00100000:0.0:1789130240.216879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130240.216971:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995584 00000100:00100000:1.0:1789130240.216982:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995584 00000100:00100000:1.0:1789130240.217038:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 394 00000100:00100000:1.0:1789130240.217049:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+35:37780:x1876037604995584:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130240.217069:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130240.217090:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea1ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac045 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217167:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217182:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217194:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217211:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217217:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217243:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217366:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217375:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217382:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130240.217411:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00000004:00200000:1.0:1789130240.217414:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130240.217435:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217446:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217453:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217460:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217466:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130240.217469:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217476:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217494:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130240.217496:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130240.217502:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217509:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217521:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217526:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217532:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217537:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130240.217540:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217546:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217552:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130240.217554:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130240.217556:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217562:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea20d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217598:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea1ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac045 expref: 37 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217650:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac045 expref: 36 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.217657:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130240.217659:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130240.217662:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34600, rc 0) 00000100:00100000:1.0:1789130240.217722:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:37780:x1876037604995584:12345-192.168.201.39@tcp:101:dd.0 Request processed in 675us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130240.217729:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 394 00000100:00100000:1.0:1789130240.222130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.222305:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995840 00000100:00100000:2.0:1789130240.222317:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995840 00000100:00100000:2.0:1789130240.222390:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 395 00000100:00100000:2.0:1789130240.222402:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+36:37780:x1876037604995840:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130240.222423:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130240.222446:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea21b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac04c expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222647:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222693:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222708:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222725:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222733:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.222739:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130240.223343:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcb:0x0], index 1: 0 00010000:00010000:2.0:1789130240.223532:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea230 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223542:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea230 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223551:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea230 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223583:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223590:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223597:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223635:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130240.223640:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223647:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223660:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:2.0:1789130240.223674:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130240.223680:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223687:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea222 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130240.223712:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000afdff29f reply state 00000000d6e6e89f transno 30064771420 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130240.223721:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130240.223753:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86a00/0x5c74554e47cea21b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac04c expref: 39 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223766:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea230 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac04c expref: 38 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.223774:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130240.223777:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130240.223779:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86e00, rc 0) 00000100:00100000:2.0:1789130240.223854:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:37780:x1876037604995840:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1454us (1735us total) trans 30064771420 rc 0/0 00000100:00100000:2.0:1789130240.223863:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 395 00010000:00010000:1.0:1789130240.232246:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232263:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232270:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232280:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00000100:00100000:3.0:1789130240.232281:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130240.232285:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232294:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232330:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff90b4976b8800) 00010000:00010000:1.0:1789130240.232334:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130240.232343:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130240.232350:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea229 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130240.232386:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604995968 00000100:00100000:2.0:1789130240.232396:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604995968 00000100:00100000:2.0:1789130240.232476:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1789130240.232488:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+8:37780:x1876037604995968:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130240.232506:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130240.232524:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c5e734/0x5c74554e47cea23e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac053 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130240.232549:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130240.232569:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=1403s v=(0 0) 00010000:00010000:2.0:1789130240.232580:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130240.232590:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c5e734/0x5c74554e47cea23e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac053 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130240.232633:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789130240.232645:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1c5e734/0x5c74554e47cea23e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac053 expref: 9 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.232658:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86a00, rc 0) 00000100:00100000:2.0:1789130240.232732:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+9:37780:x1876037604995968:12345-192.168.201.39@tcp:101:dd.0 Request processed in 247us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130240.232740:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:3.0:1789130240.257068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.257210:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996096 00000100:00100000:2.0:1789130240.257220:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996096 00002000:00100000:2.0:1789130240.257274:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff90b4bd9a4b40 x1876037604996096/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.257285:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4b40 with x1876037604996096 ext(0->1048575) 00002000:00010000:2.0:1789130240.257291:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bd9a4b40 00000100:00100000:2.0:1789130240.257324:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:2.0:1789130240.257333:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+9:2367:x1876037604996096:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.284267:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037604996096:12345-192.168.201.39@tcp:4:dd.0 Request processed in 26925us (27200us total) trans 30064771183 rc 0/0 00000100:00100000:2.0:1789130240.284281:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 286 00002000:00100000:2.0:1789130240.284293:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff90b4bd9a4b40 x1876037604996096/t30064771183(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.284304:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a4b40 with x1876037604996096 ext(0->1048575) 00002000:00010000:2.0:1789130240.284325:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bd9a4b40 00000100:00100000:3.0:1789130240.305136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.305276:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996224 00000100:00100000:0.0:1789130240.305299:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996224 00002000:00100000:0.0:1789130240.305544:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff90b4bd9a7c00 x1876037604996224/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.305558:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a7c00 with x1876037604996224 ext(1048576->2097151) 00002000:00010000:0.0:1789130240.305566:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bd9a7c00 00000100:00100000:0.0:1789130240.305700:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 287 00000100:00100000:0.0:1789130240.305714:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037604996224:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.328417:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037604996224:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22695us (23286us total) trans 30064771184 rc 0/0 00000100:00100000:2.0:1789130240.328432:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 287 00002000:00100000:2.0:1789130240.328445:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff90b4bd9a7c00 x1876037604996224/t30064771184(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.328457:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bd9a7c00 with x1876037604996224 ext(1048576->2097151) 00002000:00010000:2.0:1789130240.328465:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bd9a7c00 00000100:00100000:1.0:1789130240.358724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.360540:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996352 00000100:00100000:0.0:1789130240.360561:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996352 00002000:00100000:0.0:1789130240.360705:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff90b486ed1a40 x1876037604996352/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.360717:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed1a40 with x1876037604996352 ext(2097152->3145727) 00002000:00010000:0.0:1789130240.360726:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed1a40 00000100:00100000:0.0:1789130240.360760:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00100000:0.0:1789130240.360772:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037604996352:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.381885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.382011:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996480 00000100:00100000:3.0:1789130240.382025:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996480 00002000:00100000:3.0:1789130240.382092:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff90b384a70000 x1876037604996480/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.382130:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a70000 with x1876037604996480 ext(3145728->4194303) 00002000:00010000:3.0:1789130240.382138:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a70000 00000100:00100000:3.0:1789130240.382182:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 289 00000100:00100000:3.0:1789130240.382194:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604996480:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.387974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.388083:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996608 00000100:00100000:3.0:1789130240.388097:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996608 00002000:00100000:3.0:1789130240.388162:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff90b384a70f00 x1876037604996608/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.388176:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a70f00 with x1876037604996608 ext(4194304->5242879) 00002000:00010000:3.0:1789130240.388183:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a70f00 00000100:00100000:3.0:1789130240.388221:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 290 00000100:00100000:3.0:1789130240.388232:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037604996608:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.404574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.408644:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996736 00000100:00100000:0.0:1789130240.408677:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996736 00002000:00100000:0.0:1789130240.408758:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff90b3832b6d00 x1876037604996736/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.408771:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6d00 with x1876037604996736 ext(5242880->6291455) 00002000:00010000:0.0:1789130240.408779:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3832b6d00 00000100:00100000:0.0:1789130240.408950:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 291 00000100:00100000:0.0:1789130240.408964:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+19:2369:x1876037604996736:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.421101:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+21:2370:x1876037604996352:12345-192.168.201.39@tcp:4:dd.0 Request processed in 60314us (62377us total) trans 30064771185 rc 0/0 00000100:00100000:0.0:1789130240.421121:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 288 00002000:00100000:0.0:1789130240.421138:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff90b486ed1a40 x1876037604996352/t30064771185(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.421149:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed1a40 with x1876037604996352 ext(2097152->3145727) 00002000:00010000:0.0:1789130240.421159:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed1a40 00000100:00100000:0.0:1789130240.449214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.449281:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996864 00000100:00100000:0.0:1789130240.449294:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996864 00002000:00100000:0.0:1789130240.449361:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff90b384a71a40 x1876037604996864/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.449381:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71a40 with x1876037604996864 ext(6291456->7340031) 00002000:00010000:0.0:1789130240.449389:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a71a40 00000100:00100000:0.0:1789130240.449421:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 292 00000100:00100000:0.0:1789130240.449433:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037604996864:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.452366:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+23:2370:x1876037604996480:12345-192.168.201.39@tcp:4:dd.0 Request processed in 70160us (70482us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1789130240.452384:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 289 00002000:00100000:2.0:1789130240.452400:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff90b384a70000 x1876037604996480/t30064771186(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.452412:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a70000 with x1876037604996480 ext(3145728->4194303) 00002000:00010000:2.0:1789130240.452420:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a70000 00000100:00100000:2.0:1789130240.461567:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+23:2370:x1876037604996608:12345-192.168.201.39@tcp:4:dd.0 Request processed in 73321us (73592us total) trans 30064771187 rc 0/0 00000100:00100000:2.0:1789130240.461586:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 290 00002000:00100000:2.0:1789130240.461630:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff90b384a70f00 x1876037604996608/t30064771187(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.461643:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a70f00 with x1876037604996608 ext(4194304->5242879) 00002000:00010000:2.0:1789130240.461652:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a70f00 00010000:00010000:3.0:1789130240.466495:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130240.476131:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2369:x1876037604996736:12345-192.168.201.39@tcp:4:dd.0 Request processed in 67151us (71553us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1789130240.476177:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 291 00002000:00100000:0.0:1789130240.476196:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff90b3832b6d00 x1876037604996736/t30064771188(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.476208:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b6d00 with x1876037604996736 ext(5242880->6291455) 00002000:00010000:0.0:1789130240.476217:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3832b6d00 00000100:00100000:0.0:1789130240.480416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.484068:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604996992 00000100:00100000:3.0:1789130240.484093:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604996992 00002000:00100000:3.0:1789130240.484171:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff90b384a73480 x1876037604996992/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.484185:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a73480 with x1876037604996992 ext(7340032->8388607) 00002000:00010000:3.0:1789130240.484192:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a73480 00000100:00100000:3.0:1789130240.484248:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 293 00000100:00100000:3.0:1789130240.484260:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+23:2367:x1876037604996992:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.495588:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+25:2367:x1876037604996864:12345-192.168.201.39@tcp:4:dd.0 Request processed in 46138us (46370us total) trans 30064771189 rc 0/0 00000100:00100000:2.0:1789130240.497348:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 292 00002000:00100000:2.0:1789130240.497370:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff90b384a71a40 x1876037604996864/t30064771189(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.497382:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a71a40 with x1876037604996864 ext(6291456->7340031) 00002000:00010000:2.0:1789130240.497391:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a71a40 00000100:00100000:2.0:1789130240.509173:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+25:2367:x1876037604996992:12345-192.168.201.39@tcp:4:dd.0 Request processed in 24898us (28759us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1789130240.509190:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 293 00002000:00100000:2.0:1789130240.509205:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff90b384a73480 x1876037604996992/t30064771190(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.509218:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a73480 with x1876037604996992 ext(7340032->8388607) 00002000:00010000:2.0:1789130240.509226:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a73480 00000100:00100000:3.0:1789130240.511881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.512021:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997120 00000100:00100000:0.0:1789130240.512034:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997120 00002000:00100000:0.0:1789130240.512110:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff90b3832b5a40 x1876037604997120/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.512124:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b5a40 with x1876037604997120 ext(8388608->9437183) 00002000:00010000:0.0:1789130240.512132:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3832b5a40 00000100:00100000:0.0:1789130240.512183:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 294 00000100:00100000:0.0:1789130240.512194:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+25:2370:x1876037604997120:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.532016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.532367:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997248 00000100:00100000:2.0:1789130240.532382:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997248 00002000:00100000:2.0:1789130240.532451:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff90b384a72580 x1876037604997248/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.532465:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72580 with x1876037604997248 ext(9437184->10485759) 00002000:00010000:2.0:1789130240.532475:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72580 00000100:00100000:2.0:1789130240.532516:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 295 00000100:00100000:2.0:1789130240.532527:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+27:2368:x1876037604997248:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.541570:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037604997120:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22094us (22423us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1789130240.541594:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 294 00002000:00100000:2.0:1789130240.542147:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff90b3832b5a40 x1876037604997120/t30064771191(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.542162:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3832b5a40 with x1876037604997120 ext(8388608->9437183) 00002000:00010000:2.0:1789130240.542173:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3832b5a40 00000100:00100000:2.0:1789130240.545468:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+29:2368:x1876037604997248:12345-192.168.201.39@tcp:4:dd.0 Request processed in 12926us (13451us total) trans 30064771192 rc 0/0 00000100:00100000:2.0:1789130240.545486:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 295 00002000:00100000:2.0:1789130240.545502:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff90b384a72580 x1876037604997248/t30064771192(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.545515:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72580 with x1876037604997248 ext(9437184->10485759) 00002000:00010000:2.0:1789130240.545524:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72580 00000100:00100000:1.0:1789130240.556801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.556924:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997376 00000100:00100000:0.0:1789130240.556938:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997376 00002000:00100000:0.0:1789130240.557014:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff90b486ed0780 x1876037604997376/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.557029:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed0780 with x1876037604997376 ext(10485760->11534335) 00002000:00010000:0.0:1789130240.557039:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed0780 00000100:00100000:0.0:1789130240.557086:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 296 00000100:00100000:0.0:1789130240.557098:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+29:2367:x1876037604997376:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.571486:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604997376:12345-192.168.201.39@tcp:4:dd.0 Request processed in 14371us (14683us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1789130240.571506:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 296 00002000:00100000:3.0:1789130240.571524:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff90b486ed0780 x1876037604997376/t30064771193(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.571537:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed0780 with x1876037604997376 ext(10485760->11534335) 00002000:00010000:3.0:1789130240.571547:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed0780 00000100:00100000:0.0:1789130240.579363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.579487:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997504 00000100:00100000:2.0:1789130240.579502:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997504 00002000:00100000:2.0:1789130240.579576:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff90b384a72940 x1876037604997504/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.579591:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72940 with x1876037604997504 ext(11534336->12582911) 00002000:00010000:2.0:1789130240.579599:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72940 00000100:00100000:2.0:1789130240.579701:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 297 00000100:00100000:2.0:1789130240.579713:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037604997504:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.591935:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+33:2367:x1876037604997504:12345-192.168.201.39@tcp:4:dd.0 Request processed in 12206us (12572us total) trans 30064771194 rc 0/0 00000100:00100000:2.0:1789130240.591955:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 297 00002000:00100000:2.0:1789130240.591978:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff90b384a72940 x1876037604997504/t30064771194(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.592015:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a72940 with x1876037604997504 ext(11534336->12582911) 00002000:00010000:2.0:1789130240.592024:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a72940 00000100:00100000:0.0:1789130240.601916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.602188:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997632 00000100:00100000:2.0:1789130240.602203:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997632 00002000:00100000:2.0:1789130240.602282:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff90b384a703c0 x1876037604997632/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.602361:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a703c0 with x1876037604997632 ext(12582912->13631487) 00002000:00010000:2.0:1789130240.602370:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a703c0 00000100:00100000:2.0:1789130240.602413:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 298 00000100:00100000:2.0:1789130240.602425:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+33:2370:x1876037604997632:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.612391:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604997632:12345-192.168.201.39@tcp:4:dd.0 Request processed in 9953us (10478us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1789130240.612412:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 298 00002000:00100000:2.0:1789130240.612427:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff90b384a703c0 x1876037604997632/t30064771195(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.612439:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a703c0 with x1876037604997632 ext(12582912->13631487) 00002000:00010000:2.0:1789130240.612448:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384a703c0 00000100:00100000:3.0:1789130240.624906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.625096:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997760 00000100:00100000:2.0:1789130240.625110:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997760 00002000:00100000:2.0:1789130240.625184:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff90b382f8c3c0 x1876037604997760/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.625199:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c3c0 with x1876037604997760 ext(13631488->14680063) 00002000:00010000:2.0:1789130240.625207:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8c3c0 00000100:00100000:2.0:1789130240.625280:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 299 00000100:00100000:2.0:1789130240.625365:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+35:2370:x1876037604997760:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130240.650966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130240.651037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.651184:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998144 00000100:00100000:3.0:1789130240.651199:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998144 00000100:00100000:3.0:1789130240.651282:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789130240.651303:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48615c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+38:37780:x1876037604998144:12345-192.168.201.39@tcp:35:dd.0 00000001:00080000:3.0:1789130240.651779:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771421 00000100:00100000:3.0:1789130240.651930:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48615c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:37780:x1876037604998144:12345-192.168.201.39@tcp:35:dd.0 Request processed in 629us (981us total) trans 30064771422 rc 0/0 00000100:00100000:3.0:1789130240.651940:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000020:00080000:3.0:1789130240.651946:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130240.652779:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604997888 00000100:00100000:2.0:1789130240.652791:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604997888 00002000:00100000:2.0:1789130240.652848:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff90b4c1966580 x1876037604997888/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.652861:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966580 with x1876037604997888 ext(14680064->15728639) 00002000:00010000:2.0:1789130240.652869:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1966580 00000100:00100000:2.0:1789130240.652907:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 300 00000100:00100000:2.0:1789130240.652917:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+37:2369:x1876037604997888:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.668213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.668440:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998400 00000100:00100000:0.0:1789130240.668455:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998400 00000100:00100000:0.0:1789130240.668543:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 396 00000100:00100000:0.0:1789130240.668557:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:37782:x1876037604998400:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130240.668594:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130240.668683:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea245 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac05a expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668862:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668881:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668895:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668914:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668927:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.668934:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130240.671039:0:36587:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcb:0x0], index 0: 0 00010000:00010000:0.0:1789130240.671322:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea25a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671341:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea25a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671354:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea25a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671406:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671414:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671421:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671428:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130240.671433:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671441:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671462:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130240.671465:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130240.671473:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671479:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47cea24c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130240.671497:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a12da721 reply state 000000007d30d51b transno 30064771423 ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130240.671508:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130240.671554:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47cea245 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac05a expref: 43 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671570:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea25a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac05a expref: 42 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.671579:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130240.671582:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130240.671585:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657000, rc 0) 00000100:00100000:0.0:1789130240.671782:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:37782:x1876037604998400:12345-192.168.201.39@tcp:101:dd.0 Request processed in 3226us (3585us total) trans 30064771423 rc 0/0 00000100:00100000:0.0:1789130240.671804:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 396 00000100:00100000:0.0:1789130240.691779:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+39:2370:x1876037604997760:12345-192.168.201.39@tcp:4:dd.0 Request processed in 66401us (66873us total) trans 30064771196 rc 0/0 00000100:00100000:0.0:1789130240.691798:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 299 00002000:00100000:0.0:1789130240.691814:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff90b382f8c3c0 x1876037604997760/t30064771196(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.691827:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8c3c0 with x1876037604997760 ext(13631488->14680063) 00002000:00010000:0.0:1789130240.691835:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b382f8c3c0 00000100:00100000:1.0:1789130240.696460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130240.696583:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696649:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696667:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696676:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130240.696682:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696692:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696717:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff90b497c01500) 00010000:00010000:2.0:1789130240.696720:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130240.696749:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130240.696756:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47cea253 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130240.697017:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998528 00000100:00100000:0.0:1789130240.697031:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998528 00000100:00100000:0.0:1789130240.697135:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:0.0:1789130240.697149:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:37782:x1876037604998528:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130240.697176:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130240.697204:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856aa987/0x5c74554e47cea268 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac061 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130240.697241:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130240.697273:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=1403s v=(0 0) 00010000:00010000:0.0:1789130240.697279:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1789130240.697532:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130240.697825:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856aa987/0x5c74554e47cea268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac061 expref: 12 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.697848:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000856aa987/0x5c74554e47cea268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac061 expref: 12 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130240.697863:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656800, rc 0) 00000100:00100000:2.0:1789130240.698165:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:37782:x1876037604998528:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1018us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130240.698175:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:2.0:1789130240.728293:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037604997888:12345-192.168.201.39@tcp:4:dd.0 Request processed in 75353us (77231us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1789130240.728313:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 300 00002000:00100000:2.0:1789130240.728332:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff90b4c1966580 x1876037604997888/t30064771197(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.728344:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966580 with x1876037604997888 ext(14680064->15728639) 00002000:00010000:2.0:1789130240.728353:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1966580 00000100:00100000:1.0:1789130240.736949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.737422:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998656 00000100:00100000:3.0:1789130240.737439:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998656 00002000:00100000:3.0:1789130240.737517:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff90b4c1965e00 x1876037604998656/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.737533:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1965e00 with x1876037604998656 ext(0->1048575) 00002000:00010000:3.0:1789130240.737541:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1965e00 00000100:00100000:3.0:1789130240.737583:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 301 00000100:00100000:3.0:1789130240.737595:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037604998656:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130240.769763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.771409:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998784 00000100:00100000:0.0:1789130240.771430:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998784 00002000:00100000:0.0:1789130240.771507:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff90b4c1966d00 x1876037604998784/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.771520:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966d00 with x1876037604998784 ext(1048576->2097151) 00002000:00010000:0.0:1789130240.771529:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1966d00 00000100:00100000:2.0:1789130240.771669:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604998656:12345-192.168.201.39@tcp:4:dd.0 Request processed in 34063us (34734us total) trans 30064771252 rc 0/0 00000100:00100000:2.0:1789130240.771682:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 301 00002000:00100000:2.0:1789130240.771690:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff90b4c1965e00 x1876037604998656/t30064771252(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789130240.771694:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 302 00002000:00100000:2.0:1789130240.771698:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1965e00 with x1876037604998656 ext(0->1048575) 00002000:00010000:2.0:1789130240.771702:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1965e00 00000100:00100000:0.0:1789130240.771705:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037604998784:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.786228:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037604998784:12345-192.168.201.39@tcp:4:dd.0 Request processed in 14507us (16606us total) trans 30064771253 rc 0/0 00000100:00100000:3.0:1789130240.786248:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 302 00002000:00100000:3.0:1789130240.786269:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff90b4c1966d00 x1876037604998784/t30064771253(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.786296:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966d00 with x1876037604998784 ext(1048576->2097151) 00002000:00010000:3.0:1789130240.786306:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1966d00 00000100:00100000:0.0:1789130240.798463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.798729:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604998912 00000100:00100000:2.0:1789130240.798743:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604998912 00002000:00100000:2.0:1789130240.798818:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff90b38274a940 x1876037604998912/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.798850:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a940 with x1876037604998912 ext(2097152->3145727) 00002000:00010000:2.0:1789130240.798859:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274a940 00000100:00100000:2.0:1789130240.798955:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 303 00000100:00100000:2.0:1789130240.798967:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:2367:x1876037604998912:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.812005:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+18:2367:x1876037604998912:12345-192.168.201.39@tcp:4:dd.0 Request processed in 13025us (13546us total) trans 30064771254 rc 0/0 00000100:00100000:2.0:1789130240.812022:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 303 00002000:00100000:2.0:1789130240.812038:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff90b38274a940 x1876037604998912/t30064771254(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.812050:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a940 with x1876037604998912 ext(2097152->3145727) 00002000:00010000:2.0:1789130240.812059:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274a940 00000100:00100000:0.0:1789130240.822810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.823048:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999040 00000100:00100000:2.0:1789130240.823064:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999040 00002000:00100000:2.0:1789130240.823139:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff90b38274a580 x1876037604999040/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.823153:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a580 with x1876037604999040 ext(3145728->4194303) 00002000:00010000:2.0:1789130240.823162:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274a580 00000100:00100000:2.0:1789130240.823205:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 304 00000100:00100000:2.0:1789130240.823217:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037604999040:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.857173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.861928:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:2370:x1876037604999040:12345-192.168.201.39@tcp:4:dd.0 Request processed in 38693us (39114us total) trans 30064771255 rc 0/0 00000100:00100000:2.0:1789130240.861948:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 304 00002000:00100000:2.0:1789130240.861989:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff90b38274a580 x1876037604999040/t30064771255(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.862002:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274a580 with x1876037604999040 ext(3145728->4194303) 00002000:00010000:2.0:1789130240.862012:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38274a580 00000100:00100000:2.0:1789130240.862050:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999168 00000100:00100000:2.0:1789130240.862060:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999168 00002000:00100000:2.0:1789130240.862111:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff90b38975f0c0 x1876037604999168/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.862121:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975f0c0 with x1876037604999168 ext(4194304->5242879) 00002000:00010000:2.0:1789130240.862125:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975f0c0 00000100:00100000:2.0:1789130240.862166:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:2.0:1789130240.862179:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037604999168:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.876986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130240.877515:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999296 00000100:00100000:2.0:1789130240.877531:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999296 00002000:00100000:2.0:1789130240.877650:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff90b382f8e1c0 x1876037604999296/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.877675:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8e1c0 with x1876037604999296 ext(5242880->6291455) 00002000:00010000:2.0:1789130240.877684:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8e1c0 00000100:00100000:2.0:1789130240.877727:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:2.0:1789130240.877741:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:2370:x1876037604999296:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130240.892687:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+24:2369:x1876037604999168:12345-192.168.201.39@tcp:4:dd.0 Request processed in 30497us (35518us total) trans 30064771256 rc 0/0 00000100:00100000:2.0:1789130240.892704:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 305 00002000:00100000:2.0:1789130240.892722:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff90b38975f0c0 x1876037604999168/t30064771256(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.892750:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975f0c0 with x1876037604999168 ext(4194304->5242879) 00002000:00010000:2.0:1789130240.892759:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975f0c0 00000100:00100000:2.0:1789130240.900571:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+24:2370:x1876037604999296:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22815us (23585us total) trans 30064771257 rc 0/0 00000100:00100000:2.0:1789130240.900589:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 306 00002000:00100000:2.0:1789130240.900634:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff90b382f8e1c0 x1876037604999296/t30064771257(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130240.900644:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8e1c0 with x1876037604999296 ext(5242880->6291455) 00002000:00010000:2.0:1789130240.900670:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8e1c0 00000040:00080000:3.0:1789130240.901856:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130240.901867:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130240.901905:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 4 00000040:00080000:3.0:1789130240.901913:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130240.906766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130240.906959:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999424 00000100:00100000:3.0:1789130240.906975:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999424 00002000:00100000:3.0:1789130240.907044:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff90b384b7de00 x1876037604999424/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.907058:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7de00 with x1876037604999424 ext(6291456->7340031) 00002000:00010000:3.0:1789130240.907067:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7de00 00000100:00100000:3.0:1789130240.907142:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:3.0:1789130240.907161:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+24:2367:x1876037604999424:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130240.922333:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+26:2367:x1876037604999424:12345-192.168.201.39@tcp:4:dd.0 Request processed in 15158us (15566us total) trans 30064771258 rc 0/0 00000100:00100000:3.0:1789130240.922351:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 307 00002000:00100000:3.0:1789130240.922367:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff90b384b7de00 x1876037604999424/t30064771258(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130240.922400:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7de00 with x1876037604999424 ext(6291456->7340031) 00002000:00010000:3.0:1789130240.922409:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7de00 00000100:00100000:1.0:1789130240.927278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.927490:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999552 00000100:00100000:0.0:1789130240.927506:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999552 00002000:00100000:0.0:1789130240.927582:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff90b4c1964780 x1876037604999552/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.927598:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1964780 with x1876037604999552 ext(7340032->8388607) 00002000:00010000:0.0:1789130240.927843:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1964780 00000100:00100000:0.0:1789130240.927923:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:0.0:1789130240.927937:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:2368:x1876037604999552:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.940197:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:2368:x1876037604999552:12345-192.168.201.39@tcp:4:dd.0 Request processed in 12246us (12921us total) trans 30064771259 rc 0/0 00000100:00100000:0.0:1789130240.940216:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 308 00002000:00100000:0.0:1789130240.940236:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff90b4c1964780 x1876037604999552/t30064771259(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.940254:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1964780 with x1876037604999552 ext(7340032->8388607) 00002000:00010000:0.0:1789130240.940263:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1964780 00000100:00100000:3.0:1789130240.941810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.942041:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999680 00000100:00100000:0.0:1789130240.942054:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999680 00002000:00100000:0.0:1789130240.942118:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff90b382f8d680 x1876037604999680/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.942139:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8d680 with x1876037604999680 ext(8388608->9437183) 00002000:00010000:0.0:1789130240.942146:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8d680 00000100:00100000:0.0:1789130240.942184:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:0.0:1789130240.942196:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037604999680:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130240.954083:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037604999680:12345-192.168.201.39@tcp:4:dd.0 Request processed in 11869us (12263us total) trans 30064771260 rc 0/0 00000100:00100000:0.0:1789130240.954104:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 309 00002000:00100000:0.0:1789130240.954126:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff90b382f8d680 x1876037604999680/t30064771260(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.954141:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382f8d680 with x1876037604999680 ext(8388608->9437183) 00002000:00010000:0.0:1789130240.954152:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b382f8d680 00000100:00100000:2.0:1789130240.966931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130240.967047:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999808 00000100:00100000:0.0:1789130240.967061:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999808 00002000:00100000:0.0:1789130240.967134:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff90b384b7c780 x1876037604999808/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/0 e 0 to 0 dl 1789130251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130240.967148:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7c780 with x1876037604999808 ext(9437184->10485759) 00002000:00010000:0.0:1789130240.967157:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7c780 00000100:00100000:0.0:1789130240.967236:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:0.0:1789130240.967249:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+30:2370:x1876037604999808:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130241.016256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.016886:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604999936 00000100:00100000:0.0:1789130241.016900:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604999936 00002000:00100000:0.0:1789130241.016972:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff90b384b7f480 x1876037604999936/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.016991:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7f480 with x1876037604999936 ext(10485760->11534335) 00002000:00010000:0.0:1789130241.016999:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7f480 00000100:00100000:0.0:1789130241.017104:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:0.0:1789130241.017118:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+32:2367:x1876037604999936:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130241.021757:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+34:2370:x1876037604999808:12345-192.168.201.39@tcp:4:dd.0 Request processed in 54491us (54823us total) trans 30064771261 rc 0/0 00000100:00100000:0.0:1789130241.021778:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 310 00002000:00100000:0.0:1789130241.021795:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff90b384b7c780 x1876037604999808/t30064771261(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:711/0 lens 488/448 e 0 to 0 dl 1789130251 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.021808:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7c780 with x1876037604999808 ext(9437184->10485759) 00002000:00010000:0.0:1789130241.021818:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7c780 00000100:00100000:3.0:1789130241.045873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130241.046096:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000064 00000100:00100000:2.0:1789130241.046112:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000064 00002000:00100000:2.0:1789130241.046185:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff90b38295cf00 x1876037605000064/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130241.046200:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295cf00 with x1876037605000064 ext(11534336->12582911) 00002000:00010000:2.0:1789130241.046209:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295cf00 00000100:00100000:2.0:1789130241.046243:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:2.0:1789130241.046256:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+34:2368:x1876037605000064:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130241.064101:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+36:2367:x1876037604999936:12345-192.168.201.39@tcp:4:dd.0 Request processed in 46967us (47843us total) trans 30064771262 rc 0/0 00000100:00100000:0.0:1789130241.064123:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 311 00002000:00100000:0.0:1789130241.064144:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff90b384b7f480 x1876037604999936/t30064771262(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/448 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.064159:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7f480 with x1876037604999936 ext(10485760->11534335) 00002000:00010000:0.0:1789130241.064170:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7f480 00000100:00100000:2.0:1789130241.068957:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+36:2368:x1876037605000064:12345-192.168.201.39@tcp:4:dd.0 Request processed in 22682us (23082us total) trans 30064771263 rc 0/0 00000100:00100000:2.0:1789130241.068979:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 312 00002000:00100000:2.0:1789130241.069031:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff90b38295cf00 x1876037605000064/t30064771263(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/448 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130241.069045:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38295cf00 with x1876037605000064 ext(11534336->12582911) 00002000:00010000:2.0:1789130241.069054:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38295cf00 00000100:00100000:0.0:1789130241.070842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.070951:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000192 00000100:00100000:3.0:1789130241.070964:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000192 00002000:00100000:3.0:1789130241.071037:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff90b38975cb40 x1876037605000192/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.071050:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975cb40 with x1876037605000192 ext(12582912->13631487) 00002000:00010000:3.0:1789130241.071057:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975cb40 00000100:00100000:3.0:1789130241.071138:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:3.0:1789130241.071149:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+36:2370:x1876037605000192:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130241.082369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.082504:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000320 00000100:00100000:3.0:1789130241.082518:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000320 00002000:00100000:3.0:1789130241.082588:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff90b384b7da40 x1876037605000320/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.082664:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7da40 with x1876037605000320 ext(13631488->14680063) 00002000:00010000:3.0:1789130241.082674:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7da40 00000100:00100000:3.0:1789130241.082707:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:3.0:1789130241.082719:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+38:2369:x1876037605000320:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130241.097725:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605000192:12345-192.168.201.39@tcp:4:dd.0 Request processed in 26556us (26879us total) trans 30064771264 rc 0/0 00000100:00100000:3.0:1789130241.097748:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 313 00002000:00100000:3.0:1789130241.097796:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff90b38975cb40 x1876037605000192/t30064771264(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/448 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.097810:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975cb40 with x1876037605000192 ext(12582912->13631487) 00002000:00010000:3.0:1789130241.097820:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38975cb40 00000100:00100000:3.0:1789130241.098923:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605000320:12345-192.168.201.39@tcp:4:dd.0 Request processed in 16196us (16559us total) trans 30064771265 rc 0/0 00000100:00100000:3.0:1789130241.098937:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 314 00002000:00100000:3.0:1789130241.098948:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff90b384b7da40 x1876037605000320/t30064771265(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/448 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.098958:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7da40 with x1876037605000320 ext(13631488->14680063) 00002000:00010000:3.0:1789130241.098964:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b7da40 00000100:00100000:1.0:1789130241.102071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.102116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.102159:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000448 00000100:00100000:1.0:1789130241.102173:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000448 00002000:00100000:1.0:1789130241.102244:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff90b4c1967c00 x1876037605000448/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.102258:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1967c00 with x1876037605000448 ext(14680064->15728639) 00002000:00010000:1.0:1789130241.102267:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1967c00 00000100:00100000:3.0:1789130241.102383:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000704 00000100:00100000:3.0:1789130241.102388:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000704 00000100:00100000:3.0:1789130241.102436:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789130241.102448:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:37782:x1876037605000704:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:1.0:1789130241.102731:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:1.0:1789130241.102741:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605000448:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130241.113548:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037605000448:12345-192.168.201.39@tcp:4:dd.0 Request processed in 10787us (11409us total) trans 30064771266 rc 0/0 00000100:00100000:1.0:1789130241.113568:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 315 00002000:00100000:1.0:1789130241.113584:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff90b4c1967c00 x1876037605000448/t30064771266(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/448 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.113621:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1967c00 with x1876037605000448 ext(14680064->15728639) 00002000:00010000:1.0:1789130241.113632:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4c1967c00 00000100:00100000:2.0:1789130241.113728:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:37782:x1876037605000704:12345-192.168.201.39@tcp:35:dd.0 Request processed in 11281us (11672us total) trans 30064771424 rc 0/0 00000100:00100000:2.0:1789130241.113741:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130241.135052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130241.135182:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605000832 00000100:00100000:2.0:1789130241.135197:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605000832 00000100:00100000:2.0:1789130241.135295:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 397 00000100:00100000:2.0:1789130241.135309:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+43:37783:x1876037605000832:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130241.135342:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130241.135377:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea26f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac068 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135428:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47cea276 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135447:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47cea276 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135466:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47cea276 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135678:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea26f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac068 expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135721:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47cea276 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac068 expref: 44 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.135733:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130241.135737:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130241.135742:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86600, rc 0) 00000100:00100000:2.0:1789130241.135840:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:37783:x1876037605000832:12345-192.168.201.39@tcp:101:chown.0 Request processed in 534us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130241.135849:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 397 00000100:00100000:0.0:1789130241.143418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130241.143551:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001088 00000100:00100000:2.0:1789130241.143568:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001088 00000100:00100000:1.0:1789130241.145994:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 398 00000100:00100000:1.0:1789130241.146037:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:37783:x1876037605001088:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:1.0:1789130241.146133:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130241.146177:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea230 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac04c expref: 44 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.146208:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130241.146215:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130241.146260:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.146278:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.146444:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130241.147411:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].14, 88 off9256 00000004:00080000:1.0:1789130241.147427:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1404244824260ns, next at 1405244821405ns, rc = 0 00000004:00010000:1.0:1789130241.147544:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e0fc4718 reply state 00000000858451e5 transno 30064771425 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130241.147566:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130241.148104:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+45:37783:x1876037605001088:12345-192.168.201.39@tcp:36:chown.0 Request processed in 2086us (4702us total) trans 30064771425 rc 0/0 00000100:00100000:1.0:1789130241.148114:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 398 00000100:00100000:1.0:1789130241.152119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.152220:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001216 00000100:00100000:0.0:1789130241.152234:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001216 00000100:00100000:0.0:1789130241.152328:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 399 00000100:00100000:0.0:1789130241.152340:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:37783:x1876037605001216:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130241.152374:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130241.152404:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47cea284 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac06f expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.152497:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47cea284 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac06f expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.152516:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47cea284 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac06f expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.152543:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130241.152547:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130241.152553:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657200, rc 0) 00000100:00100000:0.0:1789130241.152661:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:37783:x1876037605001216:12345-192.168.201.39@tcp:101:chown.0 Request processed in 313us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130241.152669:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 399 00000100:00100000:0.0:1789130241.156482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.156826:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001344 00000100:00100000:3.0:1789130241.156841:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001344 00000100:00100000:3.0:1789130241.156928:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1789130241.156942:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+39:2369:x1876037605001344:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:3.0:1789130241.157216:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789130241.157221:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1789130240 00002000:00010000:3.0:1789130241.157223:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130241.157226:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1789130240 00002000:00010000:3.0:1789130241.157229:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789130241.157677:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605001344:12345-192.168.201.39@tcp:2:chown.0 Request processed in 735us (1209us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1789130241.157707:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00010000:00010000:2.0:1789130241.158013:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158028:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158036:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158042:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130241.158048:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158058:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158080:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130241.158092:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130241.158099:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.158107:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea27d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130241.175915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.176432:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001472 00000100:00100000:1.0:1789130241.176447:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001472 00000100:00100000:1.0:1789130241.176530:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 400 00000100:00100000:1.0:1789130241.176543:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:37784:x1876037605001472:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130241.176576:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130241.176674:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea28b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac076 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.176725:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34000/0x5c74554e47cea292 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.176743:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34000/0x5c74554e47cea292 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.176756:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34000/0x5c74554e47cea292 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.176977:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea28b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac076 expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.177000:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34000/0x5c74554e47cea292 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac076 expref: 46 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.177023:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130241.177027:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130241.177031:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34000, rc 0) 00000100:00100000:1.0:1789130241.177109:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:37784:x1876037605001472:12345-192.168.201.39@tcp:101:chown.0 Request processed in 569us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130241.177117:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 400 00000100:00100000:0.0:1789130241.183437:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.183559:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001728 00000100:00100000:1.0:1789130241.183575:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001728 00000100:00100000:1.0:1789130241.183694:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 401 00000100:00100000:1.0:1789130241.183707:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+46:37784:x1876037605001728:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:1.0:1789130241.183780:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130241.183818:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea25a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac05a expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.183842:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130241.183848:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130241.183888:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.183904:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.183916:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130241.184474:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].14, 88 off9328 00000004:00080000:1.0:1789130241.184489:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1404281885874ns, next at 1405281882787ns, rc = 0 00000004:00010000:1.0:1789130241.185293:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000016b44d8c reply state 000000006aed4344 transno 30064771426 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130241.185312:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130241.185489:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:37784:x1876037605001728:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1781us (2064us total) trans 30064771426 rc 0/0 00000100:00100000:1.0:1789130241.185499:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 401 00010000:00010000:2.0:1789130241.188090:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188114:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188123:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188131:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130241.188136:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188145:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188167:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130241.188170:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130241.188176:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130241.188184:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea299 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130241.189811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.189997:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001856 00000100:00100000:1.0:1789130241.190013:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001856 00000100:00100000:1.0:1789130241.190095:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 402 00000100:00100000:1.0:1789130241.190108:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:37784:x1876037605001856:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130241.190146:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130241.190182:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea2a0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac07d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.190307:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea2a0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac07d expref: 47 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.190327:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea2a0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac07d expref: 47 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.190357:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130241.190360:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130241.190366:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34c00, rc 0) 00000100:00100000:1.0:1789130241.190456:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+47:37784:x1876037605001856:12345-192.168.201.39@tcp:101:chown.0 Request processed in 350us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130241.190464:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 402 00000100:00100000:0.0:1789130241.195666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.196454:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605001984 00000100:00100000:3.0:1789130241.196471:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605001984 00000100:00100000:3.0:1789130241.196566:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789130241.196579:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:2368:x1876037605001984:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:3.0:1789130241.196909:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789130241.196914:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1789130240 00002000:00010000:3.0:1789130241.196916:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130241.196918:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1789130240 00002000:00010000:3.0:1789130241.196920:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789130241.197012:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:2368:x1876037605001984:12345-192.168.201.39@tcp:2:chown.0 Request processed in 434us (1422us total) trans 30064771267 rc 0/0 00000100:00100000:3.0:1789130241.197021:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789130241.265078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.265209:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605002112 00000100:00100000:0.0:1789130241.265222:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605002112 00000100:00100000:0.0:1789130241.265323:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 403 00000100:00100000:0.0:1789130241.265335:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+47:37790:x1876037605002112:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130241.265368:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130241.265398:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea2a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac084 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265498:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265516:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265530:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130241.265860:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00000004:00200000:0.0:1789130241.265866:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130241.265903:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265939:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47cea2a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac084 expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265960:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac084 expref: 48 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.265968:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130241.265971:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130241.265976:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657000, rc 0) 00000100:00100000:0.0:1789130241.266055:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:37790:x1876037605002112:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 722us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130241.266063:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 403 00000100:00100000:0.0:1789130241.277043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.277241:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605002240 00000100:00100000:1.0:1789130241.277403:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605002240 00000100:00100000:1.0:1789130241.277497:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 404 00000100:00100000:1.0:1789130241.277511:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:37790:x1876037605002240:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130241.277544:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130241.277577:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea2b5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac08b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.277970:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.277990:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278003:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278021:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278027:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278033:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278349:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278361:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278369:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130241.278416:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:1.0:1789130241.278423:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130241.278447:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278462:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278471:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278477:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278484:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278490:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130241.278494:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278503:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278517:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130241.278521:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130241.278526:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278533:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea2bc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278563:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278570:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278576:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278581:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130241.278584:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278591:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278966:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff90b4909bd300) 00010000:00010000:1.0:1789130241.278970:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130241.278976:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.278984:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea2c3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.279034:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea2b5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac08b expref: 50 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.279050:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac08b expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130241.279073:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130241.279075:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130241.279078:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34400, rc 0) 00000100:00100000:1.0:1789130241.279782:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:37790:x1876037605002240:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 2268us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130241.280028:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 404 00000100:00100000:1.0:1789130241.285979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.286081:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605002496 00000100:00100000:0.0:1789130241.286092:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605002496 00000100:00100000:0.0:1789130241.286159:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 405 00000100:00100000:0.0:1789130241.286168:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:37790:x1876037605002496:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130241.286200:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130241.286227:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47cea2d1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac092 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.286379:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea2d8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.286398:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea2d8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.286415:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea2d8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130241.286428:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:0.0:1789130241.286590:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47cea2d1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac092 expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.286681:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea2d8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac092 expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130241.286692:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130241.286695:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130241.286700:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657600, rc 0) 00000100:00100000:0.0:1789130241.286776:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:37790:x1876037605002496:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 608us (809us total) trans 30064771427 rc 0/0 00000100:00100000:0.0:1789130241.286784:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 405 00000100:00100000:0.0:1789130241.291229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.291379:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605002752 00000100:00100000:3.0:1789130241.291393:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605002752 00000100:00100000:3.0:1789130241.291476:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 406 00000100:00100000:3.0:1789130241.291490:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:37790:x1876037605002752:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:3.0:1789130241.291527:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130241.291531:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1789130241.291570:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47cea284 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac06f expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291644:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47cea2d8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac092 expref: 50 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291672:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea2ca lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac08b expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291710:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130241.291716:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130241.291737:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea2e6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac099 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291799:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291817:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291831:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291848:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291855:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291864:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291870:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130241.291875:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291883:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291907:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130241.291910:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130241.291914:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291921:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea2ed lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291952:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291961:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.291967:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.292269:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac099 expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.292969:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130241.292973:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130241.292993:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9c00/0x5c74554e47cea2e6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac099 expref: 51 pid: 36587 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.293013:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac099 expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130241.293050:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789130241.293065:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130241.293068:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb9800, rc 0) 00000100:00100000:3.0:1789130241.293156:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:37790:x1876037605002752:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1669us (1978us total) trans 30064771428 rc 0/0 00000100:00100000:3.0:1789130241.293165:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 406 00000100:00100000:1.0:1789130241.313914:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.314050:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605002880 00000100:00100000:0.0:1789130241.314065:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605002880 00002000:00100000:0.0:1789130241.314145:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff90b4c1966940 x1876037605002880/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.314159:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966940 with x1876037605002880 ext(0->1048575) 00002000:00010000:0.0:1789130241.314168:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1966940 00000100:00100000:0.0:1789130241.314223:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 316 00000100:00100000:0.0:1789130241.314236:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:2367:x1876037605002880:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130241.339685:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:2367:x1876037605002880:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 25431us (25769us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130241.339731:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 316 00002000:00100000:2.0:1789130241.339751:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff90b4c1966940 x1876037605002880/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130241.339766:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1966940 with x1876037605002880 ext(0->1048575) 00002000:00010000:2.0:1789130241.339777:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1966940 00000100:00100000:1.0:1789130241.363959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.364089:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003008 00000100:00100000:0.0:1789130241.364104:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003008 00002000:00100000:0.0:1789130241.364245:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff90b4c19670c0 x1876037605003008/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.364370:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c19670c0 with x1876037605003008 ext(1048576->2097151) 00002000:00010000:0.0:1789130241.364379:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c19670c0 00000100:00100000:0.0:1789130241.364467:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 317 00000100:00100000:0.0:1789130241.364485:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605003008:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130241.382117:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605003008:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 17621us (18155us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130241.382136:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 317 00002000:00100000:2.0:1789130241.382155:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff90b4c19670c0 x1876037605003008/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130241.382168:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c19670c0 with x1876037605003008 ext(1048576->2097151) 00002000:00010000:2.0:1789130241.382738:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c19670c0 00000100:00100000:0.0:1789130241.417341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.417487:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003136 00000100:00100000:3.0:1789130241.417500:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003136 00002000:00100000:3.0:1789130241.417565:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff90b38975fc00 x1876037605003136/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.417577:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975fc00 with x1876037605003136 ext(2097152->3145727) 00002000:00010000:3.0:1789130241.417585:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38975fc00 00000100:00100000:3.0:1789130241.417673:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 318 00000100:00100000:3.0:1789130241.417685:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605003136:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130241.427437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.428167:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003264 00000100:00100000:1.0:1789130241.428193:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003264 00002000:00100000:1.0:1789130241.428284:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff90b486ed1680 x1876037605003264/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.428296:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed1680 with x1876037605003264 ext(3145728->4194303) 00002000:00010000:1.0:1789130241.428311:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed1680 00000100:00100000:1.0:1789130241.428361:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:1.0:1789130241.428374:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+42:2370:x1876037605003264:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130241.447978:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037605003136:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 30278us (30636us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130241.447997:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 318 00002000:00100000:0.0:1789130241.448014:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff90b38975fc00 x1876037605003136/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.448031:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38975fc00 with x1876037605003136 ext(2097152->3145727) 00002000:00010000:0.0:1789130241.448040:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38975fc00 00000100:00100000:1.0:1789130241.465963:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605003264:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 37576us (38525us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.465984:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 319 00002000:00100000:1.0:1789130241.466001:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff90b486ed1680 x1876037605003264/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.466013:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486ed1680 with x1876037605003264 ext(3145728->4194303) 00002000:00010000:1.0:1789130241.466051:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b486ed1680 00010000:00010000:1.0:1789130241.477967:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130241.503839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.503891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.503935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.503967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.504063:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003392 00000100:00100000:0.0:1789130241.504076:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003392 00002000:00100000:0.0:1789130241.504156:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff90b4c19652c0 x1876037605003392/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.504171:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c19652c0 with x1876037605003392 ext(4194304->5242879) 00002000:00010000:0.0:1789130241.504180:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c19652c0 00000100:00100000:0.0:1789130241.504216:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003520 00000100:00100000:0.0:1789130241.504220:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003520 00002000:00100000:0.0:1789130241.504237:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff90b4c1967840 x1876037605003520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.504247:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1967840 with x1876037605003520 ext(5242880->6291455) 00002000:00010000:0.0:1789130241.504250:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1967840 00000100:00100000:0.0:1789130241.504267:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003776 00000100:00100000:0.0:1789130241.504270:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003776 00002000:00100000:0.0:1789130241.504285:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff90b4be5f3480 x1876037605003776/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.504293:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f3480 with x1876037605003776 ext(7340032->8388607) 00002000:00010000:0.0:1789130241.504297:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f3480 00000100:00100000:0.0:1789130241.504310:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003648 00000100:00100000:0.0:1789130241.504313:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003648 00002000:00100000:0.0:1789130241.504328:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff90b4be5f3c00 x1876037605003648/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.504343:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f3c00 with x1876037605003648 ext(6291456->7340031) 00002000:00010000:0.0:1789130241.504346:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f3c00 00000100:00100000:0.0:1789130241.504365:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 320 00000100:00100000:0.0:1789130241.504377:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:2370:x1876037605003392:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130241.505333:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:0.0:1789130241.505347:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037605003520:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130241.506076:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 322 00000100:00100000:0.0:1789130241.506089:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+45:2369:x1876037605003776:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130241.506999:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 323 00000100:00100000:3.0:1789130241.507014:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+46:2370:x1876037605003648:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130241.547283:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+46:2370:x1876037605003392:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 42004us (42557us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.547306:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 320 00002000:00100000:1.0:1789130241.547326:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff90b4c19652c0 x1876037605003392/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.547339:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c19652c0 with x1876037605003392 ext(4194304->5242879) 00002000:00010000:1.0:1789130241.547350:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c19652c0 00000100:00100000:0.0:1789130241.569967:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037605003520:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 64601us (66052us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130241.569989:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 321 00002000:00100000:0.0:1789130241.570009:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff90b4c1967840 x1876037605003520/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.570021:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c1967840 with x1876037605003520 ext(5242880->6291455) 00002000:00010000:0.0:1789130241.570031:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4c1967840 00000100:00100000:0.0:1789130241.585219:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037605003776:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 79115us (81264us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130241.585238:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 322 00002000:00100000:0.0:1789130241.585255:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff90b4be5f3480 x1876037605003776/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.585267:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f3480 with x1876037605003776 ext(7340032->8388607) 00002000:00010000:0.0:1789130241.585277:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f3480 00000100:00100000:1.0:1789130241.601792:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605003648:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 94765us (97806us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.601811:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 323 00002000:00100000:1.0:1789130241.601827:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff90b4be5f3c00 x1876037605003648/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.601841:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f3c00 with x1876037605003648 ext(6291456->7340031) 00002000:00010000:1.0:1789130241.601850:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f3c00 00000100:00100000:2.0:1789130241.691536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130241.691647:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605003904 00000100:00100000:3.0:1789130241.691658:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605003904 00002000:00100000:3.0:1789130241.691710:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff90b384b7d680 x1876037605003904/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.691722:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7d680 with x1876037605003904 ext(8388608->9437183) 00002000:00010000:3.0:1789130241.691728:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b7d680 00000100:00100000:3.0:1789130241.691763:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 324 00000100:00100000:3.0:1789130241.691772:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605003904:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130241.716547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.716577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.716634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.716664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130241.716714:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004160 00000100:00100000:0.0:1789130241.716726:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004160 00002000:00100000:0.0:1789130241.716781:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff90b381d48b40 x1876037605004160/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.716793:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48b40 with x1876037605004160 ext(10485760->11534335) 00000100:00100000:3.0:1789130241.717081:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004032 00000100:00100000:3.0:1789130241.717086:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004032 00002000:00100000:3.0:1789130241.717107:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff90b381d48f00 x1876037605004032/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.717116:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48f00 with x1876037605004032 ext(9437184->10485759) 00002000:00010000:3.0:1789130241.717120:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48f00 00000100:00100000:3.0:1789130241.717143:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004288 00000100:00100000:3.0:1789130241.717146:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004288 00002000:00100000:3.0:1789130241.717161:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff90b381d48000 x1876037605004288/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.717169:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48000 with x1876037605004288 ext(11534336->12582911) 00002000:00010000:3.0:1789130241.717172:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48000 00000100:00100000:3.0:1789130241.717184:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004544 00000100:00100000:3.0:1789130241.717187:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004544 00002000:00100000:3.0:1789130241.717202:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff90b381d48780 x1876037605004544/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130241.717209:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48780 with x1876037605004544 ext(13631488->14680063) 00002000:00010000:3.0:1789130241.717212:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48780 00000100:00100000:3.0:1789130241.717230:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:3.0:1789130241.717239:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:2369:x1876037605004032:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130241.718257:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 326 00000100:00100000:1.0:1789130241.718273:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:2369:x1876037605004288:12345-192.168.201.39@tcp:3:lfs.0 00002000:00010000:0.0:1789130241.719250:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48b40 00000100:00100000:0.0:1789130241.719286:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:0.0:1789130241.719299:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:2369:x1876037605004544:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130241.724337:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 328 00000100:00100000:3.0:1789130241.724357:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+48:2370:x1876037605004160:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130241.725517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.725553:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004416 00000100:00100000:1.0:1789130241.725575:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004416 00002000:00100000:1.0:1789130241.725636:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff90b4be5f30c0 x1876037605004416/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.725661:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f30c0 with x1876037605004416 ext(12582912->13631487) 00002000:00010000:1.0:1789130241.725669:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f30c0 00000100:00100000:1.0:1789130241.725700:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:1.0:1789130241.725709:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:2369:x1876037605004416:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130241.729097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130241.729379:0:40189:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:1.0:1789130241.729389:0:40189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000100:00100000:1.0:1789130241.729430:0:39572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:1.0:1789130241.729439:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004672 00000100:00100000:1.0:1789130241.729447:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004672 00002000:00100000:1.0:1789130241.729490:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff90b4be5f2940 x1876037605004672/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/0 e 0 to 0 dl 1789130252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.729500:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f2940 with x1876037605004672 ext(14680064->15728639) 00002000:00010000:1.0:1789130241.729507:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f2940 00000100:00100000:1.0:1789130241.737750:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 330 00000100:00100000:1.0:1789130241.737774:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+52:2369:x1876037605004672:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130241.738759:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:2370:x1876037605003904:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 46981us (47227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.738769:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 324 00002000:00100000:1.0:1789130241.738781:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff90b384b7d680 x1876037605003904/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.738792:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b7d680 with x1876037605003904 ext(8388608->9437183) 00002000:00010000:1.0:1789130241.739464:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b384b7d680 00000100:00100000:1.0:1789130241.749792:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:2369:x1876037605004032:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 32531us (33191us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.749811:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 325 00002000:00100000:1.0:1789130241.749832:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff90b381d48f00 x1876037605004032/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.749845:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48f00 with x1876037605004032 ext(9437184->10485759) 00002000:00010000:1.0:1789130241.749856:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48f00 00000100:00100000:0.0:1789130241.796740:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:2369:x1876037605004288:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 78461us (80094us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130241.796755:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 326 00002000:00100000:0.0:1789130241.796769:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff90b381d48000 x1876037605004288/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.796780:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48000 with x1876037605004288 ext(11534336->12582911) 00002000:00010000:0.0:1789130241.796786:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48000 00000100:00100000:2.0:1789130241.843050:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+46:2370:x1876037605004160:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 118688us (126504us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130241.843065:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 328 00002000:00100000:2.0:1789130241.843078:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff90b381d48b40 x1876037605004160/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130241.843089:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48b40 with x1876037605004160 ext(10485760->11534335) 00002000:00010000:2.0:1789130241.843097:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48b40 00000100:00100000:0.0:1789130241.854777:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:2369:x1876037605004416:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 129055us (129253us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130241.854792:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 329 00002000:00100000:0.0:1789130241.855020:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff90b4be5f30c0 x1876037605004416/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130241.855036:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f30c0 with x1876037605004416 ext(12582912->13631487) 00002000:00010000:0.0:1789130241.855044:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f30c0 00000100:00100000:1.0:1789130241.910010:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:2369:x1876037605004544:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 190697us (193325us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.910029:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 327 00002000:00100000:1.0:1789130241.910047:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff90b381d48780 x1876037605004544/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.910060:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d48780 with x1876037605004544 ext(13631488->14680063) 00002000:00010000:1.0:1789130241.910069:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d48780 00000100:00100000:1.0:1789130241.910155:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+40:2369:x1876037605004672:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 172390us (181070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130241.910164:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 330 00002000:00100000:1.0:1789130241.910185:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff90b4be5f2940 x1876037605004672/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:712/0 lens 488/440 e 0 to 0 dl 1789130252 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130241.910194:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f2940 with x1876037605004672 ext(14680064->15728639) 00002000:00010000:1.0:1789130241.910198:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f2940 00000001:00080000:3.0:1789130241.960812:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771427 is committed 00000004:00080000:3.0:1789130241.960859:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00080000:3.0:1789130241.960883:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000100:00100000:3.0:1789130241.961116:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626836480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130241.961218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130241.961652:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130241.961670:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626836608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130241.961720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130241.961777:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836480 00000100:00100000:0.0:1789130241.961806:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836480 00000100:00100000:0.0:1789130241.961896:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836608 00000100:00100000:0.0:1789130241.961901:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836608 00000100:00100000:0.0:1789130241.961930:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789130241.961950:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626836480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789130241.962161:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1789130241.962165:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 1789130240 -> 1789130240 00002000:00010000:0.0:1789130241.962168:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130241.962170:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 1789130240 -> 1789130240 00002000:00010000:0.0:1789130241.962172:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130241.962252:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626836480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 304us (1033us total) trans 30064771199 rc 0/0 00000100:00100000:0.0:1789130241.962261:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789130241.962279:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789130241.962286:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626836608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789130241.962510:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1789130241.962515:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 1789130240 -> 1789130240 00002000:00010000:0.0:1789130241.962517:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130241.962520:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 1789130240 -> 1789130240 00002000:00010000:0.0:1789130241.962523:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:0.0:1789130241.962569:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626836608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (848us total) trans 30064771268 rc 0/0 00000100:00100000:0.0:1789130241.962580:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1789130241.963271:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130241.963277:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789130241.963336:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4be5f2d00/2, rc 0, transno 30064771268 00000100:00100000:1.0:1789130241.963346:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626836608:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789130241.963493:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771428 is committed 00000004:00080000:3.0:1789130241.963569:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b497af0f00/2, rc 0, transno 30064771199 00000100:00100000:3.0:1789130241.963578:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626836480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130241.984303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130241.984430:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605004928 00000100:00100000:2.0:1789130241.984442:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605004928 00000100:00100000:2.0:1789130241.984511:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:2.0:1789130241.984542:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+39:37790:x1876037605004928:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:2.0:1789130241.985184:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:37790:x1876037605004928:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 642us (888us total) trans 30064771429 rc 0/0 00000100:00100000:2.0:1789130241.985194:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000001:00080000:1.0:1789130241.986745:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771262 is committed 00000001:00080000:1.0:1789130241.986792:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771266 is committed 00000001:00080000:1.0:1789130241.986910:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771267 is committed 00000100:00100000:3.0:1789130242.107421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.107570:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005056 00000100:00100000:1.0:1789130242.107586:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005056 00000100:00100000:1.0:1789130242.107743:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 407 00000100:00100000:1.0:1789130242.107759:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:37796:x1876037605005056:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130242.107790:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130242.107817:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea2fb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0a0 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107890:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107906:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107919:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107946:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107954:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.107977:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108373:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108382:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108389:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130242.108554:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00000004:00200000:1.0:1789130242.108559:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130242.108580:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108593:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108627:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108651:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108657:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108663:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130242.108668:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108683:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108695:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130242.108699:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130242.108704:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108710:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea302 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108724:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108730:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108736:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108740:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130242.108743:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108748:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108755:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff90b4909bd300) 00010000:00010000:1.0:1789130242.108758:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130242.108760:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108774:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea309 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108808:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea2fb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a0 expref: 42 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108822:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a0 expref: 41 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.108829:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130242.108831:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130242.108833:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130242.108910:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+41:37796:x1876037605005056:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1156us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130242.108919:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 407 00000100:00080000:2.0:1789130242.109076:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130242.111842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.112003:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005312 00000100:00100000:2.0:1789130242.112018:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005312 00000100:00100000:2.0:1789130242.112097:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 408 00000100:00100000:2.0:1789130242.112108:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+41:37796:x1876037605005312:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130242.112129:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130242.112150:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47cea317 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0a7 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.112247:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea31e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.112261:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea31e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.112272:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea31e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130242.112283:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00010000:00010000:2.0:1789130242.112490:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47cea317 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a7 expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.112511:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea31e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a7 expref: 43 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.112540:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130242.112543:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130242.112546:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4a00, rc 0) 00000100:00100000:2.0:1789130242.112659:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+43:37796:x1876037605005312:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 552us (832us total) trans 30064771430 rc 0/0 00000100:00100000:2.0:1789130242.112666:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 408 00000100:00100000:3.0:1789130242.118362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.118520:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005568 00000100:00100000:0.0:1789130242.118533:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005568 00000100:00100000:0.0:1789130242.118645:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 409 00000100:00100000:0.0:1789130242.118658:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+43:37796:x1876037605005568:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130242.118686:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130242.118689:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1789130242.118721:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea2a0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac07d expref: 43 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118743:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea31e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a7 expref: 42 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118757:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea310 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0a0 expref: 41 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118767:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130242.118773:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130242.118788:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea32c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0ae expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118848:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118863:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118872:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118888:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118894:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118900:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118906:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130242.118910:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118917:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118924:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130242.118927:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130242.118941:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118947:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea333 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118974:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118981:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.118988:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.119227:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ae expref: 43 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.119235:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130242.119237:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130242.119245:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea32c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ae expref: 43 pid: 36587 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.119258:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ae expref: 42 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.119281:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130242.119283:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130242.119286:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031c00, rc 0) 00000100:00100000:0.0:1789130242.119353:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:37796:x1876037605005568:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 698us (1002us total) trans 30064771431 rc 0/0 00000100:00100000:0.0:1789130242.119361:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 409 00000100:00100000:3.0:1789130242.153926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.154111:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005696 00000100:00100000:1.0:1789130242.154122:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005696 00002000:00100000:1.0:1789130242.154199:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff90b497af1680 x1876037605005696/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.154211:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b497af1680 with x1876037605005696 ext(0->1048575) 00002000:00010000:1.0:1789130242.154218:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b497af1680 00000100:00100000:1.0:1789130242.154259:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:1.0:1789130242.154270:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605005696:12345-192.168.201.39@tcp:3:lfs.0 00000100:00080000:2.0:1789130242.154534:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130242.198676:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605005696:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 43525us (43877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130242.198710:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 331 00002000:00100000:1.0:1789130242.198727:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff90b497af1680 x1876037605005696/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.198739:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b497af1680 with x1876037605005696 ext(0->1048575) 00002000:00010000:1.0:1789130242.198747:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b497af1680 00000100:00100000:2.0:1789130242.265809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.265968:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005824 00000100:00100000:1.0:1789130242.265981:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005824 00002000:00100000:1.0:1789130242.266041:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff90b384a57c00 x1876037605005824/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.266054:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57c00 with x1876037605005824 ext(1048576->2097151) 00002000:00010000:1.0:1789130242.266062:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a57c00 00000100:00100000:1.0:1789130242.266099:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 332 00000100:00100000:1.0:1789130242.266110:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605005824:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130242.297227:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605005824:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 31106us (31428us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130242.297243:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 332 00002000:00100000:1.0:1789130242.297258:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff90b384a57c00 x1876037605005824/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.297270:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384a57c00 with x1876037605005824 ext(1048576->2097151) 00002000:00010000:1.0:1789130242.297278:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384a57c00 00000100:00100000:2.0:1789130242.310265:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130242.310357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130242.310763:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836736 00000100:00100000:3.0:1789130242.310773:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836736 00000100:00100000:3.0:1789130242.310848:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789130242.310858:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626836736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130242.310899:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 223150080 pending 25559040 free 3788505088 avail 3786407936 00000100:00100000:3.0:1789130242.310967:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626836736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130242.310974:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789130242.311025:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130242.311679:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626837248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130242.311725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130242.311779:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130242.311786:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626837120:0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.311939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626836864:0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.311976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130242.311999:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130242.312004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626836992:0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.312027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130242.312060:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837248 00000100:00100000:2.0:1789130242.312066:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837248 00000100:00100000:2.0:1789130242.312111:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836992 00000100:00100000:2.0:1789130242.312115:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836992 00000100:00100000:2.0:1789130242.312133:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789130242.312140:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.312181:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626837248:12345-0@lo:400:kworker.0 Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130242.312188:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789130242.312203:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789130242.312218:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626836992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.312250:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626836992:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130242.312269:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1789130242.312289:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130242.312313:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789130242.312651:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626836864 00000100:00100000:3.0:1789130242.312656:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626836864 00000100:00100000:3.0:1789130242.312686:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789130242.312693:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626836864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130242.312738:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626836864:12345-0@lo:400:kworker.0 Request processed in 46us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130242.312745:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789130242.312802:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626836864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130242.313117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130242.313150:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626837248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130242.313202:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837120 00000100:00100000:0.0:1789130242.313206:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837120 00000100:00100000:0.0:1789130242.313248:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789130242.313262:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626837120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130242.313298:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626837120:12345-0@lo:400:kworker.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130242.313304:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789130242.313589:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130242.313692:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626837120:0@lo:400:kworker.0 00000100:00100000:2.0:1789130242.325451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.325509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130242.325760:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605005952 00000100:00100000:3.0:1789130242.325771:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605005952 00002000:00100000:3.0:1789130242.325840:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff90b384b52940 x1876037605005952/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130242.325851:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b52940 with x1876037605005952 ext(2097152->3145727) 00002000:00010000:3.0:1789130242.325858:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b52940 00000100:00100000:3.0:1789130242.325888:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006080 00000100:00100000:3.0:1789130242.325892:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006080 00002000:00100000:3.0:1789130242.325908:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff90b384b50000 x1876037605006080/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130242.325917:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50000 with x1876037605006080 ext(3145728->4194303) 00002000:00010000:3.0:1789130242.325920:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b50000 00000100:00100000:3.0:1789130242.325954:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:3.0:1789130242.325964:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605005952:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130242.326730:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 334 00000100:00100000:1.0:1789130242.326745:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605006080:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130242.359551:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605006080:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 32798us (34028us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130242.359569:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 334 00002000:00100000:0.0:1789130242.360104:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff90b384b50000 x1876037605006080/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.360116:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b50000 with x1876037605006080 ext(3145728->4194303) 00002000:00010000:0.0:1789130242.360124:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b50000 00000100:00100000:3.0:1789130242.360358:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605005952:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 34395us (34917us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130242.360366:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 333 00002000:00100000:3.0:1789130242.360373:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff90b384b52940 x1876037605005952/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130242.360384:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b52940 with x1876037605005952 ext(2097152->3145727) 00002000:00010000:3.0:1789130242.360387:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b52940 00000100:00100000:2.0:1789130242.430046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.430324:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006208 00000100:00100000:1.0:1789130242.430337:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006208 00002000:00100000:1.0:1789130242.430400:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff90b38969a580 x1876037605006208/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.430478:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969a580 with x1876037605006208 ext(4194304->5242879) 00002000:00010000:1.0:1789130242.430485:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969a580 00000100:00100000:1.0:1789130242.430560:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00100000:1.0:1789130242.430571:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605006208:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130242.442677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.442728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.442753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.443045:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006336 00000100:00100000:0.0:1789130242.443055:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006336 00002000:00100000:0.0:1789130242.443109:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff90b38969b840 x1876037605006336/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.443121:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969b840 with x1876037605006336 ext(5242880->6291455) 00002000:00010000:0.0:1789130242.443128:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969b840 00000100:00100000:0.0:1789130242.443148:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006464 00000100:00100000:0.0:1789130242.443151:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006464 00002000:00100000:0.0:1789130242.443164:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff90b38969b0c0 x1876037605006464/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.443172:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969b0c0 with x1876037605006464 ext(6291456->7340031) 00002000:00010000:0.0:1789130242.443175:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969b0c0 00000100:00100000:0.0:1789130242.443186:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006592 00000100:00100000:0.0:1789130242.443189:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006592 00002000:00100000:0.0:1789130242.443199:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff90b3896992c0 x1876037605006592/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/0 e 0 to 0 dl 1789130253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.443206:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3896992c0 with x1876037605006592 ext(7340032->8388607) 00002000:00010000:0.0:1789130242.443208:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3896992c0 00000100:00100000:0.0:1789130242.443227:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 336 00000100:00100000:0.0:1789130242.443236:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037605006336:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130242.444103:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:0.0:1789130242.444116:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037605006464:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130242.445883:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 338 00000100:00100000:0.0:1789130242.445902:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:2369:x1876037605006592:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:1.0:1789130242.485439:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605006208:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 54858us (55390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130242.485456:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 335 00002000:00100000:1.0:1789130242.485472:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff90b38969a580 x1876037605006208/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.485483:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969a580 with x1876037605006208 ext(4194304->5242879) 00002000:00010000:1.0:1789130242.485492:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969a580 00010000:00010000:3.0:1789130242.501913:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130242.503847:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037605006336:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 60597us (61168us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130242.503864:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 336 00002000:00100000:0.0:1789130242.503882:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff90b38969b840 x1876037605006336/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.503893:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969b840 with x1876037605006336 ext(5242880->6291455) 00002000:00010000:0.0:1789130242.503904:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969b840 00000100:00100000:0.0:1789130242.522869:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605006464:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 78735us (80118us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130242.522889:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 337 00002000:00100000:0.0:1789130242.522908:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff90b38969b0c0 x1876037605006464/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130242.522921:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38969b0c0 with x1876037605006464 ext(6291456->7340031) 00002000:00010000:0.0:1789130242.522930:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b38969b0c0 00000100:00100000:1.0:1789130242.531957:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3896992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605006592:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 86044us (89184us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130242.531999:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 338 00002000:00100000:1.0:1789130242.532017:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff90b3896992c0 x1876037605006592/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:713/0 lens 488/440 e 0 to 0 dl 1789130253 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130242.532030:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3896992c0 with x1876037605006592 ext(7340032->8388607) 00002000:00010000:1.0:1789130242.532041:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3896992c0 00000100:00100000:2.0:1789130242.540991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.541120:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605006848 00000100:00100000:0.0:1789130242.541136:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605006848 00000100:00100000:0.0:1789130242.541226:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:0.0:1789130242.541248:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:37796:x1876037605006848:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130242.541957:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+43:37796:x1876037605006848:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 708us (980us total) trans 30064771432 rc 0/0 00000100:00100000:0.0:1789130242.541969:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130242.642143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.642272:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605007104 00000100:00100000:1.0:1789130242.642285:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605007104 00000100:00100000:1.0:1789130242.642386:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 410 00000100:00100000:1.0:1789130242.642396:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:37806:x1876037605007104:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130242.642434:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130242.642461:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0b5 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130242.643103:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 7680 00010000:00010000:1.0:1789130242.643487:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea341 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0b5 expref: 45 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.643504:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130242.643507:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130242.643515:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0b5 expref: 45 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.643530:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:1.0:1789130242.643770:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:37806:x1876037605007104:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1374us (1640us total) trans 30064771433 rc 301/301 00000100:00100000:1.0:1789130242.643788:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 410 00000100:00100000:3.0:1789130242.648395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.658026:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605007232 00000100:00100000:2.0:1789130242.658053:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605007232 00000100:00100000:1.0:1789130242.658237:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 411 00000100:00100000:1.0:1789130242.658255:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:37806:x1876037605007232:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130242.658381:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.658404:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.658431:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.658452:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.658459:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.658467:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659093:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659107:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659115:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130242.659171:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659204:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659211:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659220:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659227:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130242.659232:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659240:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659256:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130242.659260:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130242.659266:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659272:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea34f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659286:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659292:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659298:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659311:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130242.659315:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659321:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659330:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff90b4909bd300) 00010000:00010000:1.0:1789130242.659333:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130242.659335:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659341:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86e00/0x5c74554e47cea356 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659359:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659365:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659371:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659376:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130242.659379:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659385:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659406:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130242.659408:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130242.659412:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.659426:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea35d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130242.659955:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:37806:x1876037605007232:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1700us (11570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130242.659967:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 411 00000100:00100000:2.0:1789130242.666962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.669813:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605007488 00000100:00100000:0.0:1789130242.669834:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605007488 00000100:00100000:0.0:1789130242.669935:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1789130242.669947:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+44:37806:x1876037605007488:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130242.670782:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:37806:x1876037605007488:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 832us (3832us total) trans 30064771434 rc 0/0 00000100:00100000:0.0:1789130242.670794:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789130242.818710:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130242.827086:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605007744 00000100:00100000:1.0:1789130242.827112:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605007744 00000100:00100000:1.0:1789130242.827219:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 412 00000100:00100000:1.0:1789130242.827239:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:37816:x1876037605007744:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130242.827277:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130242.827306:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0bc expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130242.827741:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 7680 00010000:00010000:1.0:1789130242.827965:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea364 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0bc expref: 47 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.827985:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130242.827989:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130242.827997:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86800/0x5c74554e47cea364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0bc expref: 47 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130242.828031:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86800, rc 0) 00000100:00100000:1.0:1789130242.828145:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:37816:x1876037605007744:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 907us (9450us total) trans 30064771435 rc 301/301 00000100:00100000:1.0:1789130242.828155:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 412 00000100:00100000:3.0:1789130242.839115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.839271:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605007872 00000100:00100000:2.0:1789130242.839286:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605007872 00000100:00100000:2.0:1789130242.839375:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 413 00000100:00100000:2.0:1789130242.839387:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:37816:x1876037605007872:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130242.839515:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.839539:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.839554:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.839674:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.839684:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.839691:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840171:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840183:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840191:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130242.840245:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840259:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840265:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840272:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840279:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130242.840290:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840300:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840316:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:2.0:1789130242.840320:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130242.840325:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840332:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea372 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840349:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840355:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840362:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840367:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759ae00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130242.840370:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840375:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840382:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff90b4976b8800) 00010000:00010000:2.0:1789130242.840385:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130242.840395:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840401:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea379 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840419:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840425:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840430:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840435:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759be00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130242.840438:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840444:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840452:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130242.840455:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130242.840457:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.840463:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea380 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130242.840581:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+46:37816:x1876037605007872:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1193us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130242.840592:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 413 00000100:00100000:3.0:1789130242.844091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.844557:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605008128 00000100:00100000:0.0:1789130242.844583:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605008128 00000100:00100000:0.0:1789130242.844716:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789130242.844728:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:37816:x1876037605008128:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130242.845592:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:37816:x1876037605008128:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 859us (1513us total) trans 30064771436 rc 0/0 00000100:00100000:0.0:1789130242.852726:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130242.921239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.921447:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605008256 00000100:00100000:0.0:1789130242.921463:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605008256 00000100:00100000:0.0:1789130242.921594:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 414 00000100:00100000:0.0:1789130242.921649:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:37822:x1876037605008256:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130242.921684:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130242.921714:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea387 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0c3 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921813:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921832:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921916:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921938:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921945:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.921953:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922470:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922482:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922491:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130242.922535:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:0.0:1789130242.922541:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130242.922566:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922586:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922596:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922643:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922651:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922658:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130242.922663:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922672:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922688:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130242.922691:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130242.922697:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922704:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47cea38e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922720:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922727:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922734:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922740:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130242.922743:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922748:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922756:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff90b497c01700) 00010000:00010000:0.0:1789130242.922758:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130242.922761:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922767:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47cea395 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922805:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47cea387 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0c3 expref: 49 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922821:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0c3 expref: 48 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130242.922828:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789130242.922830:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130242.922833:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:0.0:1789130242.923979:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:37822:x1876037605008256:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2246us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130242.924000:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 414 00000100:00100000:3.0:1789130242.927995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.928368:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605008512 00000100:00100000:2.0:1789130242.928382:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605008512 00000100:00100000:2.0:1789130242.928464:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 415 00000100:00100000:2.0:1789130242.928476:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:37822:x1876037605008512:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130242.928505:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130242.928708:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea3a3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0ca expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.928930:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea3aa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.928950:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea3aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.928965:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea3aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130242.928981:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:2.0:1789130242.929253:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759be00/0x5c74554e47cea3a3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ca expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.929278:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea3aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ca expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.929288:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130242.929291:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130242.929296:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759ae00, rc 0) 00000100:00100000:2.0:1789130242.929372:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:37822:x1876037605008512:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 899us (1393us total) trans 30064771437 rc 0/0 00000100:00100000:2.0:1789130242.929403:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 415 00000100:00100000:3.0:1789130242.938719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130242.940558:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605008640 00000100:00100000:2.0:1789130242.940580:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605008640 00000100:00100000:2.0:1789130242.940789:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:2.0:1789130242.940804:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:2368:x1876037605008640:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130242.940827:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130242.940874:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea3aa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ca expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130242.940903:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789130242.940909:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130242.940999:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:2368:x1876037605008640:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 198us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130242.941008:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1789130242.943506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130242.943760:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605008896 00000100:00100000:0.0:1789130242.943775:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605008896 00000100:00100000:0.0:1789130242.943852:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1789130242.943864:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48615c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:37822:x1876037605008896:12345-192.168.201.39@tcp:35:lfs.0 00000001:00080000:0.0:1789130242.944283:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771438 00000100:00100000:0.0:1789130242.944950:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48615c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:37822:x1876037605008896:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1082us (1451us total) trans 30064771439 rc 0/0 00000100:00100000:0.0:1789130242.944962:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000020:00080000:0.0:1789130242.944970:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789130243.335190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626837376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130243.335285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130243.335469:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837376 00000100:00100000:2.0:1789130243.335478:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837376 00000100:00100000:2.0:1789130243.335551:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130243.335563:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4ba9bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626837376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130243.335646:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:2.0:1789130243.335702:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4ba9bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626837376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130243.335710:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130243.336001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626837376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789130243.336525:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130243.526024:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130243.626089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130243.626132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130243.626163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130243.626195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130243.626216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130243.626320:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009280 00000100:00100000:1.0:1789130243.626330:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009280 00000100:00100000:1.0:1789130243.626382:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009408 00000100:00100000:1.0:1789130243.626384:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009408 00000100:00100000:1.0:1789130243.626420:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130243.626429:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605009280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130243.626463:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789130243.626490:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:2368:x1876037605009408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130243.626513:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605009280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130243.626522:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130243.626560:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009536 00000100:00100000:1.0:1789130243.626564:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009536 00000100:00100000:0.0:1789130243.626579:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+40:2368:x1876037605009408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130243.626592:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789130243.626599:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009152 00000100:00100000:1.0:1789130243.626642:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009152 00000100:00100000:1.0:1789130243.626671:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130243.626687:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605009536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130243.626722:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605009536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130243.626729:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130243.626741:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:1.0:1789130243.626747:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:2368:x1876037605009152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130243.626937:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:2368:x1876037605009152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 189us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130243.626945:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:2.0:1789130243.627128:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009024 00000100:00100000:2.0:1789130243.627133:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009024 00000100:00100000:2.0:1789130243.627179:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:2.0:1789130243.627187:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605009024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130243.627220:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605009024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130243.627229:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00080000:3.0:1789130243.627507:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130243.627512:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789130244.549844:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130244.984877:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771199 is committed 00000001:00080000:1.0:1789130244.985257:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771196 is committed 00000001:00080000:1.0:1789130244.985281:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771197 is committed 00000001:00080000:1.0:1789130244.985334:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771198 is committed 00010000:00010000:0.0:1789130245.576737:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130246.023337:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130246.023357:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130246.028329:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 3 00000040:00080000:3.0:1789130246.028359:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789130246.599463:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130246.992390:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771439 is committed 00000001:00080000:1.0:1789130247.001298:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771268 is committed 00000100:00100000:0.0:1789130247.429938:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626837504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130247.430046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130247.430695:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837504 00000100:00100000:3.0:1789130247.430705:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837504 00000100:00080000:0.0:1789130247.430758:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130247.430785:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130247.430798:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626837504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130247.430846:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 197591040 pending 0 free 3772776448 avail 3770679296 00000100:00100000:3.0:1789130247.430913:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626837504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130247.430921:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789130247.430943:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771199 gen 2 00000004:00080000:0.0:1789130247.430951:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b497af0f00, transno 30064771199 00000100:00100000:0.0:1789130247.430977:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626837504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130247.432731:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626837632:0@lo:400:kworker.0 00000100:00100000:2.0:1789130247.432770:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626837888:0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.432809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130247.432870:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626837760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130247.432944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130247.432975:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130247.432976:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626838144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130247.432980:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38969a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626838016:0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.433002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130247.433040:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837632 00000100:00100000:0.0:1789130247.433047:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837632 00000100:00100000:0.0:1789130247.433095:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789130247.433104:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626837632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.433157:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626837632:12345-0@lo:400:kworker.0 Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130247.433165:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789130247.435658:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838144 00000100:00100000:0.0:1789130247.435658:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837888 00000100:00100000:2.0:1789130247.435675:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838144 00000100:00100000:0.0:1789130247.435675:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837888 00000100:00080000:1.0:1789130247.435795:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130247.436006:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789130247.436019:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626838144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130247.436136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130247.436175:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789130247.436185:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626837888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.436237:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626837888:12345-0@lo:400:kworker.0 Request processed in 53us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130247.436245:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789130247.436264:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626838144:12345-0@lo:400:kworker.0 Request processed in 249us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130247.436270:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789130247.436279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130247.436380:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626837760 00000100:00100000:3.0:1789130247.436384:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626837760 00000100:00100000:0.0:1789130247.436399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626837888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130247.436424:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130247.436432:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626837760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.436441:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626838144:0@lo:400:kworker.0 00000100:00100000:0.0:1789130247.436454:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626837632:0@lo:400:kworker.0 00000100:00100000:3.0:1789130247.436469:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626837760:12345-0@lo:400:kworker.0 Request processed in 39us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130247.436476:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789130247.436492:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130247.436505:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771268 gen 2 00000004:00080000:3.0:1789130247.436511:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4be5f2d00, transno 30064771268 00000100:00100000:3.0:1789130247.436546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626837760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130247.436676:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838016 00000100:00100000:2.0:1789130247.436680:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838016 00000100:00100000:2.0:1789130247.436720:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789130247.436726:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130247.436762:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626838016:12345-0@lo:400:kworker.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130247.436768:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789130247.436839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38969a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626838016:0@lo:400:kworker.0 00000100:00080000:3.0:1789130247.437018:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130247.623770:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130248.261847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130248.267820:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009664 00000100:00100000:0.0:1789130248.267842:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009664 00000100:00100000:0.0:1789130248.267999:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 416 00000100:00100000:0.0:1789130248.268014:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:37764:x1876037605009664:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130248.268180:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38685f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+40:37764:x1876037605009664:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 169us (6348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130248.268187:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 416 00000100:00080000:3.0:1789130248.269233:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130248.274775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130248.274885:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605009920 00000100:00100000:0.0:1789130248.274899:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605009920 00000100:00100000:0.0:1789130248.274980:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130248.274990:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+40:37764:x1876037605009920:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130248.275815:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:37764:x1876037605009920:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 820us (1051us total) trans 30064771440 rc 0/0 00000100:00100000:0.0:1789130248.275826:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:3.0:1789130248.454051:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626838272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130248.454164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130248.454318:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838272 00000100:00100000:2.0:1789130248.454341:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838272 00000100:00100000:2.0:1789130248.454476:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789130248.454488:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626838272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130248.454546:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:2.0:1789130248.454701:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626838272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130248.454709:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789130248.457136:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626838272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130248.645839:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130248.735795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130248.735936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130248.735982:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130248.736017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130248.736044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130248.736105:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010048 00000100:00100000:3.0:1789130248.736119:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010048 00000100:00100000:3.0:1789130248.736180:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:3.0:1789130248.736190:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605010048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130248.736279:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605010048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130248.736305:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:0.0:1789130248.737319:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010432 00000100:00100000:0.0:1789130248.737341:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010432 00000100:00100000:0.0:1789130248.737419:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010304 00000100:00100000:0.0:1789130248.737422:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010304 00000100:00100000:0.0:1789130248.737449:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130248.737459:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037605010432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130248.737555:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+9:2368:x1876037605010432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 98us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130248.737563:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130248.737580:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789130248.737586:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605010304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130248.737648:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605010304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 62us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130248.737658:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00080000:3.0:1789130248.738510:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130248.738526:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130248.739291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130248.739757:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010176 00000100:00100000:3.0:1789130248.739768:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010176 00000100:00100000:3.0:1789130248.739837:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010560 00000100:00100000:3.0:1789130248.739842:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010560 00000100:00100000:3.0:1789130248.739875:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010688 00000100:00100000:3.0:1789130248.739878:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010688 00000100:00100000:3.0:1789130248.739896:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:3.0:1789130248.739981:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037605010176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130248.740089:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:2368:x1876037605010176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 111us (4310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130248.740098:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:3.0:1789130248.740116:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1789130248.740124:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605010560:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130248.740148:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605010560:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130248.740154:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1789130248.740165:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 417 00000100:00100000:3.0:1789130248.740172:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:38264:x1876037605010688:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:3.0:1789130248.740184:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130248.740211:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0d1 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130248.740295:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130248.740662:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130248.741768:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130248.741792:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130248.743163:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130248.743175:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130248.743294:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130248.745414:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130248.745458:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 6 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130248.745478:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130248.745482:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130248.745487:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4a00, rc 0) 00000100:00100000:3.0:1789130248.745767:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:38264:x1876037605010688:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 5592us (6480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130248.745778:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 417 00010000:00010000:0.0:1789130249.671597:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130250.695856:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130251.718563:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130252.132141:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771440 is committed 00000100:00100000:2.0:1789130252.550137:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626838400:0@lo:400:kworker.0 00000100:00100000:2.0:1789130252.550214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130252.550346:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838400 00000100:00100000:3.0:1789130252.550355:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838400 00000100:00100000:3.0:1789130252.550420:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789130252.550433:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626838400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626838528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130252.557273:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626839040:0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130252.557320:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130252.557325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626838912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.557327:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626838784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130252.557355:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626838656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557378:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838528 00000100:00100000:0.0:1789130252.557378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130252.557384:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838528 00000100:00100000:0.0:1789130252.557406:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838656 00000100:00100000:0.0:1789130252.557409:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838656 00000100:00100000:1.0:1789130252.557461:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789130252.557466:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130252.557470:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626838528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.557471:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626838656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557519:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626838528:12345-0@lo:400:kworker.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130252.557519:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626838656:12345-0@lo:400:kworker.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130252.557527:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789130252.557529:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130252.557549:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839040 00000100:00100000:1.0:1789130252.557552:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839040 00000100:00100000:0.0:1789130252.557569:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626838656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.557575:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838912 00000100:00100000:1.0:1789130252.557578:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838912 00000100:00100000:1.0:1789130252.557598:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1789130252.557619:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130252.557624:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130252.557626:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130252.557708:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626838400:12345-0@lo:400:kworker.0 Request processed in 7276us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130252.557718:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789130252.557775:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130252.557802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130252.560162:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626839040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130252.560259:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626839040:12345-0@lo:400:kworker.0 Request processed in 113us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130252.564562:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789130252.564617:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626838912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.564755:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626838912:12345-0@lo:400:kworker.0 Request processed in 175us (7405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130252.564763:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789130252.564891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130252.565020:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626838912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.565038:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626838528:0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.565051:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626839040:0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.565100:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626838784 00000100:00100000:0.0:1789130252.565107:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626838784 00000100:00100000:0.0:1789130252.565142:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789130252.565148:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.565184:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626838784:12345-0@lo:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130252.565191:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789130252.565213:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626838784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130252.566100:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839168 00000100:00100000:0.0:1789130252.566113:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839168 00000100:00100000:0.0:1789130252.566164:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789130252.566173:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626839168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130252.566209:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 197591040 pending 0 free 3772776448 avail 3770679296 00000100:00100000:0.0:1789130252.566275:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626839168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (8472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130252.566283:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789130252.566546:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626838400:0@lo:400:kworker.0 00000100:00100000:2.0:1789130252.566756:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130252.566835:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000001:02000400:0.0:1789130252.669137:0:40584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 08:37:30 (1789130250) 00010000:00010000:0.0:1789130252.742128:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130253.574981:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130253.575077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130253.575229:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839296 00000100:00100000:0.0:1789130253.575239:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839296 00000100:00100000:0.0:1789130253.575302:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789130253.575312:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626839296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130253.575352:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:0.0:1789130253.575411:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626839296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130253.575419:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789130253.578573:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626839296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130253.765981:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130253.853445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130253.853495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130253.853549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130253.853574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130253.853595:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130253.853675:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011328 00000100:00100000:3.0:1789130253.853688:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011328 00000100:00100000:3.0:1789130253.853753:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010944 00000100:00100000:3.0:1789130253.853757:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010944 00000100:00100000:3.0:1789130253.853778:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130253.853786:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037605011328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130253.854167:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037605011328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 380us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130253.854177:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130253.854195:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:3.0:1789130253.854202:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605010944:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130253.854228:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+40:2370:x1876037605010944:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130253.854234:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00080000:3.0:1789130253.854250:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130253.854407:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011072 00000100:00100000:2.0:1789130253.854413:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011072 00000100:00100000:2.0:1789130253.854462:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011200 00000100:00100000:2.0:1789130253.854466:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011200 00000100:00100000:2.0:1789130253.854487:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:2.0:1789130253.854494:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605011072:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130253.854525:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605011072:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130253.854545:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:2.0:1789130253.854560:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:2.0:1789130253.854566:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037605011200:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130253.854624:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+9:2370:x1876037605011200:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130253.854631:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789130253.854995:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605010816 00000100:00100000:0.0:1789130253.855001:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605010816 00000100:00100000:0.0:1789130253.855042:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:0.0:1789130253.855050:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605010816:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130253.855083:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605010816:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130253.855091:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00080000:3.0:1789130253.855904:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130253.855911:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130254.790061:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130255.070830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.071079:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011584 00000100:00100000:2.0:1789130255.071087:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011584 00000100:00100000:2.0:1789130255.071146:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 418 00000100:00100000:2.0:1789130255.071154:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+40:38550:x1876037605011584:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130255.071171:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130255.071173:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130255.071196:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47cea1f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac03e expref: 40 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.071210:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130255.071214:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130255.071225:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea3c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0d8 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.071576:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.071590:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 5 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.071599:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130255.071733:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130255.073643:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 5 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.074007:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 5 pid: 38723 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130255.074035:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38295d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626839424:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130255.074197:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130255.084939:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38295d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626839424:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130255.084973:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130255.090901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.093136:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011712 00000100:00100000:1.0:1789130255.093153:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011712 00010000:00010000:1.0:1789130255.093231:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 6 pid: 38723 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130255.093276:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1789130255.093286:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605011712:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130255.093302:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130255.093309:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 6 pid: 38723 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093324:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 6 pid: 38723 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093386:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4a00/0x5c74554e47cea3bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d1 expref: 6 pid: 38723 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093414:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130255.093420:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093429:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093437:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.093471:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130255.093532:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605011712:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 248us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130255.093540:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00080000:3.0:1789130255.093772:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130255.094488:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.094499:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.094525:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.094535:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.094544:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130255.097959:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcc:0x0], index 1: 0 00010000:00010000:2.0:1789130255.098926:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea3db lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.098963:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea3db lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.098978:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea3db lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099081:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099089:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099096:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099103:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130255.099107:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099115:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099127:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130255.099130:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130255.099135:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099141:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130255.099157:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000023c1f086 reply state 00000000626f7259 transno 30064771441 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130255.099175:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130255.099219:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea3c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d8 expref: 42 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099239:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea3db lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d8 expref: 41 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.099247:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.099249:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130255.099252:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759bc00, rc 0) 00000100:00100000:2.0:1789130255.099427:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+42:38550:x1876037605011584:12345-192.168.201.39@tcp:101:dd.0 Request processed in 28272us (28605us total) trans 30064771441 rc 0/0 00000100:00100000:2.0:1789130255.099436:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 418 00010000:00010000:1.0:1789130255.113507:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113524:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113531:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113537:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130255.113542:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113567:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113583:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4976b8300) 00010000:00010000:1.0:1789130255.113586:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130255.113590:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.113595:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea3d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130255.131068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.131213:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011840 00000100:00100000:0.0:1789130255.131225:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011840 00000100:00100000:0.0:1789130255.131305:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130255.131317:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+9:38550:x1876037605011840:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130255.131336:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130255.131368:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbe1a567/0x5c74554e47cea3e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0df expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130255.131512:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130255.131535:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=1418s v=(0 0) 00010000:00010000:0.0:1789130255.131540:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130255.131551:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbe1a567/0x5c74554e47cea3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0df expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.131570:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbe1a567/0x5c74554e47cea3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0df expref: 10 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.131583:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:0.0:1789130255.131775:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:38550:x1876037605011840:12345-192.168.201.39@tcp:101:dd.0 Request processed in 348us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130255.131784:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00080000:3.0:1789130255.134068:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130255.170658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130255.170852:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605011968 00000100:00100000:3.0:1789130255.170863:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605011968 00002000:00100000:3.0:1789130255.170918:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b381d4a940 x1876037605011968/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130255.170931:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d4a940 with x1876037605011968 ext(0->1048575) 00002000:00010000:3.0:1789130255.170938:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d4a940 00000100:00100000:3.0:1789130255.170975:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:3.0:1789130255.170986:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605011968:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130255.199364:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605011968:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28367us (28706us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1789130255.199377:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 339 00002000:00100000:2.0:1789130255.199391:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b381d4a940 x1876037605011968/t30064771200(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/448 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130255.199411:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381d4a940 with x1876037605011968 ext(0->1048575) 00002000:00010000:2.0:1789130255.199418:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381d4a940 00000100:00100000:0.0:1789130255.201129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.201180:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012352 00000100:00100000:2.0:1789130255.201188:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012352 00000100:00100000:2.0:1789130255.201241:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130255.201249:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+41:38550:x1876037605012352:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130255.201287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.201312:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012096 00000100:00100000:0.0:1789130255.201317:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012096 00002000:00100000:0.0:1789130255.201349:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b4be5f2d00 x1876037605012096/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.201362:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f2d00 with x1876037605012096 ext(1048576->2097151) 00002000:00010000:0.0:1789130255.201367:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f2d00 00000100:00100000:0.0:1789130255.201387:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 340 00000100:00100000:0.0:1789130255.201409:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605012096:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130255.201569:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:38550:x1876037605012352:12345-192.168.201.39@tcp:35:dd.0 Request processed in 321us (448us total) trans 30064771442 rc 0/0 00000100:00100000:2.0:1789130255.201588:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130255.220163:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605012096:12345-192.168.201.39@tcp:4:dd.0 Request processed in 18759us (18867us total) trans 30064771201 rc 0/0 00000100:00100000:2.0:1789130255.220179:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 340 00002000:00100000:2.0:1789130255.220193:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b4be5f2d00 x1876037605012096/t30064771201(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/448 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130255.220205:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f2d00 with x1876037605012096 ext(1048576->2097151) 00002000:00010000:2.0:1789130255.220212:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f2d00 00000100:00100000:0.0:1789130255.270136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.270893:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012480 00000100:00100000:2.0:1789130255.270909:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012480 00000100:00100000:2.0:1789130255.271001:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 419 00000100:00100000:2.0:1789130255.271014:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+42:38551:x1876037605012480:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:2.0:1789130255.271058:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130255.271091:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea3f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0e6 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271185:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271216:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271231:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130255.271327:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130255.271332:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130255.271545:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271580:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0e6 expref: 44 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271681:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0e6 expref: 43 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.271768:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789130255.271771:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130255.271776:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759a400, rc 0) 00000100:00100000:2.0:1789130255.271879:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+43:38551:x1876037605012480:12345-192.168.201.39@tcp:101:chown.0 Request processed in 867us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130255.271887:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 419 00000100:00100000:1.0:1789130255.278004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.278206:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012608 00000100:00100000:0.0:1789130255.278220:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012608 00000100:00100000:0.0:1789130255.278315:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 420 00000100:00100000:0.0:1789130255.278329:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:38551:x1876037605012608:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130255.278369:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130255.278410:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47cea3fe lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0ed expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278465:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47cea405 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278483:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47cea405 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278496:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47cea405 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278669:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47cea3fe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ed expref: 45 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278705:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47cea405 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ed expref: 44 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.278714:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130255.278717:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130255.278722:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362200, rc 0) 00000100:00100000:0.0:1789130255.278810:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+44:38551:x1876037605012608:12345-192.168.201.39@tcp:101:chown.0 Request processed in 484us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130255.278818:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 420 00000100:00100000:3.0:1789130255.285823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.285988:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012864 00000100:00100000:2.0:1789130255.286002:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012864 00000100:00100000:2.0:1789130255.286095:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 421 00000100:00100000:2.0:1789130255.286109:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+44:38551:x1876037605012864:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:2.0:1789130255.286185:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130255.286224:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea3db lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0d8 expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.286247:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.286266:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130255.286307:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.286326:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.286368:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130255.287055:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].15, 88 off9344 00000004:00080000:2.0:1789130255.287071:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1418384467808ns, next at 1419384464410ns, rc = 0 00000004:00010000:2.0:1789130255.287193:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063042f3c reply state 000000006e6a3b8e transno 30064771443 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130255.287206:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130255.287360:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:38551:x1876037605012864:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1251us (1550us total) trans 30064771443 rc 0/0 00000100:00100000:2.0:1789130255.287369:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 421 00010000:00010000:0.0:1789130255.293126:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.293151:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.293161:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130255.293167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130255.293168:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130255.293174:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.293182:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.293213:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130255.293217:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130255.293223:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.293239:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea40c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130255.293775:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605012992 00000100:00100000:1.0:1789130255.293789:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605012992 00000100:00100000:1.0:1789130255.293860:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 422 00000100:00100000:1.0:1789130255.293872:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:38551:x1876037605012992:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130255.293905:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130255.293929:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea413 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0f4 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.294014:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea413 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0f4 expref: 45 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.294029:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea413 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0f4 expref: 45 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.294051:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.294075:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130255.294078:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:1.0:1789130255.294155:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38295d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:38551:x1876037605012992:12345-192.168.201.39@tcp:101:chown.0 Request processed in 285us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130255.294163:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 422 00000100:00100000:1.0:1789130255.298789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.301451:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605013120 00000100:00100000:0.0:1789130255.301474:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605013120 00000100:00100000:0.0:1789130255.301588:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:0.0:1789130255.301617:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605013120:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:0.0:1789130255.301916:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789130255.301920:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1789130254 00002000:00010000:0.0:1789130255.301923:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130255.301925:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1789130255 00002000:00010000:0.0:1789130255.301928:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130255.302022:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605013120:12345-192.168.201.39@tcp:2:chown.0 Request processed in 423us (3248us total) trans 30064771202 rc 0/0 00000100:00100000:0.0:1789130255.302034:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:2.0:1789130255.378948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.379415:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605013376 00000100:00100000:1.0:1789130255.379431:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605013376 00000100:00100000:1.0:1789130255.379516:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 423 00000100:00100000:1.0:1789130255.379529:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:38557:x1876037605013376:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:1.0:1789130255.379560:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130255.379589:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea41a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac0fb expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379753:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379772:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379787:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379806:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379813:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.379819:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380032:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea42f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380043:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea42f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380051:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea42f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130255.380063:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:1.0:1789130255.380211:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380219:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380226:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380232:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130255.380237:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380246:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380272:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:1.0:1789130255.380275:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130255.380281:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380299:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87000/0x5c74554e47cea421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380320:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380326:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380332:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380337:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130255.380340:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380346:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380354:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4909bda00) 00010000:00010000:1.0:1789130255.380357:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130255.380360:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380366:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47cea428 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380435:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47cea41a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0fb expref: 48 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380467:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea42f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0fb expref: 47 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.380476:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.380479:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130255.380482:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:1.0:1789130255.384763:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+47:38557:x1876037605013376:12345-192.168.201.39@tcp:101:dd.500 Request processed in 5218us (5814us total) trans 30064771444 rc 0/0 00000100:00100000:1.0:1789130255.384780:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 423 00000100:00100000:1.0:1789130255.388741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130255.388881:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605013632 00000100:00100000:3.0:1789130255.388893:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605013632 00000100:00100000:3.0:1789130255.388967:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 424 00000100:00100000:3.0:1789130255.388978:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+47:38557:x1876037605013632:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130255.389010:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130255.389014:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1789130255.389048:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47cea413 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0f4 expref: 47 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389076:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47cea42f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0fb expref: 46 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389088:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.389110:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130255.389127:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea43d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac102 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389177:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389203:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389214:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389230:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389238:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389246:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389259:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130255.389264:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389273:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389281:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.389283:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130255.389287:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389298:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea444 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389327:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389503:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389515:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389827:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac102 expref: 48 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389836:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.389838:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130255.389849:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea43d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac102 expref: 48 pid: 36589 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389864:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac102 expref: 47 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.389891:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.389894:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130255.389896:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5c00, rc 0) 00000100:00100000:3.0:1789130255.391244:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+47:38557:x1876037605013632:12345-192.168.201.39@tcp:101:dd.500 Request processed in 2252us (2502us total) trans 30064771445 rc 0/0 00000100:00100000:3.0:1789130255.391674:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 424 00000100:00100000:3.0:1789130255.411507:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.411924:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605013760 00000100:00100000:1.0:1789130255.411938:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605013760 00002000:00100000:0.0:1789130255.412667:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac4780 x1876037605013760/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.412682:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4780 with x1876037605013760 ext(0->1048575) 00002000:00010000:0.0:1789130255.412690:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac4780 00000100:00100000:0.0:1789130255.412784:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:0.0:1789130255.412795:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037605013760:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:0.0:1789130255.441438:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037605013760:12345-192.168.201.39@tcp:3:dd.0 Request processed in 28633us (29936us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130255.441453:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 341 00002000:00100000:0.0:1789130255.441467:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac4780 x1876037605013760/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/440 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.441479:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4780 with x1876037605013760 ext(0->1048575) 00002000:00010000:0.0:1789130255.441486:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac4780 00000100:00100000:0.0:1789130255.461953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.462057:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605013888 00000100:00100000:2.0:1789130255.462068:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605013888 00002000:00100000:2.0:1789130255.462131:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b4be5f12c0 x1876037605013888/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130255.462142:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f12c0 with x1876037605013888 ext(1048576->2097151) 00002000:00010000:2.0:1789130255.462149:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f12c0 00000100:00100000:2.0:1789130255.462172:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 342 00000100:00100000:2.0:1789130255.462181:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605013888:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:2.0:1789130255.480781:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605013888:12345-192.168.201.39@tcp:3:dd.0 Request processed in 18589us (18827us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130255.480798:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 342 00002000:00100000:2.0:1789130255.480812:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b4be5f12c0 x1876037605013888/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/440 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130255.480836:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4be5f12c0 with x1876037605013888 ext(1048576->2097151) 00002000:00010000:2.0:1789130255.480843:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4be5f12c0 00000100:00100000:1.0:1789130255.495161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.495435:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605014144 00000100:00100000:2.0:1789130255.495444:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605014144 00000100:00100000:2.0:1789130255.495494:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:2.0:1789130255.495502:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:38557:x1876037605014144:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:2.0:1789130255.496076:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:38557:x1876037605014144:12345-192.168.201.39@tcp:35:dd.500 Request processed in 572us (924us total) trans 30064771446 rc 0/0 00000100:00100000:2.0:1789130255.496085:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:0.0:1789130255.603040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.603155:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605014272 00000100:00100000:2.0:1789130255.603167:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605014272 00000100:00100000:2.0:1789130255.603229:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 425 00000100:00100000:2.0:1789130255.603240:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:38567:x1876037605014272:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130255.603329:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603357:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603370:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603386:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603406:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603433:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603534:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603543:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603550:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130255.603588:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603642:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603649:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603655:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603661:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759bc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130255.603665:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603672:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603684:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789130255.603694:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130255.603700:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603707:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603721:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603727:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603733:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603738:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130255.603741:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603747:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603755:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b482b51b00) 00010000:00010000:2.0:1789130255.603757:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130255.603760:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603766:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603781:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603806:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603813:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603819:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759b600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130255.603822:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603829:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603837:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.603839:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130255.603842:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.603847:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b600/0x5c74554e47cea460 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130255.603915:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:38567:x1876037605014272:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 676us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130255.603923:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 425 00000100:00100000:0.0:1789130255.651588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.651764:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605014528 00000100:00100000:1.0:1789130255.651774:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605014528 00000100:00100000:1.0:1789130255.651866:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 426 00000100:00100000:1.0:1789130255.651877:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:38568:x1876037605014528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130255.651896:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130255.651915:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9a00/0x5c74554e47cea467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac109 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.651988:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652003:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652044:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652061:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652069:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652076:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652176:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652184:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652191:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652197:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130255.652202:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652208:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652220:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:1.0:1789130255.652223:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130255.652228:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652242:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea46e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652257:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652263:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652270:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652274:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130255.652277:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652283:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652290:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4909bda00) 00010000:00010000:1.0:1789130255.652292:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130255.652295:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652300:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652335:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9a00/0x5c74554e47cea467 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac109 expref: 49 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652358:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:1.0:1789130255.652360:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130255.652364:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9a00/0x5c74554e47cea467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac109 expref: 49 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.652374:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb9a00, rc 0) 00000100:00100000:1.0:1789130255.652451:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:38568:x1876037605014528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 576us (873us total) trans 0 rc 301/301 00000100:00100000:1.0:1789130255.652459:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 426 00000100:00100000:1.0:1789130255.657160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130255.657301:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605014656 00000100:00100000:3.0:1789130255.657313:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605014656 00000100:00100000:3.0:1789130255.657385:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 427 00000100:00100000:3.0:1789130255.657405:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:38568:x1876037605014656:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130255.657490:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657510:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657524:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657542:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657550:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657556:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657854:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657864:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657872:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130255.657919:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00000004:00200000:3.0:1789130255.657924:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130255.657936:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657950:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657956:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657962:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657969:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130255.657973:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657980:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.657992:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:3.0:1789130255.657995:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130255.658000:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658007:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea47c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658081:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658100:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658106:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658111:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130255.658115:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658121:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658130:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b496419c00) 00010000:00010000:3.0:1789130255.658133:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130255.658136:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658142:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4200/0x5c74554e47cea483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658156:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658162:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658167:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658172:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130255.658181:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658187:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658195:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.658198:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130255.658201:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.658207:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea48a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130255.658290:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:38568:x1876037605014656:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 885us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130255.658298:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 427 00000100:00100000:2.0:1789130255.714652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.714807:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605014912 00000100:00100000:0.0:1789130255.714816:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605014912 00000100:00100000:0.0:1789130255.714928:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 428 00000100:00100000:0.0:1789130255.714939:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:38574:x1876037605014912:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130255.714959:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130255.714962:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130255.714988:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a400/0x5c74554e47cea3f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0e6 expref: 48 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715007:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:0.0:1789130255.715022:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130255.715038:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea491 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac110 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715198:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715211:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715221:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715236:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715241:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715247:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715320:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea4a6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715329:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea4a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715335:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea4a6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130255.715345:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:0.0:1789130255.715458:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715466:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715472:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715477:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130255.715481:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715489:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715497:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130255.715500:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130255.715503:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715510:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715521:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715526:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715536:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715541:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130255.715543:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715549:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715556:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b497c01200) 00010000:00010000:0.0:1789130255.715559:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130255.715562:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715568:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea49f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715658:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea491 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac110 expref: 50 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715675:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea4a6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac110 expref: 49 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.715682:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130255.715684:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130255.715687:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34e00, rc 0) 00000100:00100000:0.0:1789130255.715750:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:38574:x1876037605014912:12345-192.168.201.39@tcp:101:dd.0 Request processed in 813us (1107us total) trans 30064771447 rc 0/0 00000100:00100000:0.0:1789130255.715761:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 428 00000100:00100000:0.0:1789130255.719854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.720013:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605015168 00000100:00100000:1.0:1789130255.720025:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605015168 00000100:00100000:1.0:1789130255.720124:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 429 00000100:00100000:1.0:1789130255.720135:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+49:38574:x1876037605015168:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:1.0:1789130255.720191:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130255.720217:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5c00/0x5c74554e47cea44b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac102 expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.720239:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea4a6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac110 expref: 48 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.720250:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.720256:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130255.720482:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.720517:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.720528:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130255.720584:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771448 00000004:00010000:1.0:1789130255.720653:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c9d8f1ad reply state 00000000e4cced99 transno 30064771449 ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130255.720661:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130255.720743:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38969ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:38574:x1876037605015168:12345-192.168.201.39@tcp:36:dd.0 Request processed in 611us (900us total) trans 30064771449 rc 0/0 00000100:00100000:1.0:1789130255.720748:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 429 00000020:00080000:1.0:1789130255.720752:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130255.725861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130255.725910:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725922:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725929:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725936:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130255.725940:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725948:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725963:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130255.725965:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130255.725969:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130255.725974:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8c00/0x5c74554e47cea4b4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130255.726044:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605015296 00000100:00100000:3.0:1789130255.726056:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605015296 00000100:00100000:3.0:1789130255.726109:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 430 00000100:00100000:3.0:1789130255.726120:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+49:38574:x1876037605015296:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130255.726144:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130255.726162:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea4bb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac117 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.726222:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea4bb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac117 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.726235:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea4bb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac117 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130255.726290:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789130255.726293:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130255.726295:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4c00, rc 0) 00000100:00100000:3.0:1789130255.726358:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:38574:x1876037605015296:12345-192.168.201.39@tcp:101:dd.0 Request processed in 240us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130255.726363:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 430 00000100:00100000:0.0:1789130255.731127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.731180:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605015552 00000100:00100000:2.0:1789130255.731191:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605015552 00000100:00100000:2.0:1789130255.731253:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 431 00000100:00100000:2.0:1789130255.731263:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:38574:x1876037605015552:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130255.731303:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130255.731306:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130255.731333:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47cea4bb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac117 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731360:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.731364:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130255.731377:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea4c2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac11e expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731433:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731444:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731450:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731666:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac11e expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731671:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.731673:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130255.731687:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a800/0x5c74554e47cea4c2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac11e expref: 52 pid: 36588 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731697:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac11e expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130255.731728:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130255.731730:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130255.731731:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759bc00, rc 0) 00000100:00100000:2.0:1789130255.731786:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:38574:x1876037605015552:12345-192.168.201.39@tcp:101:dd.0 Request processed in 525us (669us total) trans 30064771450 rc 0/0 00000100:00100000:2.0:1789130255.731794:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 431 00000100:00100000:0.0:1789130255.752311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130255.752488:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605015808 00000100:00100000:1.0:1789130255.752499:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605015808 00000100:00100000:1.0:1789130255.752599:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 432 00000100:00100000:1.0:1789130255.752640:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:38574:x1876037605015808:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130255.752667:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130255.752670:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130255.752699:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759bc00/0x5c74554e47cea4c9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac11e expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.752719:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.752725:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130255.752738:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9200/0x5c74554e47cea4d0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac125 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.752810:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.752824:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.752834:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130255.753288:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].16, 88 off9432 00000004:00080000:1.0:1789130255.753297:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1418850694306ns, next at 1419384464410ns, rc = 0 00010000:00010000:0.0:1789130255.814827:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130255.847705:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771447 is committed 00000001:00080000:3.0:1789130255.847725:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771451 is committed 00000004:00080000:3.0:1789130255.847729:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:3.0:1789130255.847763:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00010000:00010000:1.0:1789130255.847942:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac125 expref: 42 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.847956:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.847959:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130255.847979:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9200/0x5c74554e47cea4d0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac125 expref: 42 pid: 38723 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.848191:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac125 expref: 41 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130255.848230:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130255.848233:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130255.848236:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb8a00, rc 0) 00000100:00100000:1.0:1789130255.848325:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+41:38574:x1876037605015808:12345-192.168.201.39@tcp:101:dd.0 Request processed in 95686us (96020us total) trans 30064771451 rc 0/0 00000100:00100000:1.0:1789130255.848748:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 432 00000100:00100000:1.0:1789130255.849235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130255.849254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626839552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130255.849323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130255.849631:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839552 00000100:00100000:0.0:1789130255.849641:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839552 00000100:00100000:0.0:1789130255.849700:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789130255.849708:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626839552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789130255.849966:0:37276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1789130255.849970:0:37276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789130254 -> 1789130254 00002000:00010000:0.0:1789130255.849973:0:37276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130255.849975:0:37276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789130255 -> 1789130255 00002000:00010000:0.0:1789130255.849977:0:37276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130255.850041:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626839552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (717us total) trans 30064771203 rc 0/0 00000100:00100000:0.0:1789130255.850050:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789130255.850155:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789130255.850437:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b48e6e03c0/2, rc 0, transno 30064771203 00000100:00100000:1.0:1789130255.850446:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626839552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130255.850551:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130255.850758:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c19661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626839680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130255.850796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130255.851114:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839680 00000100:00100000:1.0:1789130255.851120:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839680 00000100:00100000:1.0:1789130255.851200:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789130255.851208:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626839680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130255.853510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.853760:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605015936 00000100:00100000:2.0:1789130255.853770:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605015936 00002000:00010000:2.0:1789130255.853812:0:40190:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:2.0:1789130255.853818:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5a40 with x1876037605015936 ext(0->18446744073709551615) 00002000:00010000:2.0:1789130255.853831:0:40190:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5a40. 00000100:00100000:2.0:1789130255.853874:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:2.0:1789130255.853884:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605015936:12345-192.168.201.39@tcp:10:dd.0 00002000:00010000:1.0:1789130255.856545:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1789130255.856556:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789130254 -> 1789130254 00002000:00010000:1.0:1789130255.856559:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130255.856561:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789130255 -> 1789130255 00002000:00010000:1.0:1789130255.856564:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130255.856690:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626839680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5478us (5888us total) trans 30064771204 rc 0/0 00000100:00100000:1.0:1789130255.856703:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000004:00080000:3.0:1789130255.857452:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4c19661c0/2, rc 0, transno 30064771204 00000100:00100000:3.0:1789130255.857462:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c19661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626839680:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789130255.857737:0:40190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:2.0:1789130255.857741:0:40190:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789130254 -> 1789130255 00002000:00010000:2.0:1789130255.857743:0:40190:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130255.857745:0:40190:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789130255 -> 1789130255 00002000:00010000:2.0:1789130255.857747:0:40190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130255.857814:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037605015936:12345-192.168.201.39@tcp:10:dd.0 Request processed in 3929us (4309us total) trans 30064771205 rc 0/0 00000100:00100000:2.0:1789130255.857824:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 343 00002000:00010000:2.0:1789130255.857830:0:40190:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:2.0:1789130255.857841:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5a40 with x1876037605015936 ext(0->18446744073709551615) 00002000:00010000:2.0:1789130255.857849:0:40190:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5a40. 00000100:00100000:3.0:1789130255.905005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130255.905303:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016064 00000100:00100000:2.0:1789130255.905317:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016064 00002000:00100000:2.0:1789130255.905455:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac5680 x1876037605016064/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130255.905469:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5680 with x1876037605016064 ext(0->1048575) 00002000:00010000:2.0:1789130255.905478:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5680 00000100:00100000:2.0:1789130255.905587:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 344 00000100:00100000:2.0:1789130255.905708:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+16:2367:x1876037605016064:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130255.930929:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+18:2367:x1876037605016064:12345-192.168.201.39@tcp:4:dd.0 Request processed in 24889us (25498us total) trans 30064771206 rc 0/0 00000100:00100000:0.0:1789130255.930949:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 344 00002000:00100000:0.0:1789130255.930970:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac5680 x1876037605016064/t30064771206(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/448 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.930983:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5680 with x1876037605016064 ext(0->1048575) 00002000:00010000:0.0:1789130255.930992:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5680 00000100:00100000:2.0:1789130255.946826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.951708:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016192 00000100:00100000:0.0:1789130255.951734:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016192 00002000:00100000:0.0:1789130255.951822:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b38274ad00 x1876037605016192/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.951838:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274ad00 with x1876037605016192 ext(1048576->2097151) 00002000:00010000:0.0:1789130255.952991:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38274ad00 00000100:00100000:3.0:1789130255.953444:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:3.0:1789130255.953472:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+18:2367:x1876037605016192:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130255.990983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130255.991441:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016320 00000100:00100000:0.0:1789130255.991458:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016320 00002000:00100000:0.0:1789130255.991534:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff90b498b21a40 x1876037605016320/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/0 e 0 to 0 dl 1789130266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130255.991548:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b21a40 with x1876037605016320 ext(2097152->3145727) 00002000:00010000:0.0:1789130255.991557:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498b21a40 00000100:00100000:0.0:1789130255.991599:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 346 00000100:00100000:0.0:1789130255.991649:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+20:2369:x1876037605016320:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130256.005484:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+22:2367:x1876037605016192:12345-192.168.201.39@tcp:4:dd.0 Request processed in 52005us (58653us total) trans 30064771207 rc 0/0 00000100:00100000:1.0:1789130256.005506:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 345 00002000:00100000:1.0:1789130256.005528:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b38274ad00 x1876037605016192/t30064771207(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/448 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.005542:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b38274ad00 with x1876037605016192 ext(1048576->2097151) 00002000:00010000:1.0:1789130256.005581:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b38274ad00 00000100:00100000:3.0:1789130256.010901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.014204:0:37280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016448 00000100:00100000:1.0:1789130256.014224:0:37280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016448 00002000:00100000:1.0:1789130256.014297:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff90b498ac7840 x1876037605016448/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.014311:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac7840 with x1876037605016448 ext(3145728->4194303) 00002000:00010000:1.0:1789130256.014319:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac7840 00000100:00100000:1.0:1789130256.014354:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:1.0:1789130256.014366:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+22:2370:x1876037605016448:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130256.020750:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+24:2369:x1876037605016320:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28395us (29074us total) trans 30064771208 rc 0/0 00000100:00100000:0.0:1789130256.020778:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 346 00002000:00100000:0.0:1789130256.020800:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff90b498b21a40 x1876037605016320/t30064771208(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:726/0 lens 488/448 e 0 to 0 dl 1789130266 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.020820:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b21a40 with x1876037605016320 ext(2097152->3145727) 00002000:00010000:0.0:1789130256.020830:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498b21a40 00000100:00100000:1.0:1789130256.042380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130256.042479:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016576 00000100:00100000:3.0:1789130256.042501:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016576 00002000:00100000:3.0:1789130256.042777:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff90b498b212c0 x1876037605016576/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130256.042813:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b212c0 with x1876037605016576 ext(4194304->5242879) 00002000:00010000:3.0:1789130256.042820:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498b212c0 00000100:00100000:3.0:1789130256.042855:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:3.0:1789130256.042866:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+24:2368:x1876037605016576:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130256.043758:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605016448:12345-192.168.201.39@tcp:4:dd.0 Request processed in 29385us (32859us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1789130256.043773:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 347 00002000:00100000:1.0:1789130256.043787:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff90b498ac7840 x1876037605016448/t30064771209(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/448 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.043812:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac7840 with x1876037605016448 ext(3145728->4194303) 00002000:00010000:1.0:1789130256.043820:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac7840 00000100:00100000:1.0:1789130256.043975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130256.044265:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016832 00000100:00100000:3.0:1789130256.044277:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016832 00000100:00100000:3.0:1789130256.044337:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1789130256.044346:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+41:38574:x1876037605016832:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:3.0:1789130256.045783:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+42:38574:x1876037605016832:12345-192.168.201.39@tcp:35:dd.0 Request processed in 1430us (1800us total) trans 30064771452 rc 0/0 00000100:00100000:3.0:1789130256.045794:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130256.099171:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+26:2368:x1876037605016576:12345-192.168.201.39@tcp:4:dd.0 Request processed in 56279us (56778us total) trans 30064771210 rc 0/0 00000100:00100000:2.0:1789130256.099192:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 348 00002000:00100000:2.0:1789130256.099218:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff90b498b212c0 x1876037605016576/t30064771210(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/448 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130256.099231:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498b212c0 with x1876037605016576 ext(4194304->5242879) 00002000:00010000:2.0:1789130256.099241:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498b212c0 00000100:00100000:0.0:1789130256.177555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130256.177854:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605016960 00000100:00100000:3.0:1789130256.177866:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605016960 00000100:00100000:0.0:1789130256.178005:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 433 00000100:00100000:0.0:1789130256.178016:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+42:38584:x1876037605016960:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130256.178041:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130256.178063:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac12c expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178127:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178142:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178161:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130256.178354:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130256.178359:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130256.178659:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178686:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac12c expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178703:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac12c expref: 43 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.178712:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130256.178715:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130256.178718:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00100000:0.0:1789130256.178817:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+43:38584:x1876037605016960:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 802us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130256.178826:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 433 00000100:00100000:1.0:1789130256.191905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.191987:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017088 00000100:00100000:0.0:1789130256.191997:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017088 00000100:00100000:0.0:1789130256.192052:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 434 00000100:00100000:0.0:1789130256.192060:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:38584:x1876037605017088:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130256.192126:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192140:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192150:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192160:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192164:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192168:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192463:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192470:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192474:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130256.192510:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192519:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192523:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192528:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192539:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.192543:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192550:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192562:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130256.192564:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.192569:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192575:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192587:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192593:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192599:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192649:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.192651:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192656:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192664:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b497c01200) 00010000:00010000:0.0:1789130256.192666:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.192668:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192671:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea4f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192682:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192688:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192693:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192697:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.192700:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192705:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192712:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.192714:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.192718:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.192723:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea4fa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130256.192797:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+43:38584:x1876037605017088:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 737us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130256.192803:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 434 00000040:00080000:3.0:1789130256.262480:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130256.262490:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130256.262543:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 3 00000040:00080000:3.0:1789130256.262551:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130256.309935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.310169:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017344 00000100:00100000:1.0:1789130256.310186:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017344 00000100:00100000:1.0:1789130256.310269:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 435 00000100:00100000:1.0:1789130256.310281:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+43:38590:x1876037605017344:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:1.0:1789130256.310304:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130256.310327:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9000/0x5c74554e47cea501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac133 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310446:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310466:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310480:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310505:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310512:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.310518:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311133:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9e00/0x5c74554e47cea516 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311146:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9e00/0x5c74554e47cea516 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311153:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9e00/0x5c74554e47cea516 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130256.311164:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:1.0:1789130256.311263:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311280:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311286:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311292:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.311296:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311302:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311314:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130256.311317:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.311322:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311327:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8600/0x5c74554e47cea508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311341:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311346:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311351:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311356:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b381fb8e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.311363:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311369:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311376:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4909bda00) 00010000:00010000:1.0:1789130256.311391:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.311394:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311400:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8e00/0x5c74554e47cea50f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311443:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9000/0x5c74554e47cea501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac133 expref: 46 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311457:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9e00/0x5c74554e47cea516 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac133 expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.311463:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130256.311466:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130256.311468:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b381fb9e00, rc 0) 00000100:00100000:1.0:1789130256.311547:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+45:38590:x1876037605017344:12345-192.168.201.39@tcp:101:dd.500 Request processed in 1268us (1631us total) trans 30064771453 rc 0/0 00000100:00100000:1.0:1789130256.311556:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 435 00000100:00100000:2.0:1789130256.315490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.315656:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017600 00000100:00100000:0.0:1789130256.315669:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017600 00000100:00100000:0.0:1789130256.315818:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 436 00000100:00100000:0.0:1789130256.315830:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:38590:x1876037605017600:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130256.315865:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130256.315869:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1789130256.315906:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb8a00/0x5c74554e47cea4d7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac125 expref: 45 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.315935:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9e00/0x5c74554e47cea516 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac133 expref: 44 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.315946:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.315951:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130256.315968:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea524 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac13a expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316037:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316054:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316067:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316085:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316092:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316099:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316107:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.316111:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316120:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316128:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.316130:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130256.316135:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316140:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea52b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316183:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316192:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316199:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316527:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac13a expref: 46 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316535:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.316537:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130256.316548:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea524 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac13a expref: 46 pid: 36589 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316562:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac13a expref: 45 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.316591:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.316593:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130256.316595:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35e00, rc 0) 00000100:00100000:0.0:1789130256.316708:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:38590:x1876037605017600:12345-192.168.201.39@tcp:101:dd.500 Request processed in 879us (1235us total) trans 30064771454 rc 0/0 00000100:00100000:0.0:1789130256.316717:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 436 00000100:00100000:3.0:1789130256.337976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.338301:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017728 00000100:00100000:0.0:1789130256.338315:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017728 00002000:00100000:0.0:1789130256.338411:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac4000 x1876037605017728/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.338425:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4000 with x1876037605017728 ext(0->1048575) 00002000:00010000:0.0:1789130256.338433:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac4000 00000100:00100000:0.0:1789130256.338473:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 349 00000100:00100000:0.0:1789130256.338485:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605017728:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:0.0:1789130256.362300:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605017728:12345-192.168.201.39@tcp:3:dd.0 Request processed in 23801us (24323us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130256.362318:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 349 00002000:00100000:0.0:1789130256.362335:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff90b498ac4000 x1876037605017728/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/440 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.362347:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4000 with x1876037605017728 ext(0->1048575) 00002000:00010000:0.0:1789130256.362356:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac4000 00000100:00100000:3.0:1789130256.376219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.376360:0:39570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017856 00000100:00100000:1.0:1789130256.376374:0:39570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017856 00002000:00100000:1.0:1789130256.376458:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b498ac5e00 x1876037605017856/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.376504:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5e00 with x1876037605017856 ext(1048576->2097151) 00002000:00010000:1.0:1789130256.376512:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5e00 00000100:00100000:1.0:1789130256.376673:0:39570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 350 00000100:00100000:1.0:1789130256.376685:0:39570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605017856:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:1.0:1789130256.408834:0:39570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605017856:12345-192.168.201.39@tcp:3:dd.0 Request processed in 32132us (32614us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130256.408856:0:39570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 350 00002000:00100000:1.0:1789130256.408875:0:39570:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff90b498ac5e00 x1876037605017856/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/440 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.408887:0:39570:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5e00 with x1876037605017856 ext(1048576->2097151) 00002000:00010000:1.0:1789130256.408899:0:39570:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b498ac5e00 00000100:00100000:3.0:1789130256.428836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130256.428893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.429796:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605017984 00000100:00100000:0.0:1789130256.429807:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605017984 00002000:00100000:0.0:1789130256.429860:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff90b4bfcd6d00 x1876037605017984/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.429871:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd6d00 with x1876037605017984 ext(2097152->3145727) 00002000:00010000:0.0:1789130256.429877:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd6d00 00000100:00100000:0.0:1789130256.429903:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605018112 00000100:00100000:0.0:1789130256.429905:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605018112 00002000:00100000:0.0:1789130256.429918:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff90b4bfcd4f00 x1876037605018112/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.429925:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd4f00 with x1876037605018112 ext(3145728->4194303) 00002000:00010000:0.0:1789130256.429927:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd4f00 00000100:00100000:0.0:1789130256.429940:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 351 00000100:00100000:0.0:1789130256.429948:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+27:2369:x1876037605017984:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:1.0:1789130256.430586:0:37280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 352 00000100:00100000:1.0:1789130256.430598:0:37280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+28:2370:x1876037605018112:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:0.0:1789130256.458387:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+28:2369:x1876037605017984:12345-192.168.201.39@tcp:3:dd.0 Request processed in 28414us (29539us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130256.458404:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 351 00002000:00100000:0.0:1789130256.458423:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff90b4bfcd6d00 x1876037605017984/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/440 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130256.458435:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd6d00 with x1876037605017984 ext(2097152->3145727) 00002000:00010000:0.0:1789130256.458444:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd6d00 00000100:00100000:1.0:1789130256.464669:0:37280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605018112:12345-192.168.201.39@tcp:3:dd.0 Request processed in 34060us (35761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789130256.464697:0:37280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 352 00002000:00100000:1.0:1789130256.464712:0:37280:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff90b4bfcd4f00 x1876037605018112/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/440 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130256.464725:0:37280:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd4f00 with x1876037605018112 ext(3145728->4194303) 00002000:00010000:1.0:1789130256.464734:0:37280:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd4f00 00000100:00100000:3.0:1789130256.500311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130256.501261:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605018240 00000100:00100000:2.0:1789130256.501271:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605018240 00002000:00100000:2.0:1789130256.501316:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff90b4bfcd70c0 x1876037605018240/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/0 e 0 to 0 dl 1789130267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130256.501325:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd70c0 with x1876037605018240 ext(4194304->5242879) 00002000:00010000:2.0:1789130256.501331:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd70c0 00000100:00100000:2.0:1789130256.501368:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 353 00000100:00100000:2.0:1789130256.501387:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605018240:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:3.0:1789130256.514466:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+26:2370:x1876037605018240:12345-192.168.201.39@tcp:3:dd.0 Request processed in 13077us (14150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130256.514498:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 353 00002000:00100000:3.0:1789130256.514513:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff90b4bfcd70c0 x1876037605018240/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:727/0 lens 488/440 e 0 to 0 dl 1789130267 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130256.514524:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd70c0 with x1876037605018240 ext(4194304->5242879) 00002000:00010000:3.0:1789130256.514532:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd70c0 00000100:00100000:0.0:1789130256.551061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130256.551215:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605018496 00000100:00100000:3.0:1789130256.551226:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605018496 00000100:00100000:3.0:1789130256.551366:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1789130256.551391:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:38590:x1876037605018496:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:3.0:1789130256.551814:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:38590:x1876037605018496:12345-192.168.201.39@tcp:35:dd.500 Request processed in 438us (765us total) trans 30064771455 rc 0/0 00000100:00100000:3.0:1789130256.551822:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130256.656952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.657172:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605018624 00000100:00100000:1.0:1789130256.657182:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605018624 00000100:00100000:1.0:1789130256.657261:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 437 00000100:00100000:1.0:1789130256.657271:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:38596:x1876037605018624:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130256.657362:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657389:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657402:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657419:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657426:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657433:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657944:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657953:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.657958:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130256.657991:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658000:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658014:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658021:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658027:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.658032:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658039:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658050:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130256.658053:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.658057:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658063:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658082:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658088:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658093:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658098:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.658108:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658114:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658121:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4909bda00) 00010000:00010000:1.0:1789130256.658123:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.658125:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658130:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea540 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658144:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658149:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658155:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658159:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.658161:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658167:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658173:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130256.658176:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.658185:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.658190:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea547 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130256.658428:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:38596:x1876037605018624:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1157us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130256.658438:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 437 00000100:00100000:2.0:1789130256.683892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.684100:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605018880 00000100:00100000:0.0:1789130256.684112:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605018880 00000100:00100000:0.0:1789130256.684167:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 438 00000100:00100000:0.0:1789130256.684177:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:38597:x1876037605018880:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130256.684199:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130256.684222:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac141 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684302:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684316:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684339:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684355:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684362:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684369:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684882:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684891:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684896:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684902:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.684906:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684913:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684924:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130256.684927:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.684932:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684938:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684950:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684955:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684961:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684966:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.684969:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684974:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684980:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b497c01200) 00010000:00010000:0.0:1789130256.684982:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.684984:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.684989:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea55c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.685023:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea54e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac141 expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.685033:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130256.685035:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130256.685039:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47cea54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac141 expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.685049:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:0.0:1789130256.685121:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:38597:x1876037605018880:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 944us (1239us total) trans 0 rc 301/301 00000100:00100000:0.0:1789130256.685130:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 438 00000100:00100000:3.0:1789130256.688408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.688672:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019008 00000100:00100000:0.0:1789130256.688684:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019008 00000100:00100000:0.0:1789130256.688756:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 439 00000100:00100000:0.0:1789130256.688766:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:38597:x1876037605019008:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130256.688854:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.688871:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.688882:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.688898:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.688904:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.688911:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689283:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689293:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689299:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130256.689346:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:0.0:1789130256.689351:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130256.689364:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689386:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689393:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689399:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689405:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.689409:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689417:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689429:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130256.689432:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.689436:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689443:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689455:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689461:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689467:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689473:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.689476:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689481:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689488:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b497c01d00) 00010000:00010000:0.0:1789130256.689490:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.689493:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689498:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea56a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689513:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689519:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689524:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689529:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130256.689531:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689536:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689547:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.689549:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130256.689552:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.689557:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea571 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130256.689688:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+46:38597:x1876037605019008:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 922us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130256.689698:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 439 00000100:00100000:3.0:1789130256.747279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.747458:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019136 00000100:00100000:1.0:1789130256.747471:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019136 00000100:00100000:1.0:1789130256.747532:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 440 00000100:00100000:1.0:1789130256.747542:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:38603:x1876037605019136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130256.747564:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130256.747584:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac148 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747684:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747700:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747712:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747726:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747732:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.747762:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748642:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748654:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748663:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130256.748700:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:1.0:1789130256.748705:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130256.748723:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748735:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748742:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748748:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748754:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748760:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.748763:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.748779:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749186:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130256.749191:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.749197:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749204:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749218:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749225:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749231:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749237:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130256.749240:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749247:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749256:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff90b4909bda00) 00010000:00010000:1.0:1789130256.749258:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130256.749260:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749277:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea586 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749322:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 48 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749352:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 47 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.749361:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130256.749363:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130256.749366:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed7000, rc 0) 00000100:00100000:1.0:1789130256.749459:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+47:38603:x1876037605019136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1918us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130256.749468:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 440 00000100:00100000:2.0:1789130256.754296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130256.754459:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019392 00000100:00100000:0.0:1789130256.754470:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019392 00000100:00100000:0.0:1789130256.754537:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 441 00000100:00100000:0.0:1789130256.754547:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:38603:x1876037605019392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130256.754568:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130256.754591:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac14f expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.754732:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea59b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.754747:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea59b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.754757:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea59b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130256.754768:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:0.0:1789130256.754903:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac14f expref: 50 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.754924:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea59b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac14f expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130256.754933:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789130256.754936:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789130256.754939:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34400, rc 0) 00000100:00100000:0.0:1789130256.755001:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:38603:x1876037605019392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 456us (715us total) trans 30064771456 rc 0/0 00000100:00100000:0.0:1789130256.755009:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 441 00010000:00010000:0.0:1789130256.837877:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130256.882901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130256.883216:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019648 00000100:00100000:1.0:1789130256.883226:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019648 00000100:00100000:1.0:1789130256.883337:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 442 00000100:00100000:1.0:1789130256.883349:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+49:38609:x1876037605019648:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130256.883393:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130256.883417:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac156 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.883529:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.883545:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.883572:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.883637:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.883651:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 50 pid: 36587 timeout: 1519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130256.883664:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626839808:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130256.883755:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130256.890598:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626839808:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130256.890654:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130256.891364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130256.891657:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019776 00000100:00100000:2.0:1789130256.891664:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019776 00010000:00010000:2.0:1789130256.891706:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 51 pid: 36587 timeout: 1519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130256.891739:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1789130256.891749:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:2370:x1876037605019776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130256.891762:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130256.891769:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 51 pid: 36587 timeout: 1519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891781:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 51 pid: 36587 timeout: 1519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891817:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea58d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac148 expref: 51 pid: 36587 timeout: 1519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891834:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789130256.891839:0:36573:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891849:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891857:0:36573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130256.891909:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130256.891976:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:2370:x1876037605019776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 227us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130256.891984:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:1.0:1789130256.892570:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.892580:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130256.892633:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:1.0:1789130256.892854:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac156 expref: 51 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.892870:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac156 expref: 50 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130256.892894:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130256.892896:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130256.892899:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed6800, rc 0) 00000100:00100000:1.0:1789130256.892946:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:38609:x1876037605019648:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 9599us (10055us total) trans 30064771457 rc 0/0 00000100:00100000:1.0:1789130256.892954:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 442 00000100:00100000:3.0:1789130257.670136:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626840192:0@lo:400:kworker.0 00000100:00100000:2.0:1789130257.670194:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626839936:0@lo:400:kworker.0 00000100:00100000:1.0:1789130257.670262:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626840064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130257.676597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130257.676716:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626840704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130257.676775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130257.677715:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626840320:0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.677760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130257.677840:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840192 00000100:00100000:0.0:1789130257.677848:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840192 00000100:00100000:0.0:1789130257.677910:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840320 00000100:00100000:0.0:1789130257.677914:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840320 00000100:00100000:0.0:1789130257.677936:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130257.677945:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626840192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.677999:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626840192:12345-0@lo:400:kworker.0 Request processed in 54us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130257.678006:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130257.678023:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789130257.678029:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.678062:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626840320:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130257.678069:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789130257.678105:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626840320:0@lo:400:kworker.0 00000100:00080000:0.0:1789130257.678162:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130257.678166:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130257.682194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130257.682279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626840448:0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.682555:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626839936 00000100:00100000:0.0:1789130257.682564:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626839936 00000100:00100000:0.0:1789130257.682653:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789130257.682663:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626839936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.682726:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626839936:12345-0@lo:400:kworker.0 Request processed in 64us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130257.682855:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789130257.687208:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626840192:0@lo:400:kworker.0 00000100:00100000:2.0:1789130257.687351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130257.687416:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626839936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130257.688485:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840704 00000100:00100000:3.0:1789130257.688496:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840704 00000100:00100000:3.0:1789130257.688566:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840448 00000100:00100000:3.0:1789130257.688584:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840448 00000100:00100000:3.0:1789130257.688637:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789130257.688646:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626840704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130257.688734:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626840704:12345-0@lo:400:kworker.0 Request processed in 88us (11958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130257.688742:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789130257.689264:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789130257.689276:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626840448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130257.689332:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626840448:12345-0@lo:400:kworker.0 Request processed in 59us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130257.689338:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1789130257.689956:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130257.689995:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626840448:0@lo:400:kworker.0 00000100:00100000:2.0:1789130257.690046:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626840704:0@lo:400:kworker.0 00000100:00100000:1.0:1789130257.690175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130257.690205:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626840576:0@lo:400:kworker.0 00000100:00100000:1.0:1789130257.690237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130257.690532:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840576 00000100:00100000:2.0:1789130257.690539:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840576 00000100:00100000:2.0:1789130257.690595:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789130257.690621:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626840576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130257.690671:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626840576:12345-0@lo:400:kworker.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130257.690678:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789130257.691265:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840064 00000100:00100000:0.0:1789130257.691271:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840064 00000100:00100000:0.0:1789130257.691324:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130257.691332:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626840064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130257.691381:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 221446144 pending 11927552 free 3772776448 avail 3770679296 00000100:00100000:0.0:1789130257.691429:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626840064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130257.691436:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789130257.692264:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130257.692324:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626840064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130257.692341:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626840576:0@lo:400:kworker.0 00010000:00010000:0.0:1789130257.871697:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130258.693864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626840832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130258.693944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130258.694055:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840832 00000100:00100000:0.0:1789130258.694064:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840832 00000100:00100000:0.0:1789130258.694120:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130258.694131:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626840832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130258.694167:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:0.0:1789130258.694218:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626840832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130258.694227:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130258.694272:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626840832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130258.899772:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130258.984244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130258.984460:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605019904 00000100:00100000:2.0:1789130258.984470:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605019904 00000100:00100000:2.0:1789130258.984532:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:2.0:1789130258.984542:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605019904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130258.993480:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605019904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 8924us (9231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130258.993500:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:3.0:1789130258.995412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130258.995462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130258.995482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130258.995522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130258.995573:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020160 00000100:00100000:3.0:1789130258.995583:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020160 00000100:00100000:3.0:1789130258.995663:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020288 00000100:00100000:3.0:1789130258.995667:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020288 00000100:00100000:3.0:1789130258.995696:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789130258.995706:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605020160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130258.995784:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605020160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130258.995792:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789130258.995808:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789130258.995815:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:2369:x1876037605020288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130258.995842:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+26:2369:x1876037605020288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130258.995849:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00080000:3.0:1789130258.995865:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130258.995886:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130258.996092:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020416 00000100:00100000:0.0:1789130258.996096:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020416 00000100:00100000:0.0:1789130258.996146:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020032 00000100:00100000:0.0:1789130258.996149:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020032 00000100:00100000:0.0:1789130258.996172:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:0.0:1789130258.996179:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605020416:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130258.996217:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605020416:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130258.996224:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:0.0:1789130258.996236:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:0.0:1789130258.996242:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:2369:x1876037605020032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130258.996273:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:2369:x1876037605020032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130258.996278:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00080000:3.0:1789130258.996771:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130259.918765:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130260.340103:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771208 is committed 00000001:00080000:1.0:1789130260.340128:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771203 is committed 00000001:00080000:1.0:1789130260.340138:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771209 is committed 00000001:00080000:1.0:1789130260.340150:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771204 is committed 00000001:00080000:1.0:1789130260.340155:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771210 is committed 00010000:00010000:0.0:1789130260.933856:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130261.288043:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771456 is committed 00000001:00080000:0.0:1789130261.288359:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771457 is committed 00010000:00010000:3.0:1789130261.961454:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130262.790281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626841088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.790381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.790453:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626841600:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.790499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.790533:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789130262.790540:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626840960:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.790570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.790588:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626841472:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.790626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.790650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626841216:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.790674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.790690:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130262.790695:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789130262.791143:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130262.791155:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626841728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130262.791189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130262.791238:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841088 00000100:00100000:0.0:1789130262.791248:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841088 00000100:00100000:0.0:1789130262.791314:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841216 00000100:00100000:0.0:1789130262.791318:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841216 00000100:00100000:0.0:1789130262.791342:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130262.791351:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626841088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130262.791414:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626841088:12345-0@lo:400:kworker.0 Request processed in 63us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130262.791421:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130262.791439:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789130262.791445:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626841216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130262.791474:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626841216:12345-0@lo:400:kworker.0 Request processed in 30us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130262.791481:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789130262.791498:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626840960 00000100:00100000:0.0:1789130262.791501:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626840960 00000100:00100000:0.0:1789130262.791525:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789130262.791531:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626840960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130262.791561:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626840960:12345-0@lo:400:kworker.0 Request processed in 30us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130262.791567:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789130262.791594:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841600 00000100:00100000:0.0:1789130262.791597:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841600 00000100:00100000:0.0:1789130262.791647:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841472 00000100:00100000:0.0:1789130262.791650:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841472 00000100:00100000:0.0:1789130262.791671:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789130262.791677:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626841600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130262.791710:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626841600:12345-0@lo:400:kworker.0 Request processed in 33us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130262.791716:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789130262.791726:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789130262.791732:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626841472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.792049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130262.792090:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771204 gen 2 00000004:00080000:1.0:1789130262.792095:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b48e6e03c0, transno 30064771203 00000004:00080000:1.0:1789130262.792105:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4c19661c0, transno 30064771204 00000100:00100000:1.0:1789130262.792113:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626841216:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.792141:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841344 00000100:00100000:1.0:1789130262.792144:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841344 00000100:00100000:1.0:1789130262.792166:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789130262.792172:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.792211:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626841344:12345-0@lo:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130262.792217:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789130262.792251:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626841344:0@lo:400:kworker.0 00000100:00080000:1.0:1789130262.792308:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130262.792314:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130262.792330:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130262.792349:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626840960:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.792360:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626841088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130262.792370:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626841600:0@lo:400:kworker.0 00000100:00100000:3.0:1789130262.793054:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841728 00000100:00100000:3.0:1789130262.793060:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841728 00000100:00100000:3.0:1789130262.793100:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130262.793108:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626841728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130262.793132:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 209518592 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130262.793186:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626841728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130262.793192:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789130262.793343:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626841728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130262.796194:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626841472:12345-0@lo:400:kworker.0 Request processed in 4452us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130262.796210:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789130262.797294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626841472:0@lo:400:kworker.0 00010000:00010000:0.0:1789130262.982140:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130262.990074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130262.992179:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020544 00000100:00100000:1.0:1789130262.992196:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020544 00000100:00100000:1.0:1789130262.992326:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 443 00000100:00100000:1.0:1789130262.992337:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:39039:x1876037605020544:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:1.0:1789130262.992360:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130262.992383:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac15d expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.992447:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.992462:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.992474:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130262.992710:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130262.992715:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000100:00080000:3.0:1789130262.994914:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1789130262.995432:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.995488:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 7 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.995510:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 6 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130262.995520:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130262.995523:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130262.995528:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed6000, rc 0) 00000100:00100000:1.0:1789130262.995782:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:39039:x1876037605020544:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 3444us (5718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130262.997341:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 443 00000100:00100000:1.0:1789130263.814298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130263.814323:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626841856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130263.814399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130263.814817:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841856 00000100:00100000:3.0:1789130263.814826:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841856 00000100:00100000:3.0:1789130263.814893:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130263.814903:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626841856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130263.814944:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:3.0:1789130263.815007:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626841856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130263.815015:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789130263.815120:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626841856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130264.005777:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130264.090844:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130264.090900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130264.090936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130264.090978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130264.091008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130264.091045:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020928 00000100:00100000:0.0:1789130264.091055:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020928 00000100:00100000:0.0:1789130264.091120:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021056 00000100:00100000:0.0:1789130264.091124:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021056 00000100:00100000:1.0:1789130264.091152:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789130264.091173:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605020928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130264.091271:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605020928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130264.091382:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020672 00000100:00100000:2.0:1789130264.091388:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020672 00000100:00100000:2.0:1789130264.091420:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:2.0:1789130264.091427:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605020672:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130264.091472:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605020672:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130264.091479:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:3.0:1789130264.091587:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021184 00000100:00100000:3.0:1789130264.091592:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021184 00000100:00100000:3.0:1789130264.091654:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605020800 00000100:00100000:3.0:1789130264.091657:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605020800 00000100:00100000:3.0:1789130264.091696:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:3.0:1789130264.091703:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605021184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130264.091736:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605021184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130264.091743:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:3.0:1789130264.091756:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:3.0:1789130264.091762:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:2368:x1876037605020800:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130264.091787:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:2368:x1876037605020800:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130264.091794:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:0.0:1789130264.095048:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:0.0:1789130264.095084:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037605021056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130264.095221:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037605021056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 158us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130264.095231:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00080000:0.0:1789130264.095954:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130264.096027:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130264.096031:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130264.096998:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00010000:00010000:0.0:1789130265.030106:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130266.053817:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130266.504720:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130266.504730:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130266.507803:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 2 00000040:00080000:3.0:1789130266.507817:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000001:02000400:1.0:1789130266.655652:0:40787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 08:37:44 (1789130264) 00010000:00010000:0.0:1789130267.077905:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130267.910339:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626841984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130267.910425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130267.910652:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626841984 00000100:00100000:2.0:1789130267.910662:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626841984 00000100:00100000:2.0:1789130267.910742:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789130267.910752:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626841984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130267.910789:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 209518592 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1789130267.910851:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626841984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130267.910858:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789130267.910906:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626841984:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789130267.911130:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130267.911595:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626842240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130267.911739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130267.911796:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626842368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130267.911822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130267.911993:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626842496:0@lo:400:kworker.0 00000100:00100000:0.0:1789130267.912022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130267.912042:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789130267.912048:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626842112:0@lo:400:kworker.0 00000100:00100000:0.0:1789130267.912074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130267.912095:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626842624:0@lo:400:kworker.0 00000100:00100000:0.0:1789130267.912119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130267.912579:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842240 00000100:00100000:1.0:1789130267.912586:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842240 00000100:00100000:1.0:1789130267.912689:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789130267.912698:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130267.912754:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626842240:12345-0@lo:400:kworker.0 Request processed in 57us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130267.912761:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789130267.912782:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842368 00000100:00100000:1.0:1789130267.912785:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842368 00000100:00100000:1.0:1789130267.912807:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842496 00000100:00100000:1.0:1789130267.912810:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842496 00000100:00100000:1.0:1789130267.912826:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789130267.912833:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626842368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130267.912870:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626842368:12345-0@lo:400:kworker.0 Request processed in 37us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130267.912876:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789130267.912886:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842624 00000100:00100000:1.0:1789130267.912889:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842624 00000100:00100000:1.0:1789130267.912905:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789130267.912911:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626842496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130267.912942:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626842496:12345-0@lo:400:kworker.0 Request processed in 31us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130267.912959:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789130267.912971:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789130267.912977:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626842624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130267.913005:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626842624:12345-0@lo:400:kworker.0 Request processed in 28us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130267.913010:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789130267.913015:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842112 00000100:00100000:3.0:1789130267.913020:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842112 00000100:00100000:1.0:1789130267.913039:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626842368:0@lo:400:kworker.0 00000100:00100000:3.0:1789130267.913052:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789130267.913058:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130267.913077:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626842240:0@lo:400:kworker.0 00000100:00100000:3.0:1789130267.913089:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626842112:12345-0@lo:400:kworker.0 Request processed in 31us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130267.913095:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1789130267.915011:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130267.915021:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130267.915060:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626842112:0@lo:400:kworker.0 00000100:00100000:0.0:1789130267.915080:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626842624:0@lo:400:kworker.0 00000100:00100000:0.0:1789130267.915093:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626842496:0@lo:400:kworker.0 00010000:00010000:3.0:1789130268.105474:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130268.933894:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130268.933946:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626842752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130268.934038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130268.934422:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626842752 00000100:00100000:0.0:1789130268.934431:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626842752 00000100:00100000:0.0:1789130268.934486:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789130268.934496:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626842752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130268.934534:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:0.0:1789130268.934599:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626842752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130268.934633:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789130268.934754:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626842752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130269.125778:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130269.219386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.219449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.219484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.219529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130269.219841:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021312 00000100:00100000:2.0:1789130269.219854:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021312 00000100:00100000:2.0:1789130269.219929:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:2.0:1789130269.219940:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605021312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130269.220039:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605021312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130269.220048:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:3.0:1789130269.220682:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021824 00000100:00100000:3.0:1789130269.220690:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021824 00000100:00100000:1.0:1789130269.220790:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021568 00000100:00100000:1.0:1789130269.220804:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021568 00000100:00100000:3.0:1789130269.220833:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021440 00000100:00100000:3.0:1789130269.220840:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021440 00000100:00100000:2.0:1789130269.220891:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:2.0:1789130269.220905:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037605021824:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130269.220969:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:2367:x1876037605021824:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 68us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130269.220977:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00080000:0.0:1789130269.232549:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130269.232569:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130269.234308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130269.234598:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:3.0:1789130269.234634:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:2367:x1876037605021440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130269.234751:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+44:2367:x1876037605021440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 123us (15220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130269.234761:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:2.0:1789130269.234898:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605021696 00000100:00100000:2.0:1789130269.234911:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605021696 00000100:00100000:1.0:1789130269.235004:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1789130269.235026:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037605021568:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130269.235121:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037605021568:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 103us (15670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.235128:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1789130269.235279:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789130269.235292:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605021696:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130269.235390:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605021696:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 102us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.235399:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00080000:3.0:1789130269.239701:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130269.277299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.277595:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022080 00000100:00100000:0.0:1789130269.277967:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022080 00000100:00100000:1.0:1789130269.278261:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 444 00000100:00100000:1.0:1789130269.278280:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+44:39325:x1876037605022080:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130269.278314:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130269.278317:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130269.278360:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea4e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac12c expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.278389:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130269.278396:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130269.278415:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac164 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.279060:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.279080:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.279090:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.279393:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.279413:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 5 pid: 38734 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130269.279431:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626842880:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130269.279556:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130269.283787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.284372:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022208 00000100:00100000:0.0:1789130269.284390:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022208 00010000:00010000:0.0:1789130269.284459:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 6 pid: 38734 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130269.284516:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789130269.284529:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605022208:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130269.284553:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130269.284562:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 6 pid: 38734 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.284580:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 6 pid: 38734 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.284633:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130269.284640:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.284654:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.284669:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.284697:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130269.284786:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605022208:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 259us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130269.285117:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00010000:00010000:1.0:1789130269.287096:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6000/0x5c74554e47cea5c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac15d expref: 5 pid: 38734 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130269.287288:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626842880:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130269.287329:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.287441:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.287450:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.287490:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.287506:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.287521:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130269.290466:0:36587:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcc:0x0], index 0: 0 00010000:00010000:0.0:1789130269.290991:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea5e1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291013:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea5e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291028:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea5e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291081:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291088:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291313:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291322:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.291327:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291336:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291352:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130269.291356:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130269.291363:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291370:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7a00/0x5c74554e47cea5d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130269.291391:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bb4e59a4 reply state 00000000780efe10 transno 30064771458 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130269.291403:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130269.291456:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac164 expref: 46 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291484:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea5e1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac164 expref: 45 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.291492:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.291494:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130269.291497:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35800, rc 0) 00000100:00100000:0.0:1789130269.291946:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:39325:x1876037605022080:12345-192.168.201.39@tcp:101:dd.0 Request processed in 13668us (14662us total) trans 30064771458 rc 0/0 00000100:00100000:0.0:1789130269.291958:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 444 00000100:00100000:2.0:1789130269.316677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130269.317055:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022336 00000100:00100000:1.0:1789130269.317070:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022336 00000100:00100000:1.0:1789130269.317172:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:1.0:1789130269.317210:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:39325:x1876037605022336:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130269.317244:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130269.317281:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c153aaa4/0x5c74554e47cea5ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac16b expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130269.317331:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130269.317371:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=1432s v=(0 0) 00010000:00010000:1.0:1789130269.317378:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130269.317393:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c153aaa4/0x5c74554e47cea5ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac16b expref: 13 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.317418:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c153aaa4/0x5c74554e47cea5ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac16b expref: 13 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.317437:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed6000, rc 0) 00000100:00100000:1.0:1789130269.317532:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:39325:x1876037605022336:12345-192.168.201.39@tcp:101:dd.0 Request processed in 325us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.317540:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00010000:00010000:0.0:1789130269.322300:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322331:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322340:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322348:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.322356:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322364:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322391:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b497c01200) 00010000:00010000:0.0:1789130269.322395:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130269.322401:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.322409:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea5da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130269.348422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130269.348977:0:37281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022464 00000100:00100000:1.0:1789130269.348991:0:37281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022464 00002000:00100000:1.0:1789130269.349066:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b3839a7c00 x1876037605022464/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/0 e 0 to 0 dl 1789130280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130269.349080:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a7c00 with x1876037605022464 ext(0->1048575) 00002000:00010000:1.0:1789130269.349089:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a7c00 00000100:00100000:1.0:1789130269.349372:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 354 00000100:00100000:1.0:1789130269.349386:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605022464:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130269.371058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130269.378471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130269.378520:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022848 00000100:00100000:3.0:1789130269.378533:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022848 00002000:00100000:3.0:1789130269.378648:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b486f40b40 x1876037605022848/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/0 e 0 to 0 dl 1789130280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130269.378662:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40b40 with x1876037605022848 ext(1048576->2097151) 00002000:00010000:3.0:1789130269.378671:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f40b40 00000100:00100000:3.0:1789130269.378705:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 355 00000100:00100000:3.0:1789130269.378716:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+15:2368:x1876037605022848:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130269.382258:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022720 00000100:00100000:0.0:1789130269.382280:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022720 00000100:00100000:2.0:1789130269.382823:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1789130269.382837:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48615f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+45:39325:x1876037605022720:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130269.383453:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48615f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+46:39325:x1876037605022720:12345-192.168.201.39@tcp:35:dd.0 Request processed in 616us (12412us total) trans 30064771459 rc 0/0 00000100:00100000:2.0:1789130269.383485:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:1.0:1789130269.395220:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037605022464:12345-192.168.201.39@tcp:4:dd.0 Request processed in 45827us (46806us total) trans 30064771269 rc 0/0 00000100:00100000:1.0:1789130269.395236:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 354 00002000:00100000:1.0:1789130269.395249:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b3839a7c00 x1876037605022464/t30064771269(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/448 e 0 to 0 dl 1789130280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130269.395261:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a7c00 with x1876037605022464 ext(0->1048575) 00002000:00010000:1.0:1789130269.395270:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a7c00 00000100:00100000:3.0:1789130269.424099:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+17:2368:x1876037605022848:12345-192.168.201.39@tcp:4:dd.0 Request processed in 45363us (45623us total) trans 30064771270 rc 0/0 00000100:00100000:3.0:1789130269.424119:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 355 00002000:00100000:3.0:1789130269.424138:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b486f40b40 x1876037605022848/t30064771270(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/448 e 0 to 0 dl 1789130280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130269.424160:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f40b40 with x1876037605022848 ext(1048576->2097151) 00002000:00010000:3.0:1789130269.424174:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f40b40 00000100:00100000:0.0:1789130269.429641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130269.430175:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605022976 00000100:00100000:2.0:1789130269.430190:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605022976 00000100:00100000:1.0:1789130269.430313:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 445 00000100:00100000:1.0:1789130269.430328:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+46:39326:x1876037605022976:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130269.430360:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130269.430391:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac172 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430465:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430479:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430490:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130269.430555:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130269.430558:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130269.430580:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430624:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac172 expref: 48 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430665:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac172 expref: 47 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.430672:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130269.430675:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130269.430678:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed7400, rc 0) 00000100:00100000:1.0:1789130269.430746:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:39326:x1876037605022976:12345-192.168.201.39@tcp:101:chown.0 Request processed in 421us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.430753:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 445 00000100:00100000:3.0:1789130269.433160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.433251:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605023104 00000100:00100000:0.0:1789130269.433264:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605023104 00000100:00100000:0.0:1789130269.433341:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 446 00000100:00100000:0.0:1789130269.433353:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+47:39326:x1876037605023104:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789130269.433380:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130269.433406:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea604 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac179 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433449:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea60b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433463:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea60b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433477:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea60b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433641:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea604 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac179 expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433661:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea60b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac179 expref: 48 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.433675:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.433678:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130269.433682:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34c00, rc 0) 00000100:00100000:0.0:1789130269.435021:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:39326:x1876037605023104:12345-192.168.201.39@tcp:101:chown.0 Request processed in 1661us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130269.435031:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 446 00000100:00100000:1.0:1789130269.437999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.438051:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605023360 00000100:00100000:0.0:1789130269.438066:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605023360 00000100:00100000:0.0:1789130269.438156:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 447 00000100:00100000:0.0:1789130269.438169:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:39326:x1876037605023360:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:0.0:1789130269.438250:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130269.438294:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea5e1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac164 expref: 48 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.438323:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.438328:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130269.438364:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.438378:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.438387:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130269.439037:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].15, 88 off9416 00000004:00080000:0.0:1789130269.439048:0:36587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1432536445625ns, next at 1433536442824ns, rc = 0 00000004:00010000:0.0:1789130269.439142:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000055540d82 reply state 0000000040a3c209 transno 30064771460 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130269.439165:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130269.439293:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:39326:x1876037605023360:12345-192.168.201.39@tcp:36:chown.0 Request processed in 1126us (1308us total) trans 30064771460 rc 0/0 00000100:00100000:0.0:1789130269.439299:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 447 00000100:00100000:2.0:1789130269.442388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130269.442953:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605023488 00000100:00100000:1.0:1789130269.442965:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605023488 00000100:00100000:1.0:1789130269.443024:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 448 00000100:00100000:1.0:1789130269.443037:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:39326:x1876037605023488:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789130269.443069:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130269.443236:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443253:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443261:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443269:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.443275:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443284:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443310:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.443314:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130269.443321:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.443327:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cea612 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.443397:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea619 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac180 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.443481:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea619 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac180 expref: 49 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.443496:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea619 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac180 expref: 49 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.443516:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130269.443536:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130269.443539:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed6a00, rc 0) 00000100:00100000:1.0:1789130269.444026:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:39326:x1876037605023488:12345-192.168.201.39@tcp:101:chown.0 Request processed in 989us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.444035:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 448 00000100:00100000:2.0:1789130269.450889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.451561:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605023616 00000100:00100000:0.0:1789130269.451576:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605023616 00000100:00100000:0.0:1789130269.451704:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130269.451721:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2367:x1876037605023616:12345-192.168.201.39@tcp:2:chown.0 00002000:00010000:0.0:1789130269.452103:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789130269.452108:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1789130269 00002000:00010000:0.0:1789130269.452111:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130269.452113:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1789130269 00002000:00010000:0.0:1789130269.452116:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130269.452232:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+18:2367:x1876037605023616:12345-192.168.201.39@tcp:2:chown.0 Request processed in 513us (1357us total) trans 30064771271 rc 0/0 00000100:00100000:0.0:1789130269.452243:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1789130269.517060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130269.517297:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605023872 00000100:00100000:2.0:1789130269.517311:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605023872 00000100:00100000:2.0:1789130269.517395:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 449 00000100:00100000:2.0:1789130269.517407:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+49:39332:x1876037605023872:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130269.517438:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130269.517467:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac187 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517568:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517588:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517653:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517673:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517681:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517689:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517875:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47cea635 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517885:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47cea635 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.517892:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47cea635 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130269.517903:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:2.0:1789130269.518032:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518041:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518048:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518054:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130269.518059:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518067:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518081:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:2.0:1789130269.518084:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130269.518090:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518517:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518539:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518546:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518553:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518558:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130269.518561:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518568:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518577:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b482b51b00) 00010000:00010000:2.0:1789130269.518580:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130269.518583:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518589:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea62e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518721:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac187 expref: 52 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518744:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47cea635 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac187 expref: 51 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130269.518753:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:2.0:1789130269.518755:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130269.518758:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1a00, rc 0) 00000100:00100000:2.0:1789130269.518866:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:39332:x1876037605023872:12345-192.168.201.39@tcp:101:dd.500 Request processed in 1460us (1826us total) trans 30064771461 rc 0/0 00000100:00100000:2.0:1789130269.518876:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 449 00000100:00100000:3.0:1789130269.524409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.524534:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605024128 00000100:00100000:0.0:1789130269.524544:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605024128 00000100:00100000:0.0:1789130269.524738:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 450 00000100:00100000:0.0:1789130269.524756:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39332:x1876037605024128:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130269.524784:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130269.524788:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1789130269.524813:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6a00/0x5c74554e47cea619 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac180 expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524840:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47cea635 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac187 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524851:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.524856:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130269.524870:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea643 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac18e expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524919:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524932:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524942:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524957:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524962:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524969:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524975:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.524979:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524986:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.524993:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.524995:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130269.524999:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525005:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea64a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525030:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525037:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525045:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525331:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac18e expref: 52 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525340:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.525342:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130269.525352:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea643 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac18e expref: 52 pid: 36587 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525365:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac18e expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.525388:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.525391:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130269.525393:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00100000:0.0:1789130269.525565:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39332:x1876037605024128:12345-192.168.201.39@tcp:101:dd.500 Request processed in 812us (1166us total) trans 30064771462 rc 0/0 00000100:00100000:0.0:1789130269.525573:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 450 00000100:00100000:0.0:1789130269.539700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130269.539841:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605024256 00000100:00100000:2.0:1789130269.539860:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605024256 00002000:00100000:2.0:1789130269.539943:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b3833570c0 x1876037605024256/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/0 e 0 to 0 dl 1789130280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130269.539957:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3833570c0 with x1876037605024256 ext(0->1048575) 00002000:00010000:2.0:1789130269.539966:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3833570c0 00000100:00100000:2.0:1789130269.540017:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 356 00000100:00100000:2.0:1789130269.540029:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605024256:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:2.0:1789130269.572443:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605024256:12345-192.168.201.39@tcp:3:dd.0 Request processed in 32399us (32739us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130269.572463:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 356 00002000:00100000:2.0:1789130269.572481:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b3833570c0 x1876037605024256/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/440 e 0 to 0 dl 1789130280 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130269.572493:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3833570c0 with x1876037605024256 ext(0->1048575) 00002000:00010000:2.0:1789130269.572505:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3833570c0 00000100:00100000:3.0:1789130269.594574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130269.594768:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605024384 00000100:00100000:1.0:1789130269.594781:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605024384 00002000:00100000:1.0:1789130269.594844:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b486f430c0 x1876037605024384/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/0 e 0 to 0 dl 1789130280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130269.594853:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f430c0 with x1876037605024384 ext(1048576->2097151) 00002000:00010000:1.0:1789130269.594860:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f430c0 00000100:00100000:1.0:1789130269.594892:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 357 00000100:00100000:1.0:1789130269.594901:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605024384:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:2.0:1789130269.623215:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605024384:12345-192.168.201.39@tcp:3:dd.0 Request processed in 28296us (28638us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130269.623234:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 357 00002000:00100000:2.0:1789130269.623252:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b486f430c0 x1876037605024384/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:740/0 lens 488/440 e 0 to 0 dl 1789130280 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130269.623265:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b486f430c0 with x1876037605024384 ext(1048576->2097151) 00002000:00010000:2.0:1789130269.623274:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b486f430c0 00000100:00100000:3.0:1789130269.684739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130269.685001:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605024640 00000100:00100000:2.0:1789130269.685014:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605024640 00000100:00100000:2.0:1789130269.685111:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130269.685125:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39332:x1876037605024640:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:2.0:1789130269.685909:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:39332:x1876037605024640:12345-192.168.201.39@tcp:35:dd.500 Request processed in 784us (1184us total) trans 30064771463 rc 0/0 00000100:00100000:2.0:1789130269.685918:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1789130269.848425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130269.848807:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605024768 00000100:00100000:1.0:1789130269.848822:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605024768 00000100:00100000:1.0:1789130269.848909:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 451 00000100:00100000:1.0:1789130269.848922:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:39342:x1876037605024768:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130269.849040:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849078:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849092:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849111:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849159:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849167:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849341:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849351:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849357:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130269.849412:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849428:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849435:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849442:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849450:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130269.849456:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849466:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849490:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130269.849494:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130269.849501:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849508:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849525:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849532:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849538:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849543:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130269.849546:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849552:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849560:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b4909bd600) 00010000:00010000:1.0:1789130269.849563:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130269.849565:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849572:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea65f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849599:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849686:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849692:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849697:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130269.849701:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849709:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849719:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130269.849722:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130269.849726:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130269.849732:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6c00/0x5c74554e47cea666 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130269.849858:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:39342:x1876037605024768:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 936us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130269.849869:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 451 00000100:00100000:1.0:1789130269.912245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130269.912493:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605025024 00000100:00100000:3.0:1789130269.912508:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605025024 00000100:00100000:3.0:1789130269.912623:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 452 00000100:00100000:3.0:1789130269.912637:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:39343:x1876037605025024:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130269.912666:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130269.912694:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea66d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac195 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912810:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912831:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912849:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912871:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912878:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.912886:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913021:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913046:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913054:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913060:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759aa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130269.913066:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913074:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913106:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:3.0:1789130269.913110:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130269.913117:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913124:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913152:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913159:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913166:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913171:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130269.913183:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913189:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913209:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b496419c00) 00010000:00010000:3.0:1789130269.913211:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130269.913215:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913221:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea67b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913268:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea66d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac195 expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913279:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:3.0:1789130269.913282:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130269.913285:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea66d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac195 expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130269.913295:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759ba00, rc 0) 00000100:00100000:3.0:1789130269.913379:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:39343:x1876037605025024:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 745us (1151us total) trans 0 rc 301/301 00000100:00100000:3.0:1789130269.913387:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 452 00000100:00100000:3.0:1789130269.928332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130269.931203:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605025152 00000100:00100000:0.0:1789130269.931227:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605025152 00000100:00100000:0.0:1789130269.931339:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 453 00000100:00100000:0.0:1789130269.931352:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:39343:x1876037605025152:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130269.931462:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931485:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931500:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931519:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931526:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931534:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931693:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931703:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.931710:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130269.931754:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00000004:00200000:0.0:1789130269.931759:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130269.932210:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932228:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932235:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932243:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932249:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.932254:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932262:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932278:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:0.0:1789130269.932281:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130269.932286:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932293:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4e00/0x5c74554e47cea682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932311:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932317:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932322:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932328:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.932332:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932338:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932346:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b497c01200) 00010000:00010000:0.0:1789130269.932348:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130269.932351:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932357:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea689 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932375:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932381:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932387:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932393:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130269.932395:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932402:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932414:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130269.932416:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130269.932420:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130269.932425:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47cea690 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130269.932546:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:39343:x1876037605025152:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1192us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130269.932556:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 453 00000100:00100000:2.0:1789130270.011529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130270.012012:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605025408 00000100:00100000:1.0:1789130270.012027:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605025408 00000100:00100000:1.0:1789130270.012154:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 454 00000100:00100000:1.0:1789130270.012169:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:39349:x1876037605025408:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130270.012208:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130270.012212:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130270.012254:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7400/0x5c74554e47cea5fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac172 expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012278:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130270.012293:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130270.012317:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea697 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac19c expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012531:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012546:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012557:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012570:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012577:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012585:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012755:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea6ac lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012774:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea6ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.012782:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea6ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130270.013015:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:1.0:1789130270.013328:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013338:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013345:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013352:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130270.013358:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013367:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013379:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130270.013382:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130270.013387:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013393:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7800/0x5c74554e47cea69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013418:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013425:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013430:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013435:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130270.013438:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013445:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013454:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b4909bd500) 00010000:00010000:1.0:1789130270.013456:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130270.013459:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013466:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013526:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea697 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac19c expref: 54 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013544:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea6ac lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac19c expref: 53 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.013564:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130270.013566:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130270.013569:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed7000, rc 0) 00000100:00100000:1.0:1789130270.013693:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+53:39349:x1876037605025408:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1528us (2180us total) trans 30064771464 rc 0/0 00000100:00100000:1.0:1789130270.013703:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 454 00000100:00100000:1.0:1789130270.017974:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.018075:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605025664 00000100:00100000:3.0:1789130270.018098:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605025664 00000100:00100000:3.0:1789130270.018199:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 455 00000100:00100000:3.0:1789130270.018236:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:39349:x1876037605025664:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:3.0:1789130270.018342:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130270.018816:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea651 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac18e expref: 53 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.018843:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7000/0x5c74554e47cea6ac lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac19c expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.018856:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.018863:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130270.019182:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.019210:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.019222:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130270.019308:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771465 00000004:00010000:3.0:1789130270.019339:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000522e1759 reply state 0000000016d42426 transno 30064771466 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130270.019352:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130270.019489:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:39349:x1876037605025664:12345-192.168.201.39@tcp:36:dd.0 Request processed in 1257us (1528us total) trans 30064771466 rc 0/0 00000100:00100000:3.0:1789130270.019498:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 455 00000020:00080000:3.0:1789130270.019505:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789130270.022555:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.022577:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.022586:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.022592:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759ba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130270.022598:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130270.022759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130270.022871:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605025792 00000100:00100000:0.0:1789130270.022883:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605025792 00000100:00100000:0.0:1789130270.022954:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 456 00000100:00100000:0.0:1789130270.022965:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:39349:x1876037605025792:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130270.022998:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130270.023024:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea6c1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1a3 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130270.023112:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea6c1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1a3 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130270.023130:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea6c1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1a3 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130270.023164:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130270.023168:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130270.023173:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5400, rc 0) 00000100:00100000:0.0:1789130270.023267:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:39349:x1876037605025792:12345-192.168.201.39@tcp:101:dd.0 Request processed in 303us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130270.023275:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 456 00010000:00010000:2.0:1789130270.024505:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.024525:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:2.0:1789130270.024528:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130270.024533:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.024540:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ba00/0x5c74554e47cea6ba lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130270.026918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130270.027028:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026048 00000100:00100000:1.0:1789130270.027040:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026048 00000100:00100000:1.0:1789130270.027378:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 457 00000100:00100000:1.0:1789130270.027393:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:39349:x1876037605026048:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130270.027422:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130270.027426:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130270.027458:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5400/0x5c74554e47cea6c1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1a3 expref: 54 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027482:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130270.027487:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130270.027503:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea6c8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1aa expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027571:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027586:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027700:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027967:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1aa expref: 56 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.027977:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130270.027980:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130270.027991:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7c00/0x5c74554e47cea6c8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1aa expref: 56 pid: 36588 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.028007:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1aa expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.028034:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130270.028037:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130270.028039:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed6400, rc 0) 00000100:00100000:1.0:1789130270.028555:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:39349:x1876037605026048:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1164us (1646us total) trans 30064771467 rc 0/0 00000100:00100000:1.0:1789130270.028566:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 457 00000100:00100000:3.0:1789130270.043756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.050010:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026304 00000100:00100000:2.0:1789130270.050031:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026304 00000100:00100000:2.0:1789130270.050127:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 458 00000100:00100000:2.0:1789130270.050150:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:39349:x1876037605026304:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130270.050187:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130270.050203:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130270.050243:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6400/0x5c74554e47cea6cf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1aa expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.050282:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:2.0:1789130270.050290:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130270.050310:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea6d6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1b1 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.050388:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.050407:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130270.050421:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130270.052343:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].16, 88 off9504 00000004:00080000:2.0:1789130270.052363:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1433149760506ns, next at 1433536442824ns, rc = 0 00010000:00010000:3.0:1789130270.149837:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130270.156144:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771462 is committed 00000004:00080000:1.0:1789130270.156167:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:1.0:1789130270.156185:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771467 is committed 00000001:00080000:1.0:1789130270.156193:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771468 is committed 00000004:00080000:1.0:1789130270.156196:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000100:00100000:1.0:1789130270.156306:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626843008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130270.156378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130270.156477:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843008 00000100:00100000:1.0:1789130270.156484:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843008 00000100:00100000:1.0:1789130270.156539:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789130270.156548:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626843008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789130270.156753:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1789130270.156757:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789130269 -> 1789130269 00002000:00010000:1.0:1789130270.156759:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130270.156761:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789130269 -> 1789130269 00002000:00010000:1.0:1789130270.156763:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130270.156802:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626843008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (423us total) trans 30064771272 rc 0/0 00000100:00100000:1.0:1789130270.156809:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789130270.156825:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789130270.156854:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4bae7b840/2, rc 0, transno 30064771272 00000100:00100000:1.0:1789130270.156863:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626843008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130270.156900:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626843136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130270.156926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130270.156964:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843136 00000100:00100000:1.0:1789130270.156968:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843136 00000100:00100000:1.0:1789130270.156992:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789130270.156998:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626843136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789130270.157098:0:37273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1789130270.157101:0:37273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789130269 -> 1789130269 00002000:00010000:1.0:1789130270.157103:0:37273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130270.157105:0:37273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789130269 -> 1789130269 00002000:00010000:1.0:1789130270.157107:0:37273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130270.157148:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626843136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (221us total) trans 30064771273 rc 0/0 00000100:00100000:1.0:1789130270.157163:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000004:00080000:1.0:1789130270.157193:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4bae79e00/2, rc 0, transno 30064771273 00000100:00100000:1.0:1789130270.157199:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626843136:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789130270.158485:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b1 expref: 46 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.158502:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.158505:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130270.158525:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea6d6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b1 expref: 46 pid: 36589 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.158546:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b1 expref: 45 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.158591:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.158594:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130270.158597:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:3.0:1789130270.158713:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+45:39349:x1876037605026304:12345-192.168.201.39@tcp:101:dd.0 Request processed in 108564us (114970us total) trans 30064771468 rc 0/0 00000100:00100000:3.0:1789130270.158721:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 458 00000100:00100000:2.0:1789130270.175949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130270.176075:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026432 00000100:00100000:0.0:1789130270.176106:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026432 00002000:00010000:0.0:1789130270.176175:0:40189:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:0.0:1789130270.176181:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a6940 with x1876037605026432 ext(0->18446744073709551615) 00002000:00010000:0.0:1789130270.176193:0:40189:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a6940. 00000100:00100000:0.0:1789130270.176239:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 358 00000100:00100000:0.0:1789130270.176265:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+18:2368:x1876037605026432:12345-192.168.201.39@tcp:10:dd.0 00002000:00010000:0.0:1789130270.177350:0:40189:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1789130270.177356:0:40189:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789130269 -> 1789130269 00002000:00010000:0.0:1789130270.177359:0:40189:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130270.177361:0:40189:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789130269 -> 1789130269 00002000:00010000:0.0:1789130270.177364:0:40189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130270.177447:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+19:2368:x1876037605026432:12345-192.168.201.39@tcp:10:dd.0 Request processed in 1195us (1508us total) trans 30064771274 rc 0/0 00000100:00100000:0.0:1789130270.177458:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 358 00002000:00010000:0.0:1789130270.177462:0:40189:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:0.0:1789130270.177465:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a6940 with x1876037605026432 ext(0->18446744073709551615) 00002000:00010000:0.0:1789130270.177470:0:40189:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a6940. 00000100:00100000:0.0:1789130270.228862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.229112:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026560 00000100:00100000:2.0:1789130270.229139:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026560 00002000:00100000:2.0:1789130270.229232:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b383356580 x1876037605026560/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.229247:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383356580 with x1876037605026560 ext(0->1048575) 00002000:00010000:2.0:1789130270.229255:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383356580 00000100:00100000:2.0:1789130270.229298:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 359 00000100:00100000:2.0:1789130270.229311:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+19:2370:x1876037605026560:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130270.286033:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+21:2370:x1876037605026560:12345-192.168.201.39@tcp:4:dd.0 Request processed in 56713us (57172us total) trans 30064771275 rc 0/0 00000100:00100000:0.0:1789130270.286052:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 359 00002000:00100000:0.0:1789130270.286067:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b383356580 x1876037605026560/t30064771275(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/448 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130270.286078:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383356580 with x1876037605026560 ext(0->1048575) 00002000:00010000:0.0:1789130270.286085:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383356580 00000100:00100000:1.0:1789130270.300642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.300772:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026688 00000100:00100000:3.0:1789130270.300781:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026688 00002000:00100000:3.0:1789130270.300837:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b4bae79a40 x1876037605026688/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130270.300849:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bae79a40 with x1876037605026688 ext(1048576->2097151) 00002000:00010000:3.0:1789130270.300855:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bae79a40 00000100:00100000:3.0:1789130270.300890:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 360 00000100:00100000:3.0:1789130270.300900:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+21:2367:x1876037605026688:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:3.0:1789130270.321096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.322062:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2367:x1876037605026688:12345-192.168.201.39@tcp:4:dd.0 Request processed in 21158us (21425us total) trans 30064771276 rc 0/0 00000100:00100000:3.0:1789130270.322085:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 360 00002000:00100000:3.0:1789130270.322099:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b4bae79a40 x1876037605026688/t30064771276(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/448 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130270.322110:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bae79a40 with x1876037605026688 ext(1048576->2097151) 00002000:00010000:3.0:1789130270.322117:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bae79a40 00000100:00100000:3.0:1789130270.322155:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026816 00000100:00100000:3.0:1789130270.322162:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026816 00002000:00100000:3.0:1789130270.322192:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff90b4927952c0 x1876037605026816/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130270.322200:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927952c0 with x1876037605026816 ext(2097152->3145727) 00002000:00010000:3.0:1789130270.322203:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927952c0 00000100:00100000:3.0:1789130270.322224:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 361 00000100:00100000:3.0:1789130270.322232:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+23:2368:x1876037605026816:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130270.346204:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+25:2368:x1876037605026816:12345-192.168.201.39@tcp:4:dd.0 Request processed in 23963us (25120us total) trans 30064771277 rc 0/0 00000100:00100000:2.0:1789130270.346219:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 361 00002000:00100000:2.0:1789130270.346232:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff90b4927952c0 x1876037605026816/t30064771277(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/448 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.348491:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927952c0 with x1876037605026816 ext(2097152->3145727) 00002000:00010000:2.0:1789130270.348640:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927952c0 00000100:00100000:3.0:1789130270.366687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.366943:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605026944 00000100:00100000:2.0:1789130270.366957:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605026944 00002000:00100000:2.0:1789130270.367028:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff90b492794f00 x1876037605026944/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.367062:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492794f00 with x1876037605026944 ext(3145728->4194303) 00002000:00010000:2.0:1789130270.367069:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492794f00 00000100:00100000:2.0:1789130270.367330:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 362 00000100:00100000:2.0:1789130270.367344:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+25:2369:x1876037605026944:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:0.0:1789130270.388936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130270.389058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.392558:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605027072 00000100:00100000:2.0:1789130270.392576:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605027072 00002000:00100000:2.0:1789130270.392693:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff90b383354f00 x1876037605027072/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.392707:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383354f00 with x1876037605027072 ext(4194304->5242879) 00002000:00010000:2.0:1789130270.392715:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383354f00 00000100:00100000:2.0:1789130270.392775:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 363 00000100:00100000:2.0:1789130270.392786:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+27:2370:x1876037605027072:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:1.0:1789130270.404816:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605027328 00000100:00100000:1.0:1789130270.404833:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605027328 00000100:00100000:1.0:1789130270.404900:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130270.404910:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+45:39349:x1876037605027328:12345-192.168.201.39@tcp:35:dd.0 00000001:00080000:1.0:1789130270.405269:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771469 00000100:00100000:1.0:1789130270.405768:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+47:39349:x1876037605027328:12345-192.168.201.39@tcp:35:dd.0 Request processed in 856us (16840us total) trans 30064771470 rc 0/0 00000100:00100000:1.0:1789130270.405779:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000020:00080000:1.0:1789130270.405786:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130270.419868:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+30:2369:x1876037605026944:12345-192.168.201.39@tcp:4:dd.0 Request processed in 52510us (53179us total) trans 30064771278 rc 0/0 00000100:00100000:1.0:1789130270.419887:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 362 00002000:00100000:1.0:1789130270.419905:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff90b492794f00 x1876037605026944/t30064771278(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/448 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130270.419918:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492794f00 with x1876037605026944 ext(3145728->4194303) 00002000:00010000:1.0:1789130270.419926:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492794f00 00000100:00100000:0.0:1789130270.420088:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037605027072:12345-192.168.201.39@tcp:4:dd.0 Request processed in 27303us (31029us total) trans 30064771279 rc 0/0 00000100:00100000:0.0:1789130270.420098:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 363 00002000:00100000:0.0:1789130270.420105:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff90b383354f00 x1876037605027072/t30064771279(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/448 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130270.420114:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383354f00 with x1876037605027072 ext(4194304->5242879) 00002000:00010000:0.0:1789130270.420119:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383354f00 00000100:00100000:3.0:1789130270.540414:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130270.540587:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605027456 00000100:00100000:1.0:1789130270.540598:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605027456 00000100:00100000:1.0:1789130270.540716:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 459 00000100:00100000:1.0:1789130270.540728:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+47:39359:x1876037605027456:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130270.540772:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130270.540793:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1b8 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.540853:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.540868:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.540879:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130270.541055:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130270.541059:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130270.541149:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.541173:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b8 expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.541190:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b8 expref: 48 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.541199:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130270.541201:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130270.541216:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b382ed7600, rc 0) 00000100:00100000:1.0:1789130270.541264:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:39359:x1876037605027456:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 540us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130270.541272:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 459 00000100:00100000:2.0:1789130270.550783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130270.550916:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605027584 00000100:00100000:1.0:1789130270.550926:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605027584 00000100:00100000:1.0:1789130270.551011:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 460 00000100:00100000:1.0:1789130270.551021:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:39359:x1876037605027584:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130270.551101:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551117:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551140:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551155:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551163:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551170:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551492:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551502:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551509:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130270.551548:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551567:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551574:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551582:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551588:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed7200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130270.551594:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551625:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551638:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130270.551641:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130270.551646:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551652:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7200/0x5c74554e47cea6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551663:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551669:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.551674:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552818:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130270.552823:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552829:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552841:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b4909bd600) 00010000:00010000:1.0:1789130270.552844:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130270.552847:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552852:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6200/0x5c74554e47cea6f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552877:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552883:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552889:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552893:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b382ed6600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130270.552895:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552901:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552920:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130270.552922:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130270.552926:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130270.552931:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6600/0x5c74554e47cea700 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130270.553019:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+48:39359:x1876037605027584:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1996us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130270.553030:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 460 00000100:00100000:2.0:1789130270.673757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.673906:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605027840 00000100:00100000:3.0:1789130270.673915:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605027840 00000100:00100000:3.0:1789130270.673985:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 461 00000100:00100000:3.0:1789130270.673995:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:39365:x1876037605027840:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130270.674016:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130270.674036:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1bf expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674116:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674156:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674168:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674186:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674193:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674199:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674566:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b800/0x5c74554e47cea71c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674577:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b800/0x5c74554e47cea71c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674585:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b800/0x5c74554e47cea71c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130270.674595:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:3.0:1789130270.674707:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674715:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674722:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674735:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759aa00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130270.674739:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674747:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674759:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789130270.674761:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130270.674766:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674772:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759aa00/0x5c74554e47cea70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674784:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674791:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674815:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674820:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759ac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130270.674823:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674830:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674848:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b496419900) 00010000:00010000:3.0:1789130270.674851:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130270.674854:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674860:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ac00/0x5c74554e47cea715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674901:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a600/0x5c74554e47cea707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1bf expref: 51 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674915:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b800/0x5c74554e47cea71c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1bf expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.674922:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.674925:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130270.674927:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759b800, rc 0) 00000100:00100000:3.0:1789130270.674982:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+50:39365:x1876037605027840:12345-192.168.201.39@tcp:101:dd.500 Request processed in 989us (1235us total) trans 30064771471 rc 0/0 00000100:00100000:3.0:1789130270.674990:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 461 00000100:00100000:2.0:1789130270.679385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.679519:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028096 00000100:00100000:3.0:1789130270.679529:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028096 00000100:00100000:3.0:1789130270.679588:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 462 00000100:00100000:3.0:1789130270.679598:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:39365:x1876037605028096:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130270.679640:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130270.679643:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1789130270.679671:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea6dd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b1 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679724:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b800/0x5c74554e47cea71c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1bf expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679735:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.679740:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130270.679763:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b400/0x5c74554e47cea72a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1c6 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679804:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679817:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679827:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679841:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679848:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679855:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679861:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38759a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130270.679865:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679887:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679897:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.679899:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130270.679902:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679907:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759a000/0x5c74554e47cea731 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679930:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679938:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.679945:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.680150:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1c6 expref: 51 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.680159:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.680161:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130270.680172:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759b400/0x5c74554e47cea72a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1c6 expref: 51 pid: 38723 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.680187:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1c6 expref: 50 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130270.680228:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130270.680230:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130270.680232:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38759ae00, rc 0) 00000100:00100000:3.0:1789130270.680310:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:39365:x1876037605028096:12345-192.168.201.39@tcp:101:dd.500 Request processed in 713us (934us total) trans 30064771472 rc 0/0 00000100:00100000:3.0:1789130270.680317:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 462 00000100:00100000:0.0:1789130270.703029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.703134:0:37279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028224 00000100:00100000:2.0:1789130270.703145:0:37279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028224 00002000:00100000:2.0:1789130270.703197:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b383357840 x1876037605028224/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.703219:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383357840 with x1876037605028224 ext(0->1048575) 00002000:00010000:2.0:1789130270.703225:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383357840 00000100:00100000:2.0:1789130270.703255:0:37279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 364 00000100:00100000:2.0:1789130270.703266:0:37279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037605028224:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:2.0:1789130270.733081:0:37279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037605028224:12345-192.168.201.39@tcp:3:dd.0 Request processed in 29799us (30043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130270.733097:0:37279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 364 00002000:00100000:2.0:1789130270.733112:0:37279:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff90b383357840 x1876037605028224/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/440 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.733131:0:37279:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383357840 with x1876037605028224 ext(0->1048575) 00002000:00010000:2.0:1789130270.733138:0:37279:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b383357840 00000100:00100000:2.0:1789130270.755635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.755731:0:40190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028352 00000100:00100000:3.0:1789130270.755742:0:40190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028352 00002000:00100000:3.0:1789130270.755800:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b3839a6580 x1876037605028352/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130270.755812:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a6580 with x1876037605028352 ext(1048576->2097151) 00002000:00010000:3.0:1789130270.755818:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a6580 00000100:00100000:3.0:1789130270.755854:0:40190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 365 00000100:00100000:3.0:1789130270.755864:0:40190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037605028352:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:3.0:1789130270.775595:0:40190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:587d445f-41ce-47d3-97fe-edc16e866648+29:2370:x1876037605028352:12345-192.168.201.39@tcp:3:dd.0 Request processed in 19722us (19988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130270.775647:0:40190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 365 00002000:00100000:3.0:1789130270.775661:0:40190:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff90b3839a6580 x1876037605028352/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/440 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130270.775671:0:40190:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3839a6580 with x1876037605028352 ext(1048576->2097151) 00002000:00010000:3.0:1789130270.775689:0:40190:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3839a6580 00000100:00100000:3.0:1789130270.802197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130270.802233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130270.802411:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028480 00000100:00100000:2.0:1789130270.802421:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028480 00002000:00100000:2.0:1789130270.802470:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff90b492797c00 x1876037605028480/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.802481:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492797c00 with x1876037605028480 ext(2097152->3145727) 00002000:00010000:2.0:1789130270.802497:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492797c00 00000100:00100000:2.0:1789130270.802525:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028608 00000100:00100000:2.0:1789130270.802529:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028608 00002000:00100000:2.0:1789130270.802543:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff90b492797480 x1876037605028608/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.802557:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492797480 with x1876037605028608 ext(3145728->4194303) 00002000:00010000:2.0:1789130270.802560:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492797480 00000100:00100000:2.0:1789130270.802581:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 366 00000100:00100000:2.0:1789130270.802590:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+30:2367:x1876037605028480:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:0.0:1789130270.802869:0:37281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 367 00000100:00100000:0.0:1789130270.802880:0:37281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+30:2367:x1876037605028608:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:0.0:1789130270.840401:0:37281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:587d445f-41ce-47d3-97fe-edc16e866648+31:2367:x1876037605028608:12345-192.168.201.39@tcp:3:dd.0 Request processed in 37512us (38154us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789130270.840415:0:37281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 367 00002000:00100000:0.0:1789130270.840429:0:37281:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff90b492797480 x1876037605028608/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/440 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130270.840439:0:37281:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492797480 with x1876037605028608 ext(3145728->4194303) 00002000:00010000:0.0:1789130270.840447:0:37281:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492797480 00000100:00100000:2.0:1789130270.863788:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492797c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+29:2367:x1876037605028480:12345-192.168.201.39@tcp:3:dd.0 Request processed in 61186us (61587us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130270.863806:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 366 00002000:00100000:2.0:1789130270.863819:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff90b492797c00 x1876037605028480/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/440 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.863828:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b492797c00 with x1876037605028480 ext(2097152->3145727) 00002000:00010000:2.0:1789130270.863835:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b492797c00 00000100:00100000:3.0:1789130270.907860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130270.908114:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028736 00000100:00100000:0.0:1789130270.908137:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028736 00002000:00100000:0.0:1789130270.908191:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff90b4927970c0 x1876037605028736/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/0 e 0 to 0 dl 1789130281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130270.908204:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927970c0 with x1876037605028736 ext(4194304->5242879) 00002000:00010000:0.0:1789130270.908211:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927970c0 00000100:00100000:0.0:1789130270.908248:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 368 00000100:00100000:0.0:1789130270.908258:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037605028736:12345-192.168.201.39@tcp:3:dd.0 00000100:00100000:2.0:1789130270.953267:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+29:2369:x1876037605028736:12345-192.168.201.39@tcp:3:dd.0 Request processed in 45000us (45408us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789130270.953281:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 368 00002000:00100000:2.0:1789130270.953294:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff90b4927970c0 x1876037605028736/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:741/0 lens 488/440 e 0 to 0 dl 1789130281 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130270.953304:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4927970c0 with x1876037605028736 ext(4194304->5242879) 00002000:00010000:2.0:1789130270.953311:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4927970c0 00000100:00100000:3.0:1789130271.034539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130271.037102:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605028992 00000100:00100000:2.0:1789130271.037127:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605028992 00000100:00100000:2.0:1789130271.037228:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130271.037242:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:39365:x1876037605028992:12345-192.168.201.39@tcp:35:dd.500 00000100:00080000:1.0:1789130271.037546:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130271.037958:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39365:x1876037605028992:12345-192.168.201.39@tcp:35:dd.500 Request processed in 718us (3426us total) trans 30064771473 rc 0/0 00000100:00100000:2.0:1789130271.037968:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00010000:00010000:0.0:1789130271.174685:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130271.229501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130271.230234:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605029120 00000100:00100000:3.0:1789130271.230245:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605029120 00000100:00100000:3.0:1789130271.230320:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 463 00000100:00100000:3.0:1789130271.230331:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:39371:x1876037605029120:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130271.230401:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.230418:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.230431:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.230455:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.230471:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.230479:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231073:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231085:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231093:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130271.231160:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231174:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231181:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231188:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231194:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130271.231198:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231206:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231218:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789130271.231220:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130271.231225:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231232:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea73f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231244:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231250:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231261:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231267:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130271.231270:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231412:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231421:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b496419c00) 00010000:00010000:3.0:1789130271.231423:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130271.231427:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231536:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231552:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231558:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231564:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231569:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130271.231572:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231588:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231596:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130271.231599:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130271.231720:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.231727:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea74d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130271.231812:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:39371:x1876037605029120:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1481us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130271.231821:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 463 00000100:00100000:0.0:1789130271.283154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130271.283240:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605029376 00000100:00100000:3.0:1789130271.283249:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605029376 00000100:00100000:3.0:1789130271.283317:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 464 00000100:00100000:3.0:1789130271.283327:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:39372:x1876037605029376:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130271.283346:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130271.283365:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1cd expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283430:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283455:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283644:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283670:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283678:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.283685:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294860:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294874:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294887:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294894:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130271.294898:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294907:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294922:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130271.294925:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130271.294929:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294937:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47cea75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294950:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294956:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294962:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294968:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130271.294970:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294980:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294987:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b496419c00) 00010000:00010000:2.0:1789130271.294989:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130271.294992:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.294998:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cea762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.295042:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea754 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1cd expref: 52 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.295053:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130271.295056:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130271.295059:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cea754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1cd expref: 52 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.302282:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35000, rc 0) 00000100:00100000:2.0:1789130271.302368:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:39372:x1876037605029376:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 19039us (19218us total) trans 0 rc 301/301 00000100:00100000:2.0:1789130271.302377:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 464 00000100:00100000:2.0:1789130271.313525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130271.313743:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605029504 00000100:00100000:0.0:1789130271.313753:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605029504 00000100:00100000:0.0:1789130271.313808:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 465 00000100:00100000:0.0:1789130271.313819:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39372:x1876037605029504:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130271.313895:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.313911:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.313922:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.313937:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.313944:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.313951:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314519:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314530:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314538:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130271.314569:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:0.0:1789130271.314573:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130271.314585:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314599:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314629:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314637:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314643:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130271.314647:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314655:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314667:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130271.314670:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130271.314674:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314681:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314693:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314699:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314705:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314710:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130271.314712:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314718:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314724:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b497c01200) 00010000:00010000:0.0:1789130271.314726:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130271.314728:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314734:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea770 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314750:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314756:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314762:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314766:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130271.314769:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314775:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314782:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130271.314784:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130271.314786:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.314792:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cea777 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130271.316986:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:39372:x1876037605029504:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 3158us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130271.317000:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 465 00000100:00100000:1.0:1789130271.422647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130271.422861:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605029632 00000100:00100000:2.0:1789130271.422870:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605029632 00000100:00100000:2.0:1789130271.422970:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 466 00000100:00100000:2.0:1789130271.422981:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+51:39378:x1876037605029632:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130271.423002:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130271.423022:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47cea77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1d4 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423080:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423094:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423105:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423132:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423543:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.423553:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424000:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424011:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424019:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130271.424050:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:2.0:1789130271.424055:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130271.424071:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424082:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424090:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424097:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424103:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424121:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130271.424126:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424134:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424443:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130271.424446:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130271.424451:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424522:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424535:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424546:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424552:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424557:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130271.424561:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424567:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424575:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff90b482b51500) 00010000:00010000:2.0:1789130271.424577:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130271.424580:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424586:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea78c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424697:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47cea77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 53 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424720:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 52 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.424728:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:2.0:1789130271.424730:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130271.424733:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0800, rc 0) 00000100:00100000:2.0:1789130271.424799:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+52:39378:x1876037605029632:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1820us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130271.424808:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 466 00000100:00100000:2.0:1789130271.433917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130271.434040:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605029888 00000100:00100000:0.0:1789130271.434051:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605029888 00000100:00100000:0.0:1789130271.434125:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 467 00000100:00100000:0.0:1789130271.434136:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:39378:x1876037605029888:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130271.434165:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130271.434185:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1db expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.434598:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea7a1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.434641:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea7a1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.434652:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea7a1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130271.434663:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:0.0:1789130271.435668:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cea79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1db expref: 55 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.435693:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea7a1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1db expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130271.435703:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:0.0:1789130271.435706:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789130271.435709:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:0.0:1789130271.437164:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:39378:x1876037605029888:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3021us (3248us total) trans 30064771474 rc 0/0 00000100:00100000:0.0:1789130271.437176:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 467 00000100:00100000:0.0:1789130271.664979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130271.665079:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030144 00000100:00100000:2.0:1789130271.665090:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030144 00000100:00100000:2.0:1789130271.665159:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 468 00000100:00100000:2.0:1789130271.665169:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:39384:x1876037605030144:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130271.665192:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130271.665215:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47cea7af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1e2 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.665315:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.665904:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 55 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.665917:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.666011:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 55 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.666027:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 55 pid: 38734 timeout: 1534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130271.666041:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626843264:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130271.666239:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130271.675178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130271.675203:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626843264:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130271.675263:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030272 00000100:00100000:3.0:1789130271.675270:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030272 00010000:00010000:3.0:1789130271.675312:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 56 pid: 38734 timeout: 1534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130271.675351:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130271.675359:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:2369:x1876037605030272:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130271.675373:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130271.675379:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 56 pid: 38734 timeout: 1534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675392:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 56 pid: 38734 timeout: 1534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675415:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47cea793 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1d4 expref: 56 pid: 38734 timeout: 1534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675431:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:3.0:1789130271.675446:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675456:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675463:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130271.675481:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130271.675525:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605030272:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130271.675532:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00010000:00010000:2.0:1789130271.677902:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.677921:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.677927:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130271.677950:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:2.0:1789130271.678136:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47cea7af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e2 expref: 56 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.678158:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e2 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130271.678166:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:2.0:1789130271.678169:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130271.678172:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130271.678241:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:39384:x1876037605030144:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 13073us (13270us total) trans 30064771475 rc 0/0 00000100:00100000:2.0:1789130271.678251:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 468 00010000:00010000:3.0:1789130272.199039:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130272.608146:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771279 is committed 00000001:00080000:3.0:1789130272.608181:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771273 is committed 00000100:00100000:2.0:1789130273.032868:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626843392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130273.032952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130273.033172:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843392 00000100:00100000:3.0:1789130273.033181:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843392 00000100:00100000:3.0:1789130273.033244:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789130273.033255:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626843392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130273.033295:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 209518592 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130273.033340:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626843392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130273.033347:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789130273.033417:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130273.033454:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b492796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626843392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130273.033625:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626843776:0@lo:400:kworker.0 00000100:00100000:1.0:1789130273.033661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130273.033682:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130273.033699:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626843904:0@lo:400:kworker.0 00000100:00100000:1.0:1789130273.033723:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130273.033750:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843776 00000100:00100000:1.0:1789130273.033754:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843776 00000100:00100000:1.0:1789130273.033779:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843904 00000100:00100000:1.0:1789130273.033782:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843904 00000100:00100000:1.0:1789130273.033805:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789130273.033812:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626843776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130273.033847:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1964f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626843776:12345-0@lo:400:kworker.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130273.033863:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789130273.033877:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789130273.033883:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c19661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626843904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130273.033911:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c19661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626843904:12345-0@lo:400:kworker.0 Request processed in 29us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130273.033917:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789130273.034075:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626843520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.034122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130273.034147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626844032:0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.034169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130273.034185:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130273.034190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626843648:0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.034217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130273.034242:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843520 00000100:00100000:2.0:1789130273.034245:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843520 00000100:00100000:2.0:1789130273.034271:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789130273.034277:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0cbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626843520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.034308:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0cbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626843520:12345-0@lo:400:kworker.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130273.034314:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789130273.034339:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844032 00000100:00100000:2.0:1789130273.034342:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844032 00000100:00100000:3.0:1789130273.034426:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626843648 00000100:00100000:3.0:1789130273.034430:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626843648 00000100:00100000:2.0:1789130273.035232:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789130273.035242:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626844032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.035283:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626844032:12345-0@lo:400:kworker.0 Request processed in 43us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130273.035290:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1789130273.035343:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130273.035348:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130273.035377:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384a56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626843904:0@lo:400:kworker.0 00000100:00100000:1.0:1789130273.035387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626843776:0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.035481:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626843520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130273.035491:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48e6e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626844032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130273.035572:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789130273.035581:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626843648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130273.035631:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626843648:12345-0@lo:400:kworker.0 Request processed in 53us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130273.035649:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130273.036097:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771273 gen 2 00000004:00080000:2.0:1789130273.036104:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4bae7b840, transno 30064771272 00000004:00080000:2.0:1789130273.036118:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4bae79e00, transno 30064771273 00000100:00100000:2.0:1789130273.036124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626843648:0@lo:400:kworker.0 00010000:00010000:1.0:1789130273.222222:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130274.054734:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130274.054756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626844160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130274.054826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130274.054943:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844160 00000100:00100000:3.0:1789130274.054951:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844160 00000100:00100000:3.0:1789130274.054994:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130274.055002:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626844160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130274.055038:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130274.055107:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48e6e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626844160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130274.055114:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130274.055172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626844160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130274.247098:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130274.336497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130274.336538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130274.336573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130274.336631:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130274.336660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130274.336687:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030912 00000100:00100000:1.0:1789130274.336697:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030912 00000100:00100000:1.0:1789130274.336756:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030528 00000100:00100000:1.0:1789130274.336760:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030528 00000100:00100000:1.0:1789130274.336794:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:1.0:1789130274.336805:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605030912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130274.336877:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605030912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130274.336886:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:1.0:1789130274.336917:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789130274.336923:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+55:2367:x1876037605030528:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130274.336957:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+55:2367:x1876037605030528:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130274.336964:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789130274.336982:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030656 00000100:00100000:1.0:1789130274.336985:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030656 00000100:00100000:1.0:1789130274.337009:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030784 00000100:00100000:1.0:1789130274.337024:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030784 00000100:00100000:1.0:1789130274.337047:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130274.337054:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605030656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130274.337380:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605030656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 325us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130274.337387:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130274.337400:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:1.0:1789130274.337406:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605030784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130274.337429:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605030784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130274.337435:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00080000:1.0:1789130274.337453:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130274.337457:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130274.337459:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130274.338409:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605030400 00000100:00100000:0.0:1789130274.338418:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605030400 00000100:00100000:0.0:1789130274.338465:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:0.0:1789130274.338473:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605030400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130274.338514:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605030400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130274.338521:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000001:00080000:1.0:1789130275.150188:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771474 is committed 00000001:00080000:1.0:1789130275.150405:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771475 is committed 00010000:00010000:2.0:1789130275.275680:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130276.293852:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130276.741996:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130276.742006:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130276.742075:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 2 00000040:00080000:1.0:1789130276.742081:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789130277.320409:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130278.149938:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626844672:0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.150025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130278.150100:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130278.150107:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626844544:0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.150135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130278.150189:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844672 00000100:00100000:1.0:1789130278.150196:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844672 00000100:00100000:1.0:1789130278.150243:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789130278.150253:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.150305:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626844672:12345-0@lo:400:kworker.0 Request processed in 54us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130278.150313:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789130278.150335:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844544 00000100:00100000:1.0:1789130278.150339:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844544 00000100:00100000:1.0:1789130278.150373:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789130278.150379:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626844544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.150405:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626844544:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130278.150411:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1789130278.150429:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130278.150458:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626844544:0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.150469:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626844672:0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151021:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626844416:0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130278.151095:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626844928:0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130278.151141:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789130278.151159:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626844288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151187:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130278.151211:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626844800:0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130278.151258:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844288 00000100:00100000:3.0:1789130278.151262:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844288 00000100:00100000:3.0:1789130278.151295:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789130278.151302:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626844288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130278.151361:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626844288:12345-0@lo:400:kworker.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130278.151368:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789130278.151405:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626844288:0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.152266:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844416 00000100:00100000:1.0:1789130278.152273:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844416 00000100:00100000:1.0:1789130278.152358:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789130278.152367:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626844416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.152428:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626844416:12345-0@lo:400:kworker.0 Request processed in 62us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130278.152435:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789130278.152457:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844928 00000100:00100000:1.0:1789130278.152461:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844928 00000100:00100000:1.0:1789130278.152486:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626844800 00000100:00100000:1.0:1789130278.152490:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626844800 00000100:00100000:1.0:1789130278.152510:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1789130278.152620:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130278.152626:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130278.152894:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626845056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130278.152931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130278.152970:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845056 00000100:00100000:3.0:1789130278.152974:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845056 00000100:00100000:3.0:1789130278.153013:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130278.153020:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626845056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130278.153063:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 209518592 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130278.153105:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626845056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130278.153112:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130278.153164:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626845056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130278.153255:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626844928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.153294:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626844928:12345-0@lo:400:kworker.0 Request processed in 43us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130278.160661:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789130278.160694:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626844800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130278.160931:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626844800:12345-0@lo:400:kworker.0 Request processed in 254us (9695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130278.160940:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789130278.161034:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626844800:0@lo:400:kworker.0 00000100:00100000:0.0:1789130278.161128:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626844416:0@lo:400:kworker.0 00000100:00100000:0.0:1789130278.161141:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626844928:0@lo:400:kworker.0 00000100:00100000:1.0:1789130278.169619:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789130278.322908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130278.323232:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031040 00000100:00100000:1.0:1789130278.323244:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031040 00000100:00080000:0.0:1789130278.323797:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130278.323897:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 469 00000100:00100000:1.0:1789130278.323910:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:39815:x1876037605031040:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:1.0:1789130278.323934:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130278.323956:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47cea7c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1e9 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324035:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324218:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324234:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130278.324749:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130278.324754:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130278.324844:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324874:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47cea7c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 7 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324891:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 6 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130278.324900:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130278.324903:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130278.324907:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3de00, rc 0) 00000100:00100000:1.0:1789130278.325050:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+6:39815:x1876037605031040:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 1133us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130278.325059:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 469 00010000:00010000:3.0:1789130278.342678:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130279.174269:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130279.174366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130279.174446:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845184 00000100:00100000:1.0:1789130279.174455:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845184 00000100:00100000:1.0:1789130279.174515:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789130279.174526:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626845184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130279.174563:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130279.174648:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626845184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.174655:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130279.175137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626845184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130279.366130:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130279.456893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130279.457050:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031168 00000100:00100000:1.0:1789130279.457060:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031168 00000100:00100000:1.0:1789130279.457146:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1789130279.457158:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605031168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130279.458133:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605031168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 912us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.458144:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:0.0:1789130279.459094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130279.459153:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130279.459179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130279.459208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130279.459286:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031424 00000100:00100000:1.0:1789130279.459294:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031424 00000100:00100000:1.0:1789130279.459354:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031552 00000100:00100000:1.0:1789130279.459358:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031552 00000100:00100000:1.0:1789130279.459383:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:1.0:1789130279.459392:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605031424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130279.459449:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605031424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.459456:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:1.0:1789130279.459470:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:1.0:1789130279.459477:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605031552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130279.459503:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605031552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.459509:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:1.0:1789130279.459533:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031680 00000100:00100000:1.0:1789130279.459536:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031680 00000100:00100000:1.0:1789130279.459557:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031296 00000100:00100000:1.0:1789130279.459559:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031296 00000100:00100000:1.0:1789130279.459575:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:1.0:1789130279.459581:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605031680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130279.459635:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605031680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 53us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.459658:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:1.0:1789130279.459670:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1789130279.459676:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:2369:x1876037605031296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130279.459861:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:2369:x1876037605031296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 184us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130279.459869:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00080000:0.0:1789130279.460245:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130279.460251:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130279.460253:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130280.389972:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130281.414745:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130282.438533:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130283.270052:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626845696:0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.270124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130283.270188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130283.270194:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626845568:0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.270218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130283.270254:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845696 00000100:00100000:1.0:1789130283.270261:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845696 00000100:00100000:1.0:1789130283.270304:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789130283.270312:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626845696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.270361:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626845696:12345-0@lo:400:kworker.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130283.270368:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789130283.270410:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626845696:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270466:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626845440:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130283.270518:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626845952:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130283.270559:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789130283.270564:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626845312:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130283.270665:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626845824:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130283.270722:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845952 00000100:00100000:3.0:1789130283.270726:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845952 00000100:00100000:3.0:1789130283.270763:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845824 00000100:00100000:3.0:1789130283.270766:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845824 00000100:00100000:3.0:1789130283.270788:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789130283.270795:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626845952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270830:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626845952:12345-0@lo:400:kworker.0 Request processed in 36us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130283.270837:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789130283.270850:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789130283.270856:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626845824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.270883:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626845824:12345-0@lo:400:kworker.0 Request processed in 28us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130283.270889:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789130283.270950:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845312 00000100:00100000:3.0:1789130283.270953:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845312 00000100:00100000:3.0:1789130283.270978:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789130283.270984:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626845312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.271016:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bb6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626845312:12345-0@lo:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130283.271022:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1789130283.271051:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130283.271069:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626846080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130283.271095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130283.271125:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626846080 00000100:00100000:3.0:1789130283.271136:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626846080 00000100:00100000:3.0:1789130283.271172:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130283.271179:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626846080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130283.271214:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 209518592 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130283.271251:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626846080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130283.271256:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789130283.271274:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130283.271295:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626846080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130283.271321:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626845312:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.271331:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626845824:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.271340:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626845952:0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.271457:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845568 00000100:00100000:1.0:1789130283.271462:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845568 00000100:00100000:1.0:1789130283.271502:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626845440 00000100:00100000:1.0:1789130283.271505:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626845440 00000100:00100000:1.0:1789130283.271532:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789130283.271538:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626845568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.271582:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626845568:12345-0@lo:400:kworker.0 Request processed in 44us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130283.271589:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789130283.271624:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789130283.271630:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626845440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130283.271662:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626845440:12345-0@lo:400:kworker.0 Request processed in 32us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130283.271667:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789130283.271790:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130283.271809:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626845568:0@lo:400:kworker.0 00000100:00100000:3.0:1789130283.271830:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626845440:0@lo:400:kworker.0 00000001:02000400:1.0:1789130283.311341:0:40987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 08:38:01 (1789130281) 00010000:00010000:1.0:1789130283.467554:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130284.294626:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130284.294651:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626846208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130284.295010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130284.295164:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626846208 00000100:00100000:3.0:1789130284.295173:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626846208 00000100:00100000:3.0:1789130284.295229:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130284.295239:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626846208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130284.295276:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130284.295344:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626846208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130284.295351:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789130284.295573:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626846208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130284.488669:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130284.576395:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130284.576443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130284.576485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130284.576522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130284.576546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130284.576634:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032064 00000100:00100000:3.0:1789130284.576646:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032064 00000100:00100000:3.0:1789130284.576715:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032192 00000100:00100000:3.0:1789130284.576719:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032192 00000100:00100000:3.0:1789130284.576745:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130284.576756:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605032064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130284.576829:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605032064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 75us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130284.576837:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130284.576853:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:3.0:1789130284.576860:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605032192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130284.576898:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605032192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130284.576905:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:3.0:1789130284.576925:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032320 00000100:00100000:3.0:1789130284.576929:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032320 00000100:00100000:3.0:1789130284.576956:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031936 00000100:00100000:3.0:1789130284.576960:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031936 00000100:00100000:3.0:1789130284.576977:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:3.0:1789130284.576984:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037605032320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130284.577014:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2370:x1876037605032320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130284.577020:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:3.0:1789130284.577031:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:3.0:1789130284.577038:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:2370:x1876037605031936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130284.577065:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:2370:x1876037605031936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130284.577086:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:1.0:1789130284.577364:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605031808 00000100:00100000:1.0:1789130284.577369:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605031808 00000100:00100000:1.0:1789130284.577406:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:1.0:1789130284.577413:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605031808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130284.577453:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605031808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 41us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130284.577460:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00080000:2.0:1789130284.580056:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130284.580070:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130284.580073:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130285.431177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130285.444015:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032576 00000100:00100000:1.0:1789130285.444031:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032576 00000100:00100000:1.0:1789130285.444125:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 470 00000100:00100000:1.0:1789130285.444138:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+48:40073:x1876037605032576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130285.444160:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130285.444184:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47cea7d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1f0 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444293:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444322:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444337:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444354:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444362:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.444368:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445024:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea7e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445037:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445046:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130285.445056:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789130285.445251:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445270:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445277:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445283:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130285.445289:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445297:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445311:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:1.0:1789130285.445314:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130285.445319:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445325:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47cea7d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445339:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445345:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445352:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445357:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130285.445365:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445372:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445381:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4909bd600) 00010000:00010000:1.0:1789130285.445383:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130285.445387:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445393:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445844:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47cea7d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f0 expref: 51 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445875:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f0 expref: 50 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.445883:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130285.445885:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130285.445888:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130285.445973:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+50:40073:x1876037605032576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1838us (14808us total) trans 30064771476 rc 0/0 00000100:00100000:1.0:1789130285.445982:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 470 00000100:00100000:0.0:1789130285.457777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130285.457826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130285.457899:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032832 00000100:00100000:3.0:1789130285.457911:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032832 00000100:00100000:3.0:1789130285.457981:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 471 00000100:00100000:3.0:1789130285.457992:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:40073:x1876037605032832:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130285.458071:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605032704 00000100:00100000:2.0:1789130285.458077:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605032704 00000100:00100000:2.0:1789130285.458129:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130285.458138:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:2367:x1876037605032704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130285.458156:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130285.458186:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea7e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f0 expref: 51 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.458207:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130285.458212:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130285.458270:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:2367:x1876037605032704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 133us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130285.458277:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130285.458820:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:40073:x1876037605032832:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 829us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130285.458828:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 471 00010000:00010000:1.0:1789130285.513309:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130285.665599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130285.667113:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033088 00000100:00100000:1.0:1789130285.667125:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033088 00000100:00100000:1.0:1789130285.667196:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 472 00000100:00100000:1.0:1789130285.667223:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:40088:x1876037605033088:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130285.667246:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130285.667249:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130285.667272:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed7600/0x5c74554e47cea6eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1b8 expref: 49 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667287:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130285.667291:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130285.667301:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47cea7f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1f7 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667748:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667760:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667767:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667793:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 5 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130285.667808:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 5 pid: 38734 timeout: 1548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130285.667822:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626846336:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130285.667931:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491132a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130285.673069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130285.673412:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626846336:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130285.673442:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130285.673743:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033216 00000100:00100000:0.0:1789130285.673751:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033216 00010000:00010000:0.0:1789130285.673793:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 6 pid: 38734 timeout: 1548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130285.673835:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:0.0:1789130285.673844:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605033216:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130285.673869:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130285.673875:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 6 pid: 38734 timeout: 1548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673887:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 6 pid: 38734 timeout: 1548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673912:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea7cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e9 expref: 6 pid: 38734 timeout: 1548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673927:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130285.673932:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673942:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673949:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.673985:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130285.674041:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605033216:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 196us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130285.674049:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00010000:00010000:2.0:1789130285.674289:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.674297:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.674334:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.674343:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.674351:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130285.675869:0:36587:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcd:0x0], index 1: 0 00010000:00010000:2.0:1789130285.676153:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.676168:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677706:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677775:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677783:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677810:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677817:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130285.677822:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677829:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677844:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789130285.677847:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130285.677851:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677868:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47cea7fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130285.677887:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000048c9f5a4 reply state 000000000027c471 transno 30064771477 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130285.677897:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130285.677944:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47cea7f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677964:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 50 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.677972:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130285.677976:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130285.677978:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130285.678064:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:40088:x1876037605033088:12345-192.168.201.39@tcp:101:bash.0 Request processed in 10843us (12472us total) trans 30064771477 rc 0/0 00000100:00100000:2.0:1789130285.678073:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 472 00010000:00010000:0.0:1789130285.681882:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681901:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681909:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681916:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130285.681921:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681931:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681948:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b482b51500) 00010000:00010000:0.0:1789130285.681951:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130285.681956:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130285.681963:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea803 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130285.688206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130285.688523:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033344 00000100:00100000:3.0:1789130285.688534:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033344 00000100:00100000:3.0:1789130285.688648:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:3.0:1789130285.688659:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037605033344:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130285.688677:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130285.688697:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac1fe expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130285.688726:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130285.688748:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=1448s v=(0 0) 00010000:00010000:3.0:1789130285.688752:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130285.688762:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 11 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.688779:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 11 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.688809:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35a00, rc 0) 00000100:00100000:3.0:1789130285.688899:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037605033344:12345-192.168.201.39@tcp:101:bash.0 Request processed in 242us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130285.688906:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:3.0:1789130285.695255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130285.695569:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033472 00000100:00100000:2.0:1789130285.695580:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033472 00000100:00100000:2.0:1789130285.695681:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:2.0:1789130285.695692:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:40088:x1876037605033472:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130285.695711:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130285.695732:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac205 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.695770:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 12 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.695780:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130285.695784:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130285.695790:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 12 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.695848:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 12 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.695875:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 12 pid: 37273 timeout: 1548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130285.698282:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:37276:1876037626846464:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130285.700221:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130285.706057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130285.706979:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033600 00000100:00100000:3.0:1789130285.706994:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033600 00010000:00010000:3.0:1789130285.707055:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 13 pid: 37273 timeout: 1548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130285.707107:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130285.707127:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605033600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130285.707146:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130285.707170:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 13 pid: 37273 timeout: 1548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.707477:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 13 pid: 37273 timeout: 1548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.707517:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130285.707522:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130285.707531:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.707543:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.707744:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130285.707760:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626846592:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130285.707916:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607d240 going to sleep for 11 seconds 00010000:00010000:2.0:1789130285.708317:0:37276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c18f0cc/0x5c74554e47cea818 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1fe expref: 13 pid: 37273 timeout: 1548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130285.708336:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:37276:1876037626846464:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130285.708364:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 12 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130285.708550:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130285.708592:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:40088:x1876037605033472:12345-192.168.201.39@tcp:101:bash.0 Request processed in 12901us (13348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130285.708640:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1789130285.716065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130285.716800:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033856 00000100:00100000:1.0:1789130285.716822:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033856 00000100:00100000:1.0:1789130285.716892:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:1.0:1789130285.716904:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:40088:x1876037605033856:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130285.717496:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:40088:x1876037605033856:12345-192.168.201.39@tcp:35:bash.0 Request processed in 592us (1439us total) trans 30064771478 rc 0/0 00000100:00100000:1.0:1789130285.717506:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1789130285.717967:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626846592:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130285.717991:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130285.718020:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605033600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 10903us (11975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130285.718030:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789130285.825052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130285.825322:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605033984 00000100:00100000:3.0:1789130285.825333:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605033984 00000100:00100000:3.0:1789130285.825405:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 473 00000100:00100000:3.0:1789130285.825417:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:40091:x1876037605033984:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130285.825442:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130285.825465:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac20c expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.825749:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.825764:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.825775:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130285.826070:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130285.826075:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130285.826101:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.826129:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac20c expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.826149:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac20c expref: 52 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130285.826157:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419200) 00010000:00010000:3.0:1789130285.826160:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130285.826164:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35400, rc 0) 00000100:00100000:3.0:1789130285.826352:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:40091:x1876037605033984:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 936us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130285.826360:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 473 00000040:00080000:1.0:1789130285.957882:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130285.957894:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130285.957931:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 2 00000040:00080000:1.0:1789130285.957938:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130286.186231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130286.186490:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605034240 00000100:00100000:3.0:1789130286.186501:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605034240 00000100:00100000:3.0:1789130286.186579:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 474 00000100:00100000:3.0:1789130286.186592:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:40114:x1876037605034240:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130286.186650:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130286.186674:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac213 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.186774:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea83b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.186880:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea83b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.186895:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea83b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130286.186908:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1789130286.187051:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac213 expref: 55 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.187074:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea83b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac213 expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.187083:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:3.0:1789130286.187086:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130286.187090:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00080000:2.0:1789130286.187679:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130286.188353:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:40114:x1876037605034240:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1758us (2125us total) trans 30064771479 rc 0/0 00000100:00100000:3.0:1789130286.188371:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 474 00000100:00100000:0.0:1789130286.199929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130286.200026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.200261:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605034624 00000100:00100000:2.0:1789130286.200273:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605034624 00000100:00100000:2.0:1789130286.200353:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 475 00000100:00100000:2.0:1789130286.200365:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:40114:x1876037605034624:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130286.200391:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130286.200413:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47cea849 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac21a expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.200515:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.200530:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.200541:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130286.200556:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1789130286.200721:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47cea849 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac21a expref: 57 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.200741:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac21a expref: 56 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.200751:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130286.200754:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130286.200758:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130286.200828:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:40114:x1876037605034624:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 466us (802us total) trans 30064771480 rc 0/0 00000100:00100000:2.0:1789130286.200836:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 475 00000100:00100000:1.0:1789130286.202383:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605034368 00000100:00100000:1.0:1789130286.202397:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605034368 00000100:00100000:1.0:1789130286.202466:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130286.202475:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+56:2370:x1876037605034368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130286.202490:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130286.202514:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47cea83b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac213 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.202541:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130286.202545:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130286.202589:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2370:x1876037605034368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 117us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130286.202664:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130286.212052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.212195:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605034752 00000100:00100000:2.0:1789130286.212206:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605034752 00000100:00100000:2.0:1789130286.212289:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1789130286.212302:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605034752:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130286.212379:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.212403:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 11 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.212414:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130286.212419:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130286.212425:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.212464:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 11 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.212480:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 11 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130286.212495:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3832203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626846720:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130286.212588:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032600 going to sleep for 11 seconds 00000100:00080000:3.0:1789130286.212788:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130286.215561:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3832203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:37658:1876037626846720:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130286.215593:0:37658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.216379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130286.216717:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605034880 00000100:00100000:0.0:1789130286.216727:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605034880 00002000:00100000:0.0:1789130286.216788:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcd:0x0] (0->4) req@ffff90b382e41e00 x1876037605034880/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:2/0 lens 496/0 e 0 to 0 dl 1789130297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130286.216812:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e41e00 with x1876037605034880 ext(0->4) 00010000:00010000:0.0:1789130286.216824:0:40395:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 12 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.216840:0:40395:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 12 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130286.216866:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b382e41e00 00000100:00100000:0.0:1789130286.216902:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1789130286.216914:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605034880:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:0.0:1789130286.217785:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605034880:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 868us (1403us total) trans 30064771211 rc 0/0 00000100:00100000:0.0:1789130286.217861:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00100000:0.0:1789130286.217872:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0xcd:0x0] (0->4) req@ffff90b382e41e00 x1876037605034880/t30064771211(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:2/0 lens 496/448 e 0 to 0 dl 1789130297 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130286.217882:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e41e00 with x1876037605034880 ext(0->4) 00010000:00010000:0.0:1789130286.217890:0:40395:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.217905:0:40395:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130286.217913:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b382e41e00 00000100:00100000:0.0:1789130286.235631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.235751:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035008 00000100:00100000:1.0:1789130286.235762:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035008 00010000:00010000:1.0:1789130286.235817:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.235871:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130286.235882:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605035008:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130286.235901:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789130286.235921:0:36572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcd:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1789130286.235924:0:36572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcd:0x0] updating lvb mtime from disk: 0 -> 1789130285 00002000:00010000:1.0:1789130286.235927:0:36572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcd:0x0] updating lvb atime from disk: 0 -> 1789130285 00002000:00010000:1.0:1789130286.235929:0:36572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcd:0x0] updating lvb ctime from disk: 0 -> 1789130285 00010000:00010000:1.0:1789130286.235935:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.235950:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.235977:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cea81f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac205 expref: 14 pid: 37276 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.235997:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130286.236022:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130286.236028:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.236040:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.236078:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130286.236143:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605035008:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 263us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130286.236151:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00010000:00010000:2.0:1789130286.236285:0:37658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236295:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236321:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236330:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236337:0:37658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236362:0:37658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130286.236366:0:37658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236374:0:37658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236386:0:37658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.236393:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e497e903/0x5c74554e47cea85e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130286.236442:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605034752:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 24143us (24400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130286.236451:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1789130286.243781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130286.246269:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035264 00000100:00100000:0.0:1789130286.246285:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035264 00000100:00100000:0.0:1789130286.246371:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130286.246383:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48615fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:40114:x1876037605035264:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789130286.246448:0:36590:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac21a expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130286.246752:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771481 00000001:00080000:0.0:1789130286.246798:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771482 00000001:00080000:0.0:1789130286.247520:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771483 00010000:00010000:0.0:1789130286.247588:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.247635:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 59 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.247645:0:36590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.247685:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 59 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.247701:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 59 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130286.247716:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626846848:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130286.247819:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130286.262675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.262746:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626846848:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130286.262782:0:36590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.262862:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035392 00000100:00100000:1.0:1789130286.262870:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035392 00010000:00010000:1.0:1789130286.262911:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 60 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.262951:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789130286.262961:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+60:2370:x1876037605035392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130286.262976:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130286.262983:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 60 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.262996:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 60 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.263018:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cea80a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1f7 expref: 60 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.263060:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130286.263065:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.263073:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.263079:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.263113:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130286.263182:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+59:2370:x1876037605035392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 222us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130286.263191:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00010000:00010000:0.0:1789130286.263871:0:36590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.263880:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130286.264002:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771484 00000001:00080000:0.0:1789130286.264218:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771485 00000100:00100000:0.0:1789130286.264541:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626846976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130286.264653:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130286.264740:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130286.271516:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626846976 00000100:00100000:2.0:1789130286.271531:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626846976 00000100:00100000:2.0:1789130286.271637:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130286.271648:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626846976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130286.271788:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626846976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (7134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130286.271957:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626846976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130286.272645:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771486 00000100:00100000:0.0:1789130286.272732:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626847104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130286.272780:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130286.272813:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a9c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789130286.273046:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130286.273112:0:36592:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789130286.273123:0:36592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789130286.273304:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130286.273334:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626847104 00000100:00100000:2.0:1789130286.273628:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626847104 00000100:00100000:2.0:1789130286.273665:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130286.273672:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626847104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130286.273957:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36590:x1876037626847104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 285us (1176us total) trans 30064771212 rc 0/0 00000100:00100000:2.0:1789130286.273965:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789130286.274747:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626847104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130286.274840:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771487 00010000:00010000:0.0:1789130286.274903:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274921:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274929:0:36590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274936:0:36590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.274941:0:36590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274949:0:36590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274964:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130286.274967:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130286.274973:0:36590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.274979:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea865 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130286.276414:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130286.276544:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].17, 64 off9496 00000004:00080000:0.0:1789130286.276557:0:36590:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1449373954187ns, next at 1450373951132ns, rc = 0 00000001:00080000:0.0:1789130286.276566:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771488 00010000:00010000:0.0:1789130286.276654:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130286.276659:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130286.276668:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea850 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac21a expref: 63 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130286.276780:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48615fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:40114:x1876037605035264:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 30399us (33010us total) trans 30064771489 rc 0/0 00000100:00100000:0.0:1789130286.276791:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000020:00080000:0.0:1789130286.276797:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789130286.285157:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130286.285305:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035520 00000100:00100000:3.0:1789130286.285318:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035520 00000100:00100000:3.0:1789130286.285387:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 476 00000100:00100000:3.0:1789130286.285397:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+62:40114:x1876037605035520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130286.285425:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130286.285461:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea86c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac221 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.285547:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea86c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac221 expref: 63 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.285562:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea86c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac221 expref: 63 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.285582:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130286.285585:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130286.285589:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35200, rc 0) 00000100:00100000:3.0:1789130286.285677:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4890483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+63:40114:x1876037605035520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 282us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130286.285685:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 476 00000100:00100000:2.0:1789130286.291731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.291820:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035776 00000100:00100000:1.0:1789130286.291831:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035776 00000100:00100000:1.0:1789130286.291900:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789130286.291910:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+63:40114:x1876037605035776:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130286.292176:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+64:40114:x1876037605035776:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 267us (454us total) trans 30064771490 rc 0/0 00000100:00100000:1.0:1789130286.292185:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:2.0:1789130286.476527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130286.480296:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605035904 00000100:00100000:3.0:1789130286.480320:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605035904 00000100:00100000:3.0:1789130286.480446:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 477 00000100:00100000:3.0:1789130286.480461:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:40124:x1876037605035904:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130286.480588:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.480668:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.480690:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.480713:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.480750:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.480757:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482400:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482422:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482435:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130286.482505:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482522:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482529:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482537:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482544:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130286.482549:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482558:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482595:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419200) 00010000:00010000:3.0:1789130286.482598:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130286.482654:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482663:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47cea873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482682:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482689:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482695:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482700:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130286.482703:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482710:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482718:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b496419700) 00010000:00010000:3.0:1789130286.482720:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130286.482723:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482729:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea87a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482759:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482767:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482774:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482779:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130286.482782:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.482789:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.517360:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130286.517365:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130286.517376:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.517385:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea881 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130286.517559:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:40124:x1876037605035904:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 37095us (41037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130286.517573:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 477 00010000:00010000:3.0:1789130286.533835:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130286.655283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.655524:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605036160 00000100:00100000:1.0:1789130286.655539:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605036160 00000100:00100000:1.0:1789130286.655669:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 478 00000100:00100000:1.0:1789130286.655684:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:40131:x1876037605036160:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130286.655753:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130286.655789:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac228 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655916:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655937:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655951:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655982:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655990:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.655997:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.657865:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.657893:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.657909:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130286.657930:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:1.0:1789130286.659129:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659148:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659157:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659164:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130286.659169:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659177:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659210:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419200) 00010000:00010000:1.0:1789130286.659214:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130286.659220:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659228:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47cea88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659249:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659255:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659261:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659284:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130286.659287:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659294:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659303:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b4909bd600) 00010000:00010000:1.0:1789130286.659305:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130286.659308:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659314:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659388:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 67 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659408:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 66 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.659416:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:1.0:1789130286.659418:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130286.659421:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3cc00, rc 0) 00000100:00100000:1.0:1789130286.659531:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:40131:x1876037605036160:12345-192.168.201.39@tcp:101:cat.0 Request processed in 3850us (4266us total) trans 30064771491 rc 0/0 00000100:00100000:1.0:1789130286.659543:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 478 00000100:00100000:1.0:1789130286.662580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130286.662931:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605036416 00000100:00100000:3.0:1789130286.662947:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605036416 00000100:00100000:3.0:1789130286.663051:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789130286.663065:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+66:40131:x1876037605036416:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:3.0:1789130286.663509:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+67:40131:x1876037605036416:12345-192.168.201.39@tcp:35:cat.0 Request processed in 446us (942us total) trans 30064771492 rc 0/0 00000100:00100000:3.0:1789130286.663520:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130286.754670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.754800:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605036672 00000100:00100000:1.0:1789130286.754813:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605036672 00000100:00100000:1.0:1789130286.755209:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 479 00000100:00100000:1.0:1789130286.755222:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+67:40137:x1876037605036672:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130286.755257:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130286.755286:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea8ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac22f expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.755431:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.755449:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 68 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.755459:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.756955:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 68 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.756982:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 68 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.758129:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626847232:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130286.758301:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130286.761616:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626847232:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130286.761658:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130286.769711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.770193:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605036800 00000100:00100000:1.0:1789130286.770209:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605036800 00010000:00010000:1.0:1789130286.770277:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 69 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.770329:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789130286.770341:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:2369:x1876037605036800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130286.770382:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130286.770391:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 69 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770409:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 69 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770440:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47cea89d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac228 expref: 69 pid: 36587 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770462:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:1.0:1789130286.770476:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770488:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770499:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.770543:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130286.770687:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+68:2369:x1876037605036800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 347us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130286.770697:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:2.0:1789130286.771021:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.771031:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130286.771058:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1789130286.771253:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47cea8ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 69 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.771274:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 68 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.771282:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:2.0:1789130286.771286:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130286.771289:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d600, rc 0) 00000100:00100000:2.0:1789130286.771324:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+68:40137:x1876037605036672:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 16106us (16670us total) trans 30064771493 rc 0/0 00000100:00100000:2.0:1789130286.771333:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 479 00000100:00100000:3.0:1789130286.794316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130286.797222:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605036928 00000100:00100000:0.0:1789130286.797244:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605036928 00000100:00100000:0.0:1789130286.797353:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 480 00000100:00100000:0.0:1789130286.797365:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+68:40138:x1876037605036928:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130286.797399:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130286.797431:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac236 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797547:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797566:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797582:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797642:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797657:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797665:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797842:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797855:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 69 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797864:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797914:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 69 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.797932:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 69 pid: 38734 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130286.797957:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626847360:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130286.801142:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497426540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130286.815712:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48904b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626847360:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130286.815769:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.815975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130286.816106:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605037184 00000100:00100000:3.0:1789130286.816116:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605037184 00000100:00100000:3.0:1789130286.816188:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130286.816201:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+70:31332:x1876037605037184:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130286.816965:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+71:31332:x1876037605037184:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 761us (986us total) trans 30064771494 rc 0/0 00000100:00100000:3.0:1789130286.816977:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789130286.830978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130286.843123:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605037312 00000100:00100000:1.0:1789130286.843145:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605037312 00010000:00010000:1.0:1789130286.843224:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 71 pid: 38734 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.843291:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130286.843302:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+71:2370:x1876037605037312:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130286.843322:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130286.843330:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 71 pid: 38734 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843345:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 71 pid: 38734 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843374:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47cea8b2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac22f expref: 71 pid: 38734 timeout: 1549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843393:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:1.0:1789130286.843400:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843412:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843420:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.843983:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130286.844425:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+70:2370:x1876037605037312:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1118us (13456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130286.844439:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00010000:00010000:0.0:1789130286.844569:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844581:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130286.844675:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00000004:00200000:0.0:1789130286.844681:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130286.844718:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844737:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844749:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844757:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844765:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844772:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.844779:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844797:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844811:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419200) 00010000:00010000:0.0:1789130286.844815:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130286.844819:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844827:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844856:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844864:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844871:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.844877:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.844881:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845199:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845209:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b497c01800) 00010000:00010000:0.0:1789130286.845212:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130286.845217:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845223:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea8ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845335:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac236 expref: 71 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845352:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac236 expref: 70 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.845361:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130286.845363:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130286.845366:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030c00, rc 0) 00000100:00100000:0.0:1789130286.845418:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+70:40138:x1876037605036928:12345-192.168.201.39@tcp:101:rm.0 Request processed in 48055us (51119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130286.845427:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 480 00000100:00100000:1.0:1789130286.850127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.850402:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605037568 00000100:00100000:2.0:1789130286.850419:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605037568 00000100:00100000:2.0:1789130286.850577:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 481 00000100:00100000:2.0:1789130286.850592:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:40138:x1876037605037568:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1789130286.852164:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789130286.852216:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cea8d5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac236 expref: 69 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852247:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47cea86c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac221 expref: 68 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852262:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b496419500) 00010000:00010000:2.0:1789130286.852280:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47cea82d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac20c expref: 67 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852298:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419200) 00010000:00010000:2.0:1789130286.852304:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130286.852339:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852353:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852365:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852380:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852388:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852394:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852554:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852564:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.852572:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856796:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856830:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856858:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856869:0:36587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856876:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856882:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856910:0:36587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130286.856944:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856951:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856958:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856965:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130286.856971:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.856980:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858073:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130286.858090:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858102:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130286.858106:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858116:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858133:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51900) 00010000:00010000:1.0:1789130286.858137:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130286.858144:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858150:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cea8f1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130286.858185:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130286.858188:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130286.858190:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130286.858930:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff90b482b51900) 00010000:00010000:2.0:1789130286.858937:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130286.858946:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.858957:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ea lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859012:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859020:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859027:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859033:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130286.859037:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859044:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859058:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:2.0:1789130286.859061:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130286.859065:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.859071:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130286.859094:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006a85044b reply state 000000004878dadb transno 30064771495 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130286.859105:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130286.859255:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+68:40138:x1876037605037568:12345-192.168.201.39@tcp:36:rm.0 Request processed in 8659us (9139us total) trans 30064771495 rc 0/0 00000100:00100000:2.0:1789130286.859266:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 481 00010000:00010000:0.0:1789130286.867809:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867839:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867850:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867857:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.867863:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867878:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867907:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b482b51100) 00010000:00010000:0.0:1789130286.867910:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130286.867916:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.867924:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cea8e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.927033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.930230:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605037696 00000100:00100000:2.0:1789130286.930258:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605037696 00000100:00100000:2.0:1789130286.930377:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 482 00000100:00100000:2.0:1789130286.930392:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+67:40144:x1876037605037696:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130286.930429:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130286.930463:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac23d expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930577:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930597:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930638:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130286.930725:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130286.930731:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130286.930774:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930820:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cea8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac23d expref: 69 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930858:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac23d expref: 68 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.930868:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:2.0:1789130286.930871:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130286.930876:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130286.933294:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+68:40144:x1876037605037696:12345-192.168.201.39@tcp:101:bash.0 Request processed in 2890us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130286.933311:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 482 00000100:00100000:2.0:1789130286.939431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130286.939586:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605037952 00000100:00100000:0.0:1789130286.939636:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605037952 00000100:00100000:0.0:1789130286.939716:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 483 00000100:00100000:0.0:1789130286.939728:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+68:40144:x1876037605037952:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130286.939759:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130286.939762:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130286.939800:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cea8ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac23d expref: 68 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.939826:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:0.0:1789130286.939853:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130286.939874:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea906 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac244 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940327:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940350:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940363:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940380:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940388:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.940395:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130286.942185:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcd:0x0], index 0: 0 00010000:00010000:0.0:1789130286.942534:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cea91b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942554:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cea91b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942568:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cea91b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942828:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942847:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942855:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942863:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.942869:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.942878:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.943437:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130286.943441:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130286.943449:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.943457:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47cea90d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130286.943483:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004cac6f1b reply state 00000000a490d02b transno 30064771496 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130286.943493:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130286.943544:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea906 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac244 expref: 70 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.943570:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cea91b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac244 expref: 69 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.943578:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130286.943580:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130286.943583:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:0.0:1789130286.944253:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+70:40144:x1876037605037952:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4509us (4821us total) trans 30064771496 rc 0/0 00000100:00100000:0.0:1789130286.944266:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 483 00000100:00100000:1.0:1789130286.955746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.957876:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038080 00000100:00100000:2.0:1789130286.957904:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038080 00000100:00080000:3.0:1789130286.958173:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130286.958254:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:2.0:1789130286.958268:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605038080:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130286.958297:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130286.958326:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac24b expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130286.958365:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130286.958394:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=1450s v=(0 0) 00010000:00010000:2.0:1789130286.958399:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130286.958410:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 14 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.958437:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 14 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.958455:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1600, rc 0) 00000100:00100000:2.0:1789130286.958553:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:2367:x1876037605038080:12345-192.168.201.39@tcp:101:bash.0 Request processed in 288us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130286.958561:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00010000:00010000:0.0:1789130286.966676:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.966710:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.966721:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.966729:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130286.966736:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.966748:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.967136:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b497c01f00) 00010000:00010000:0.0:1789130286.967141:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130286.967148:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130286.967157:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea914 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130286.967944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130286.968449:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038208 00000100:00100000:2.0:1789130286.968464:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038208 00000100:00100000:2.0:1789130286.968541:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:2.0:1789130286.968553:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:40144:x1876037605038208:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130286.968578:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130286.968632:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac252 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.968678:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.968688:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130286.968694:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130286.968699:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 15 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.968749:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.969228:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130286.969248:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626847488:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130286.969378:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4900326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130286.974189:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:37276:1876037626847488:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130286.974256:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 15 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130286.974285:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0400, rc 0) 00000100:00100000:2.0:1789130286.974355:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:40144:x1876037605038208:12345-192.168.201.39@tcp:101:bash.0 Request processed in 5803us (6422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130286.974366:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:1.0:1789130286.975677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000040:00080000:1.0:1789130286.981959:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130286.981972:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130286.982335:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 1 00000040:00080000:1.0:1789130286.982344:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130286.988904:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038336 00000100:00100000:3.0:1789130286.988930:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038336 00010000:00010000:3.0:1789130286.989267:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130286.989344:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130286.989357:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605038336:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130286.989379:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130286.989411:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.989453:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.989785:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cea929 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac24b expref: 15 pid: 37275 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.989808:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130286.989812:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130286.989822:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.989842:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130286.990082:0:36572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130286.990102:0:36572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486df5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626847616:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130286.990223:0:36572:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130287.000523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.000549:0:36572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486df5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626847616:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130287.000587:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130287.000697:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605038336:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 11343us (25027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.000713:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789130287.001545:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038592 00000100:00100000:0.0:1789130287.001558:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038592 00000100:00100000:0.0:1789130287.001635:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:0.0:1789130287.001645:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:40144:x1876037605038592:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789130287.002120:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:40144:x1876037605038592:12345-192.168.201.39@tcp:35:bash.0 Request processed in 474us (1610us total) trans 30064771497 rc 0/0 00000100:00100000:0.0:1789130287.002129:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130287.079149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130287.079538:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038720 00000100:00100000:2.0:1789130287.079552:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038720 00000100:00100000:2.0:1789130287.079689:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 484 00000100:00100000:2.0:1789130287.079702:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:40147:x1876037605038720:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130287.079737:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130287.079772:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac259 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.079901:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.079923:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.079937:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130287.080240:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130287.080246:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130287.080278:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.080307:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac259 expref: 72 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.080333:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac259 expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.080341:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:2.0:1789130287.080345:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130287.080348:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130287.080444:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+71:40147:x1876037605038720:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 745us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130287.080454:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 484 00000100:00100000:2.0:1789130287.449673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.452127:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605038976 00000100:00100000:1.0:1789130287.452148:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605038976 00000100:00100000:1.0:1789130287.452279:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 485 00000100:00100000:1.0:1789130287.452291:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+71:40176:x1876037605038976:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130287.452320:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130287.452349:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac260 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.452497:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea94c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.452519:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea94c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.452533:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea94c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130287.452548:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:1.0:1789130287.452784:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47cea945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac260 expref: 74 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.452841:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea94c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac260 expref: 73 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.452851:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130287.452854:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130287.452858:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130287.456252:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+73:40176:x1876037605038976:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3937us (6570us total) trans 30064771498 rc 0/0 00000100:00100000:1.0:1789130287.456269:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 485 00000100:00100000:3.0:1789130287.459979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130287.460439:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605039232 00000100:00100000:0.0:1789130287.460450:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605039232 00000100:00100000:0.0:1789130287.460533:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 486 00000100:00100000:0.0:1789130287.460545:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:40176:x1876037605039232:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130287.460575:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130287.460597:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea95a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac267 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130287.460771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130287.460858:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605039360 00000100:00100000:3.0:1789130287.460865:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605039360 00000100:00100000:3.0:1789130287.460934:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130287.460943:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+75:2370:x1876037605039360:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130287.460954:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130287.460975:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47cea94c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac260 expref: 75 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.460994:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130287.460999:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130287.461072:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+74:2370:x1876037605039360:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130287.461079:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00010000:00010000:0.0:1789130287.461660:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea961 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.461677:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea961 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.461689:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea961 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130287.461703:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:0.0:1789130287.461935:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47cea95a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac267 expref: 75 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.461953:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea961 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac267 expref: 74 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.461961:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130287.461964:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130287.461967:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030400, rc 0) 00000100:00100000:0.0:1789130287.462013:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+74:40176:x1876037605039232:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1470us (2045us total) trans 30064771499 rc 0/0 00000100:00100000:0.0:1789130287.462021:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 486 00000100:00100000:2.0:1789130287.468785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.469024:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605039488 00000100:00100000:1.0:1789130287.469037:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605039488 00000100:00100000:1.0:1789130287.469126:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789130287.469135:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+74:40176:x1876037605039488:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130287.469154:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130287.469186:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47cea961 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac267 expref: 74 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.469210:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130287.469217:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130287.469279:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+73:40176:x1876037605039488:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 145us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.469298:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130287.472088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130287.472221:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605039744 00000100:00100000:0.0:1789130287.472238:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605039744 00000100:00100000:0.0:1789130287.472318:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789130287.472329:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+73:40176:x1876037605039744:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130287.472642:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:40176:x1876037605039744:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 314us (569us total) trans 30064771500 rc 0/0 00000100:00100000:0.0:1789130287.472650:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789130287.484726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130287.484818:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040000 00000100:00100000:2.0:1789130287.484838:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040000 00000100:00100000:2.0:1789130287.484908:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:2.0:1789130287.484918:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:40176:x1876037605040000:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130287.485170:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+75:40176:x1876037605040000:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 253us (452us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1789130287.485179:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00010000:00010000:3.0:1789130287.558058:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130287.635845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.636692:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040256 00000100:00100000:1.0:1789130287.636709:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040256 00000100:00100000:1.0:1789130287.636786:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 487 00000100:00100000:1.0:1789130287.636815:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+75:40183:x1876037605040256:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:1.0:1789130287.636889:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130287.636923:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cea91b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac244 expref: 75 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.636948:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130287.636969:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea93e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac259 expref: 74 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.636983:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:1.0:1789130287.636991:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130287.637017:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637030:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637040:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637053:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637060:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637067:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637215:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637231:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.637237:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130287.639277:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].17, 64 off9568 00000004:00080000:1.0:1789130287.642897:0:36587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1450740291326ns, next at 1451740281673ns, rc = 0 00010000:00010000:1.0:1789130287.643035:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.643055:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.643069:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644702:0:36587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644712:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644718:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644827:0:36587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130287.644857:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644863:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644885:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644891:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ce00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130287.644895:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644903:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644919:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130287.644922:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130287.644927:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644934:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea97d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644959:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644964:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644970:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644975:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130287.644978:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.644993:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.645001:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130287.645003:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130287.645006:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.645011:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea96f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130287.645027:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000607b2b8 reply state 000000007cffe43c transno 30064771502 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130287.645036:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130287.645161:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+75:40183:x1876037605040256:12345-192.168.201.39@tcp:36:rm.0 Request processed in 8344us (9338us total) trans 30064771502 rc 0/0 00000100:00100000:1.0:1789130287.645170:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 487 00010000:00010000:1.0:1789130287.658836:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658857:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658865:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658872:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130287.658877:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658911:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658932:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b4909bd900) 00010000:00010000:1.0:1789130287.658935:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130287.658941:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.658949:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea976 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.664313:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130287.664330:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.664343:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ca00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130287.664347:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.664359:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.664377:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789130287.664380:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130287.664384:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.664391:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47cea984 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.664724:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130287.664731:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130287.664733:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130287.711321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.711467:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040384 00000100:00100000:1.0:1789130287.711481:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040384 00000100:00100000:1.0:1789130287.711559:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 488 00000100:00100000:1.0:1789130287.711572:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+74:40189:x1876037605040384:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130287.711651:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130287.711685:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac26e expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.711792:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.711811:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.711846:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130287.711940:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130287.711977:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130287.712016:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.712048:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac26e expref: 76 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.712071:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac26e expref: 75 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.712080:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130287.712084:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130287.712088:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c200, rc 0) 00000100:00100000:1.0:1789130287.712176:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+75:40189:x1876037605040384:12345-192.168.201.39@tcp:101:bash.0 Request processed in 607us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.712185:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 488 00000100:00100000:2.0:1789130287.723954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130287.724253:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040640 00000100:00100000:0.0:1789130287.724267:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040640 00000100:00100000:0.0:1789130287.724351:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 489 00000100:00100000:0.0:1789130287.724364:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:40189:x1876037605040640:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130287.724394:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130287.724398:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130287.724437:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47cea992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac26e expref: 75 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.725069:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:0.0:1789130287.725084:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130287.725573:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea999 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac275 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.725811:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.726383:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.726405:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.726431:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.726438:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.726807:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130287.727656:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xce:0x0], index 1: 0 00010000:00010000:2.0:1789130287.727901:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea9ae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.727917:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea9ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.727927:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea9ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728241:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728250:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728259:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728265:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130287.728271:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728281:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728295:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51100) 00010000:00010000:2.0:1789130287.728298:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130287.728304:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728316:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47cea9a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130287.728335:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ccab495a reply state 000000009de646a2 transno 30064771503 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130287.728346:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130287.728389:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cea999 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac275 expref: 77 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728413:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea9ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac275 expref: 76 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130287.728421:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130287.728423:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130287.728426:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130287.729176:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+77:40189:x1876037605040640:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4809us (5232us total) trans 30064771503 rc 0/0 00000100:00100000:2.0:1789130287.729188:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 489 00010000:00010000:0.0:1789130287.731435:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731469:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731477:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731485:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130287.731491:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731500:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731522:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b482b51700) 00010000:00010000:0.0:1789130287.731528:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130287.731534:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130287.731541:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cea9a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130287.732975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.733740:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040768 00000100:00100000:1.0:1789130287.733756:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040768 00000100:00100000:1.0:1789130287.733875:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:1.0:1789130287.733889:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605040768:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130287.733914:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130287.733950:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac27c expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130287.733993:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130287.734026:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=1450s v=(0 0) 00010000:00010000:1.0:1789130287.734033:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130287.734046:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 13 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.734096:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 13 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.734116:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ce00, rc 0) 00000100:00100000:1.0:1789130287.734218:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605040768:12345-192.168.201.39@tcp:101:bash.0 Request processed in 331us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.734227:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:2.0:1789130287.749048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.749734:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605040896 00000100:00100000:1.0:1789130287.749753:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605040896 00000100:00100000:1.0:1789130287.749869:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:1.0:1789130287.749883:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:40189:x1876037605040896:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130287.749910:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130287.749937:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac283 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.749983:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.749993:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130287.749998:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130287.750004:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 14 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.750051:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.750089:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130287.750106:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626847744:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130287.750231:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbe240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130287.754868:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626847744:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130287.754927:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 14 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.754950:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3da00, rc 0) 00000100:00100000:1.0:1789130287.755021:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:40189:x1876037605040896:12345-192.168.201.39@tcp:101:bash.0 Request processed in 5141us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.755030:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:2.0:1789130287.767183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130287.767358:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605041024 00000100:00100000:3.0:1789130287.767369:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605041024 00010000:00010000:3.0:1789130287.767413:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130287.767457:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:3.0:1789130287.767467:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605041024:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130287.767485:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130287.767510:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.767527:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.767580:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566ccae9/0x5c74554e47cea9bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac27c expref: 14 pid: 37658 timeout: 1550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.767598:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130287.767641:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130287.767650:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.767661:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130287.767704:0:38711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130287.767719:0:38711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382bbb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626847872:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130287.767806:0:38711:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130287.778420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130287.778672:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605041280 00000100:00100000:0.0:1789130287.778682:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605041280 00000100:00100000:0.0:1789130287.778741:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:0.0:1789130287.778751:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+76:40189:x1876037605041280:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789130287.779141:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+77:40189:x1876037605041280:12345-192.168.201.39@tcp:35:bash.0 Request processed in 389us (730us total) trans 30064771504 rc 0/0 00000100:00100000:0.0:1789130287.779149:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:3.0:1789130287.780393:0:38711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382bbb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626847872:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130287.780418:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130287.780474:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605041024:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 13008us (13302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130287.780484:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130287.843051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130287.843258:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605041408 00000100:00100000:1.0:1789130287.843269:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605041408 00000100:00100000:1.0:1789130287.843790:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 490 00000100:00100000:1.0:1789130287.843803:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+77:40192:x1876037605041408:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130287.843841:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130287.843877:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea9ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac28a expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.843954:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.843993:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.844005:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130287.844074:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130287.844078:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130287.844119:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.844143:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47cea9ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac28a expref: 79 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.844162:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac28a expref: 78 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130287.844171:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130287.844175:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130287.844178:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c600, rc 0) 00000100:00100000:1.0:1789130287.844249:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+78:40192:x1876037605041408:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 449us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130287.844257:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 490 00000100:00100000:0.0:1789130288.104797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130288.105047:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605041664 00000100:00100000:3.0:1789130288.105058:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605041664 00000100:00100000:3.0:1789130288.105155:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 491 00000100:00100000:3.0:1789130288.105184:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+78:40214:x1876037605041664:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130288.105207:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130288.105229:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac291 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.105350:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea9df lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.105365:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea9df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.105378:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea9df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130288.105392:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:3.0:1789130288.105526:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47cea9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac291 expref: 81 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.105952:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea9df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac291 expref: 80 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.105963:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130288.105967:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130288.105971:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34800, rc 0) 00000100:00100000:3.0:1789130288.106664:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48904b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+80:40214:x1876037605041664:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1468us (1865us total) trans 30064771505 rc 0/0 00000100:00100000:3.0:1789130288.106676:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 491 00000100:00080000:2.0:1789130288.107051:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130288.123770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130288.123886:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605041920 00000100:00100000:2.0:1789130288.123896:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605041920 00000100:00100000:2.0:1789130288.123957:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 492 00000100:00100000:2.0:1789130288.123968:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+80:40214:x1876037605041920:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130288.123993:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130288.124014:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea9ed lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac298 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.124128:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea9f4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.124143:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea9f4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.124155:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea9f4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130288.124168:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:2.0:1789130288.124300:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cea9ed lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac298 expref: 83 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.124322:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea9f4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac298 expref: 82 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.124516:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130288.124520:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130288.124523:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1c00, rc 0) 00000100:00100000:2.0:1789130288.124593:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382bbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+82:40214:x1876037605041920:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 626us (846us total) trans 30064771506 rc 0/0 00000100:00100000:2.0:1789130288.124657:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 492 00000100:00100000:1.0:1789130288.125774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130288.126531:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605042048 00000100:00100000:3.0:1789130288.126559:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605042048 00000100:00100000:3.0:1789130288.126650:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789130288.126660:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+82:2370:x1876037605042048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130288.126674:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130288.126699:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cea9df lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac291 expref: 82 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.126716:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130288.126722:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130288.126780:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+81:2370:x1876037605042048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 121us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130288.126788:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130288.137277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130288.138186:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605042176 00000100:00100000:2.0:1789130288.138197:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605042176 00000100:00100000:2.0:1789130288.138266:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1789130288.138275:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+81:40214:x1876037605042176:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1789130288.138292:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130288.138332:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cea9f4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac298 expref: 81 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130288.138356:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130288.138361:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130288.138429:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+80:40214:x1876037605042176:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 155us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130288.138438:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130288.140754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130288.140841:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605042432 00000100:00100000:2.0:1789130288.140856:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605042432 00000100:00100000:2.0:1789130288.140929:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:2.0:1789130288.140939:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+80:40214:x1876037605042432:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130288.141214:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+81:40214:x1876037605042432:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 274us (474us total) trans 30064771507 rc 0/0 00000100:00100000:2.0:1789130288.141222:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1789130288.145748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130288.145909:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605042688 00000100:00100000:2.0:1789130288.145919:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605042688 00000100:00100000:2.0:1789130288.145969:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789130288.145979:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+81:40214:x1876037605042688:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130288.146214:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+82:40214:x1876037605042688:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 236us (476us total) trans 30064771508 rc 0/0 00000100:00100000:2.0:1789130288.146222:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:1.0:1789130288.167392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130288.167624:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605042944 00000100:00100000:3.0:1789130288.167634:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605042944 00000100:00100000:3.0:1789130288.167700:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 493 00000100:00100000:3.0:1789130288.167711:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+82:40216:x1876037605042944:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130288.167768:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130288.167797:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cea9ae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac275 expref: 82 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167828:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130288.167848:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47cea9d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac28a expref: 81 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167859:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:3.0:1789130288.167875:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130288.167899:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167928:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167938:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167951:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167959:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.167966:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.168190:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.168200:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.168208:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130288.170694:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].18, 64 off9560 00000004:00080000:3.0:1789130288.170711:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1451268107695ns, next at 1452268103851ns, rc = 0 00010000:00010000:3.0:1789130288.170793:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.170819:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.170854:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171295:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171314:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171327:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171354:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130288.171381:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171388:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171395:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171401:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130288.171406:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171414:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171426:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b496419900) 00010000:00010000:3.0:1789130288.171429:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130288.171441:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171449:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa10 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171471:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171477:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171483:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171488:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130288.171492:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171498:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171505:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419700) 00010000:00010000:3.0:1789130288.171508:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130288.171511:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130288.171517:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130288.171532:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d1711d1 reply state 00000000a222339b transno 30064771509 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130288.171553:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130288.171676:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+82:40216:x1876037605042944:12345-192.168.201.39@tcp:36:rm.0 Request processed in 3963us (4290us total) trans 30064771509 rc 0/0 00000100:00100000:3.0:1789130288.171687:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 493 00010000:00010000:0.0:1789130288.172172:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130288.172180:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130288.172187:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130288.172190:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130288.172198:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130288.172209:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff90b496419900) 00010000:00010000:0.0:1789130288.172211:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130288.172215:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130288.172220:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaa17 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130288.172235:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130288.172237:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130288.172239:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130288.177066:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177112:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177120:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177125:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130288.177130:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177139:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177155:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff90b496419600) 00010000:00010000:1.0:1789130288.177158:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130288.177162:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130288.177168:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceaa09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130288.390889:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848384:0@lo:400:kworker.0 00000100:00100000:3.0:1789130288.390972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130288.391026:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789130288.391031:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848256:0@lo:400:kworker.0 00000100:00100000:3.0:1789130288.391047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130288.391056:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626848768:0@lo:400:kworker.0 00000100:00100000:3.0:1789130288.391081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130288.391110:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848768 00000100:00100000:3.0:1789130288.391115:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848768 00000100:00100000:3.0:1789130288.391156:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789130288.391162:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626848768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130288.391208:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626848768:12345-0@lo:400:kworker.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130288.391213:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789130288.391244:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626848768:0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.391857:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848384 00000100:00100000:1.0:1789130288.391863:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848384 00000100:00100000:1.0:1789130288.391906:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848256 00000100:00100000:1.0:1789130288.391909:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848256 00000100:00100000:1.0:1789130288.391937:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789130288.391945:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626848384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.391990:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626848384:12345-0@lo:400:kworker.0 Request processed in 48us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130288.391995:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789130288.392022:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789130288.392026:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626848256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.392047:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626848256:12345-0@lo:400:kworker.0 Request processed in 22us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130288.392051:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789130288.392152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848256:0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.392162:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848384:0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392290:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626848128:0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130288.392359:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626848640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130288.392405:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789130288.392410:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626848000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130288.392433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130288.392450:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626848512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392471:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130288.392493:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848000 00000100:00100000:0.0:1789130288.392496:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848000 00000100:00100000:0.0:1789130288.392517:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130288.392530:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626848000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130288.392554:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 1703936 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130288.392579:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626848000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130288.392591:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130288.392628:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848640 00000100:00100000:0.0:1789130288.392631:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848640 00000100:00100000:0.0:1789130288.392648:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848512 00000100:00100000:0.0:1789130288.392649:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848512 00000100:00100000:0.0:1789130288.392662:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789130288.392666:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626848640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392687:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626848640:12345-0@lo:400:kworker.0 Request processed in 21us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130288.392690:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789130288.392697:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789130288.392700:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626848512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392716:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626848512:12345-0@lo:400:kworker.0 Request processed in 16us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130288.392720:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789130288.392740:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626848000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130288.392746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626848512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130288.392751:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626848640:0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.393175:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848128 00000100:00100000:1.0:1789130288.393179:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848128 00000100:00100000:1.0:1789130288.393303:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789130288.393310:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626848128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130288.393501:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626848128:12345-0@lo:400:kworker.0 Request processed in 192us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130288.393506:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1789130288.393689:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130288.393693:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130288.393695:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130288.398446:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626848128:0@lo:400:kworker.0 00010000:00010000:2.0:1789130288.581877:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130289.416039:0:36610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1452513432345ns, next at 1453513428963ns, rc = 0 00000100:00100000:1.0:1789130289.416114:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130289.416229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130289.416429:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626848896 00000100:00100000:2.0:1789130289.416439:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626848896 00000100:00100000:2.0:1789130289.416507:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130289.416519:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626848896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130289.416569:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130289.416784:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3832221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626848896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 266us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130289.416802:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789130289.421420:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626848896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130289.615539:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130289.690420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130289.690478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130289.690515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130289.690534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130289.690577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130289.690647:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043328 00000100:00100000:3.0:1789130289.690658:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043328 00000100:00100000:3.0:1789130289.690729:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043456 00000100:00100000:3.0:1789130289.690733:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043456 00000100:00100000:3.0:1789130289.690770:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1789130289.690793:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605043328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130289.690891:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605043328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 110us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130289.690901:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130289.690928:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043072 00000100:00100000:3.0:1789130289.690939:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1789130289.690945:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043072 00000100:00100000:3.0:1789130289.690952:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605043456:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130289.690994:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605043456:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130289.691003:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1789130289.691022:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789130289.691037:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605043072:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130289.691104:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605043072:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130289.691123:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:3.0:1789130289.691194:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043584 00000100:00100000:3.0:1789130289.691295:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043584 00000100:00100000:3.0:1789130289.691343:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043200 00000100:00100000:3.0:1789130289.691346:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043200 00000100:00100000:3.0:1789130289.691437:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789130289.691448:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605043584:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130289.691495:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605043584:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130289.691506:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789130289.691526:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:3.0:1789130289.691535:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+81:2369:x1876037605043200:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130289.691595:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+81:2369:x1876037605043200:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 62us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130289.691624:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00080000:3.0:1789130289.691650:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130289.691654:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130289.691656:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789130290.625361:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771504 is committed 00000004:00080000:1.0:1789130290.625395:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000020:00080000:1.0:1789130290.625421:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b381a8a180 refcount 2 committed 0 result 0 batchid 25769803911 00000020:00080000:1.0:1789130290.625426:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b381a8ad80 00000020:00080000:1.0:1789130290.625429:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4c197b400 00000004:00080000:1.0:1789130290.625461:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000004:00080000:1.0:1789130290.625484:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000001:00080000:1.0:1789130290.625490:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771508 is committed 00000001:00080000:1.0:1789130290.625520:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771509 is committed 00000004:00080000:1.0:1789130290.625524:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000100:00100000:2.0:1789130290.626044:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626849024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130290.626125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130290.626197:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130290.626203:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626849152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130290.626225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130290.626259:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849024 00000100:00100000:2.0:1789130290.626266:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849024 00000100:00100000:2.0:1789130290.626316:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849152 00000100:00100000:2.0:1789130290.626320:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849152 00000100:00100000:2.0:1789130290.626340:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789130290.626348:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626849024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789130290.626372:0:37276:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:205 count 1 00002000:00010000:2.0:1789130290.626405:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 5, mtime: 0x6aa3f62d, atime: 0x6aa3f62d, ctime: 0x6aa3f62d, blocks: 0x1 00010000:00010000:2.0:1789130290.626414:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.626438:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=1453s v=(0 0) 00010000:00010000:2.0:1789130290.626443:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130290.626450:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.626466:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.626477:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.626485:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.626515:0:37276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130290.627470:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1876037626849024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1119us (1341us total) trans 30064771213 rc 0/0 00000100:00100000:2.0:1789130290.627481:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000020:00080000:3.0:1789130290.627777:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803911 committed batchid 25769803910 00000020:00080000:3.0:1789130290.627917:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000100:00100000:2.0:1789130290.628078:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789130290.628841:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130290.628864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626849280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789130290.628936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130290.628999:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849280 00000100:00100000:1.0:1789130290.629006:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849280 00000100:00100000:1.0:1789130290.629071:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789130290.629089:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626849280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789130290.629127:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:205 count 1 00010000:00010000:1.0:1789130290.629173:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.629226:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.629236:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcd:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1789130290.629240:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130290.629255:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.629295:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.629320:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 13 pid: 37276 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130290.629350:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839b5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626849408:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130290.629453:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130290.630339:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626849152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789130290.630369:0:37276:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:206 count 1 00010000:00010000:2.0:1789130290.630391:0:37276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.630407:0:37276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.630415:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xce:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789130290.630419:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130290.630422:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.630448:0:37276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.630459:0:37276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 12 pid: 38727 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130290.630472:0:37276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:37276:1876037626849536:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130290.631122:0:37276:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d900 going to sleep for 11 seconds 00000100:00080000:2.0:1789130290.631559:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130290.631566:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789130290.631586:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130290.631594:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.631812:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130290.631817:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.631829:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.631859:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.631868:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47ceaa1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.631893:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130290.631896:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130290.631897:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130290.631947:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b497af2580/2, rc 0, transno 30064771213 00000100:00100000:2.0:1789130290.631956:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626849024:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789130290.632043:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130290.634124:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626849408:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130290.634162:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130290.634304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130290.634825:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043712 00000100:00100000:2.0:1789130290.634833:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043712 00010000:00010000:2.0:1789130290.634877:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130290.634908:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130290.634917:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+14:2367:x1876037605043712:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130290.634933:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130290.634940:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.634953:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.634975:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065c4ff60/0x5c74554e47cea930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac252 expref: 14 pid: 37276 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.634991:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130290.634995:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130290.635023:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.635034:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.635061:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130290.635109:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605043712:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130290.635117:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00010000:00010000:2.0:1789130290.635141:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.635569:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.635580:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.635589:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.637848:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130290.637863:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.637876:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130290.637881:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.637893:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.637917:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.637929:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130290.637931:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130290.637933:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130290.638287:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130290.638297:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65291cd/0x5c74554e47ceaa25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130290.645421:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626849280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12983us (13125us total) trans 30064771280 rc 0/0 00000100:00100000:2.0:1789130290.645445:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000004:00080000:3.0:1789130290.645453:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3839b4780/2, rc 0, transno 30064771280 00000100:00100000:3.0:1789130290.645472:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626849280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130290.645751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130290.645907:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043840 00000100:00100000:1.0:1789130290.645919:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043840 00010000:00010000:1.0:1789130290.645967:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130290.646015:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789130290.646026:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605043840:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130290.646043:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130290.646049:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.646063:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 13 pid: 38727 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.646090:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130290.646095:0:36574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130290.646101:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.646111:0:36574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.646132:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130290.646188:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605043840:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 164us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130290.646195:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00010000:00010000:2.0:1789130290.646645:0:37276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47cea9c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac283 expref: 12 pid: 38727 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130290.646664:0:37276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:37276:1876037626849536:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130290.646687:0:37276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.646699:0:37276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.646707:0:37276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.646820:0:37276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.646831:0:37276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130290.646846:0:37276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130290.647461:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1876037626849152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19373us (21233us total) trans 30064771214 rc 0/0 00000100:00100000:2.0:1789130290.647470:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000004:00080000:2.0:1789130290.647532:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4bd9a43c0/2, rc 0, transno 30064771214 00000100:00100000:2.0:1789130290.647539:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626849152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789130290.648407:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130290.648420:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.648432:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130290.648438:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.648451:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.648475:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.648483:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd15b732/0x5c74554e47ceaa2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130290.648520:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130290.648523:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130290.648525:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130291.048197:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771211 is committed 00000001:00080000:1.0:1789130291.048220:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771214 is committed 00010000:00010000:0.0:1789130291.655946:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130292.678699:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130293.077324:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771280 is committed 00000100:00100000:1.0:1789130293.510165:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626849664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130293.510263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.510468:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849664 00000100:00100000:0.0:1789130293.510478:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849664 00000100:00100000:0.0:1789130293.510557:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130293.510567:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626849664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130293.510631:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130293.510688:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626849664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.510695:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130293.510751:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771214 gen 2 00000004:00080000:0.0:1789130293.510757:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771212 committed transno 30064771214 00000004:00080000:0.0:1789130293.510782:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b497af2580, transno 30064771213 00000004:00080000:0.0:1789130293.510793:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4bd9a43c0, transno 30064771214 00000100:00100000:0.0:1789130293.510804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626849664:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789130293.511315:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130293.516685:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626849920:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.516773:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.516822:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789130293.516828:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626849792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.516856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.516874:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626850304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.516898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.516923:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626850048:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.516944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.516962:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130293.516966:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626850176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.516986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130293.517015:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849920 00000100:00100000:0.0:1789130293.517023:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849920 00000100:00100000:0.0:1789130293.517088:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789130293.517098:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626849920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517152:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626849920:12345-0@lo:400:kworker.0 Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.517160:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789130293.517182:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626849792 00000100:00100000:0.0:1789130293.517186:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626849792 00000100:00100000:0.0:1789130293.517224:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789130293.517231:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626849792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517260:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626849792:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.517266:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789130293.517290:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850304 00000100:00100000:0.0:1789130293.517294:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850304 00000100:00100000:0.0:1789130293.517318:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850048 00000100:00100000:0.0:1789130293.517321:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850048 00000100:00100000:0.0:1789130293.517337:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850176 00000100:00100000:0.0:1789130293.517340:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850176 00000100:00100000:0.0:1789130293.517353:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789130293.517358:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626850304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517389:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626850304:12345-0@lo:400:kworker.0 Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.517395:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789130293.517405:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789130293.517410:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517441:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626850048:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.517447:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789130293.517458:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789130293.517464:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626850176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517491:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626850176:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.517497:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1789130293.517534:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130293.517539:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130293.517568:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bd9a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626850176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517578:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626850048:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517631:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626849792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517641:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626850304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130293.517650:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771280 gen 2 00000004:00080000:0.0:1789130293.517656:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3839b4780, transno 30064771280 00000100:00100000:0.0:1789130293.517667:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626849920:0@lo:400:kworker.0 00010000:00010000:3.0:1789130293.701969:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130293.861580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130293.861872:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605043968 00000100:00100000:0.0:1789130293.861885:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605043968 00000100:00100000:0.0:1789130293.861969:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 494 00000100:00100000:0.0:1789130293.861981:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+47:40640:x1876037605043968:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:0.0:1789130293.862003:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130293.862033:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac29f expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862106:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862125:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862136:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130293.862351:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130293.862356:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130293.862438:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862463:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac29f expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862481:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac29f expref: 48 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130293.862488:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130293.862491:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130293.862495:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00080000:1.0:1789130293.862689:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130293.862858:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+48:40640:x1876037605043968:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 878us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.862867:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 494 00000100:00100000:1.0:1789130293.960394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130293.960478:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044096 00000100:00100000:0.0:1789130293.960498:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044096 00000100:00100000:0.0:1789130293.960564:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 495 00000100:00100000:0.0:1789130293.960576:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:40073:x1876037605044096:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130293.960746:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:40073:x1876037605044096:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 171us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130293.960754:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 495 00000100:00100000:2.0:1789130293.963940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130293.964303:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044352 00000100:00100000:0.0:1789130293.964314:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044352 00000100:00100000:0.0:1789130293.964378:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789130293.964388:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+48:40073:x1876037605044352:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130293.966233:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:40073:x1876037605044352:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1836us (2297us total) trans 30064771510 rc 0/0 00000100:00100000:0.0:1789130293.966248:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:1.0:1789130294.208781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130294.209031:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044480 00000100:00100000:0.0:1789130294.209047:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044480 00000100:00100000:0.0:1789130294.209149:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 496 00000100:00100000:0.0:1789130294.209162:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:40657:x1876037605044480:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130294.209192:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130294.209231:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2a6 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209321:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209340:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209357:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130294.209663:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130294.209667:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130294.209771:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209806:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 7 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209829:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 6 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130294.209838:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130294.209842:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130294.209846:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:0.0:1789130294.209936:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:40657:x1876037605044480:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 777us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130294.209944:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 496 00000100:00080000:1.0:1789130294.210164:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130294.538884:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4be5f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626850432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130294.539770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130294.543283:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850432 00000100:00100000:2.0:1789130294.543301:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850432 00000100:00100000:2.0:1789130294.543444:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789130294.543456:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626850432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130294.543511:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130294.543652:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626850432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130294.543659:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789130294.543798:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4be5f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626850432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130294.726403:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130294.819545:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130294.819591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130294.819682:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044608 00000100:00100000:3.0:1789130294.819702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130294.819702:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044608 00000100:00100000:3.0:1789130294.819746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130294.819770:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:0.0:1789130294.819786:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b571fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605044608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130294.819789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130294.819830:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605045120 00000100:00100000:3.0:1789130294.819835:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605045120 00000100:00100000:0.0:1789130294.819869:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b571fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605044608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130294.819879:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044736 00000100:00100000:0.0:1789130294.819881:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789130294.819884:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044736 00000100:00100000:3.0:1789130294.819911:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789130294.819920:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605045120:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130294.819950:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:3.0:1789130294.819955:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605045120:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130294.819963:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:2369:x1876037605044736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130294.819980:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:0.0:1789130294.820000:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+49:2369:x1876037605044736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130294.820008:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:1.0:1789130294.820098:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044864 00000100:00100000:1.0:1789130294.820103:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044864 00000100:00100000:1.0:1789130294.820155:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605044992 00000100:00100000:1.0:1789130294.820159:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605044992 00000100:00100000:1.0:1789130294.820184:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:1.0:1789130294.820193:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605044864:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130294.820223:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605044864:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130294.820230:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:1.0:1789130294.820244:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:1.0:1789130294.820250:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605044992:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130294.820281:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605044992:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130294.820287:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00080000:0.0:1789130294.820555:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130294.820560:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789130295.620566:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771510 is committed 00000020:00080000:2.0:1789130295.620594:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803911 batchid updated 00000020:00080000:3.0:1789130295.620645:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803911 00000020:00080000:3.0:1789130295.620655:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803911 00010000:00010000:3.0:1789130295.749850:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130296.198039:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130296.198050:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130296.198835:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789130296.198847:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130296.773827:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130297.797820:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130298.485538:0:41191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 08:38:16 (1789130296) 00000100:00100000:1.0:1789130298.635092:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626850944:0@lo:400:kworker.0 00000100:00100000:1.0:1789130298.635174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130298.635237:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130298.635244:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c1965a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626850816:0@lo:400:kworker.0 00000100:00100000:1.0:1789130298.635297:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130298.635336:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850816 00000100:00100000:1.0:1789130298.635344:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850816 00000100:00100000:1.0:1789130298.635401:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789130298.635412:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626850816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130298.635465:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626850816:12345-0@lo:400:kworker.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130298.635482:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1789130298.635502:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130298.635550:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c1965a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789130298.635891:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130298.635940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130298.635983:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850944 00000100:00100000:3.0:1789130298.635987:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850944 00000100:00100000:3.0:1789130298.636022:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789130298.636029:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130298.636063:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626850944:12345-0@lo:400:kworker.0 Request processed in 35us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.636070:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789130298.636090:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626851328 00000100:00100000:3.0:1789130298.636094:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626851328 00000100:00100000:3.0:1789130298.636118:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130298.636124:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626851328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130298.636154:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130298.636188:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626851328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.636195:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130298.636241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130298.636314:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626850944:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.636413:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626850560:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.636452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130298.636478:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626851072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.636502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130298.636519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789130298.636525:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626850688:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.636818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130298.636848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626851200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.636873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130298.636941:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850688 00000100:00100000:1.0:1789130298.636946:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850688 00000100:00100000:1.0:1789130298.636996:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789130298.637005:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626850688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130298.637044:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626850688:12345-0@lo:400:kworker.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130298.637050:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789130298.637182:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626850560 00000100:00100000:3.0:1789130298.637186:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626850560 00000100:00100000:3.0:1789130298.637226:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789130298.637233:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626850560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130298.637268:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626850560:12345-0@lo:400:kworker.0 Request processed in 35us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.637274:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789130298.637300:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626851072 00000100:00100000:3.0:1789130298.637304:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626851072 00000100:00100000:3.0:1789130298.637327:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626851200 00000100:00100000:3.0:1789130298.637330:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626851200 00000100:00100000:3.0:1789130298.637347:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789130298.637353:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626851072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130298.637383:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626851072:12345-0@lo:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.637389:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789130298.637402:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789130298.637408:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626851200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130298.637432:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626851200:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.637437:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789130298.637555:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626850688:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.637567:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626851200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.637779:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626850560:0@lo:400:kworker.0 00000100:00100000:0.0:1789130298.637791:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626851072:0@lo:400:kworker.0 00000100:00080000:0.0:1789130298.637822:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130298.637827:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130298.821764:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130298.830702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130298.831638:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605045376 00000100:00100000:0.0:1789130298.831649:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605045376 00000100:00100000:0.0:1789130298.831713:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 497 00000100:00100000:0.0:1789130298.831723:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+48:40853:x1876037605045376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130298.831747:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130298.831774:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2ad expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831860:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831876:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831887:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831903:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831911:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.831918:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130298.832377:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130298.832706:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaa64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832719:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaa64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832729:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaa64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130298.832742:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130298.832934:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832946:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832953:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832958:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130298.832963:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832970:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832984:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130298.832987:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130298.832992:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.832999:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceaa56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833012:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833018:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833024:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833029:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130298.833033:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833040:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833047:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b497c01d00) 00010000:00010000:0.0:1789130298.833049:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130298.833052:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.833058:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaa5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.840136:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaa4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ad expref: 51 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.842829:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaa64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ad expref: 50 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.842848:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130298.842850:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130298.842855:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031e00, rc 0) 00000100:00100000:0.0:1789130298.842938:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+50:40853:x1876037605045376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 11215us (12243us total) trans 30064771511 rc 0/0 00000100:00100000:0.0:1789130298.842949:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 497 00000100:00100000:1.0:1789130298.852947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130298.852991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130298.853282:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605045632 00000100:00100000:2.0:1789130298.853295:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605045632 00000100:00100000:2.0:1789130298.853360:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789130298.853372:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+50:2370:x1876037605045632:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130298.853389:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130298.853418:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaa64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ad expref: 50 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.853438:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130298.853443:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130298.853508:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:2370:x1876037605045632:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 138us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130298.853515:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1789130298.854152:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605045504 00000100:00100000:3.0:1789130298.854159:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605045504 00000100:00100000:3.0:1789130298.854268:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 498 00000100:00100000:3.0:1789130298.854276:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+49:40853:x1876037605045504:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130298.854346:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+49:40853:x1876037605045504:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 70us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.854354:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 498 00000100:00100000:2.0:1789130298.915151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130298.915316:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605045888 00000100:00100000:3.0:1789130298.915333:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605045888 00000100:00100000:3.0:1789130298.915441:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 499 00000100:00100000:3.0:1789130298.915454:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:40686:x1876037605045888:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130298.915485:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130298.915489:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789130298.915534:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaa3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac29f expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.915561:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130298.915578:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130298.915598:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2b4 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.916714:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.916738:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.916748:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.916933:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 5 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.916955:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 5 pid: 36587 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130298.916973:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626851456:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130298.917181:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130298.921161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130298.921524:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626851456:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130298.921526:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046016 00000100:00100000:2.0:1789130298.921544:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046016 00010000:00010000:3.0:1789130298.921585:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921701:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 6 pid: 36587 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130298.921756:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130298.921770:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:2369:x1876037605046016:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130298.921787:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130298.921799:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 6 pid: 36587 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921814:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 6 pid: 36587 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921841:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaa48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2a6 expref: 6 pid: 36587 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921867:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130298.921874:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921886:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921895:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130298.921931:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130298.922003:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605046016:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 236us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130298.922011:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00010000:00010000:1.0:1789130298.922063:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.922074:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.922116:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.922140:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.922150:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130298.922247:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789130298.923398:0:36588:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xce:0x0], index 0: 0 00010000:00010000:1.0:1789130298.923758:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923778:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923789:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923836:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923845:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923853:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923859:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130298.923864:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923872:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923885:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130298.923888:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130298.923894:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923901:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceaa79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130298.923915:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fcbfd9ed reply state 0000000045d52470 transno 30064771512 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130298.923927:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130298.923973:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceaa72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 51 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.923997:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 50 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.924004:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:1.0:1789130298.924006:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130298.924009:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130298.924095:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:40686:x1876037605045888:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8643us (8953us total) trans 30064771512 rc 0/0 00000100:00100000:1.0:1789130298.924105:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 499 00000100:00100000:0.0:1789130298.927148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130298.928143:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046144 00000100:00100000:3.0:1789130298.928162:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046144 00000100:00100000:3.0:1789130298.928258:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:3.0:1789130298.928269:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:40686:x1876037605046144:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130298.928288:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130298.928325:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2bb expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130298.928354:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130298.928379:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=1462s v=(0 0) 00010000:00010000:3.0:1789130298.928384:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130298.928394:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.928449:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130298.928661:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34e00, rc 0) 00000100:00100000:3.0:1789130298.928737:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:40686:x1876037605046144:12345-192.168.201.39@tcp:101:bash.0 Request processed in 469us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130298.928745:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00080000:0.0:1789130298.929452:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130298.932204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130298.932405:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046400 00000100:00100000:3.0:1789130298.932422:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046400 00000100:00100000:3.0:1789130298.932513:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:3.0:1789130298.932526:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:40686:x1876037605046400:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789130298.933133:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:40686:x1876037605046400:12345-192.168.201.39@tcp:35:bash.0 Request processed in 607us (938us total) trans 30064771513 rc 0/0 00000100:00100000:3.0:1789130298.933142:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00010000:00010000:1.0:1789130298.934109:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934130:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934139:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934145:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3de00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130298.934150:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934159:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934184:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff90b491c57500) 00010000:00010000:1.0:1789130298.934188:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130298.934194:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130298.934201:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceaa80 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130298.971586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130298.971750:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046528 00000100:00100000:0.0:1789130298.971762:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046528 00000100:00100000:0.0:1789130298.971843:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 500 00000100:00100000:0.0:1789130298.971853:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:40864:x1876037605046528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130298.971882:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130298.971907:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceaa9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2c2 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.971981:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.971996:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.972008:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130298.972071:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130298.972076:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130298.972103:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.972128:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceaa9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c2 expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.972148:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c2 expref: 52 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130298.972157:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130298.972160:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130298.972164:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:0.0:1789130298.972238:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:40864:x1876037605046528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 386us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130298.972246:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 500 00000100:00100000:2.0:1789130299.167938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.168043:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046784 00000100:00100000:3.0:1789130299.168056:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046784 00000100:00100000:3.0:1789130299.168135:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 501 00000100:00100000:3.0:1789130299.168147:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+52:40880:x1876037605046784:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130299.168177:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130299.168204:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaaaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2c9 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.168342:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceaab1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.168377:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceaab1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.168390:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceaab1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130299.168405:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1789130299.168554:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaaaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c9 expref: 55 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.169184:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceaab1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c9 expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.169196:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:3.0:1789130299.169199:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130299.169203:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35400, rc 0) 00000100:00100000:3.0:1789130299.169360:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:40880:x1876037605046784:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1214us (1434us total) trans 30064771514 rc 0/0 00000100:00100000:3.0:1789130299.169372:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 501 00000100:00100000:1.0:1789130299.178897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.178964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.179075:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605046912 00000100:00100000:2.0:1789130299.179090:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605046912 00000100:00100000:2.0:1789130299.179193:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130299.179206:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:2368:x1876037605046912:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130299.179228:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130299.179275:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceaab1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c9 expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.179300:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:2.0:1789130299.179307:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130299.179381:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+53:2368:x1876037605046912:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 177us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130299.179396:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130299.182391:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047168 00000100:00100000:3.0:1789130299.182415:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047168 00000100:00100000:2.0:1789130299.183019:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 502 00000100:00100000:2.0:1789130299.183036:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+53:40880:x1876037605047168:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130299.183071:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130299.183102:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaabf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2d0 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.183237:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.183268:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.183281:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130299.183299:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789130299.183474:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaabf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d0 expref: 56 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.183495:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d0 expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.183505:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:2.0:1789130299.183507:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130299.183511:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1400, rc 0) 00000100:00100000:2.0:1789130299.185415:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c1965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:40880:x1876037605047168:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2370us (6435us total) trans 30064771515 rc 0/0 00000100:00100000:2.0:1789130299.187462:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 502 00000100:00100000:2.0:1789130299.213825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.213932:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047296 00000100:00100000:1.0:1789130299.213949:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047296 00000100:00100000:1.0:1789130299.214043:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:1.0:1789130299.214056:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605047296:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789130299.214123:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.214149:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.214160:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130299.214165:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130299.214170:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.214220:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.214253:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 14 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130299.214273:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626851584:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130299.214401:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130299.218103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.219174:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047424 00000100:00100000:3.0:1789130299.219191:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047424 00002000:00100000:3.0:1789130299.219272:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xce:0x0] (0->23) req@ffff90b382e42580 x1876037605047424/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:15/0 lens 512/0 e 0 to 0 dl 1789130310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130299.219286:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e42580 with x1876037605047424 ext(0->23) 00010000:00010000:3.0:1789130299.219298:0:39571:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 15 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.219334:0:39571:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 15 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130299.219344:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b382e42580 00000100:00100000:3.0:1789130299.219383:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789130299.219394:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605047424:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:3.0:1789130299.221215:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037605047424:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 1810us (3114us total) trans 30064771281 rc 0/0 00000100:00100000:3.0:1789130299.221230:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:3.0:1789130299.221240:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xce:0x0] (0->23) req@ffff90b382e42580 x1876037605047424/t30064771281(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:15/0 lens 512/448 e 0 to 0 dl 1789130310 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130299.221252:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b382e42580 with x1876037605047424 ext(0->23) 00010000:00010000:3.0:1789130299.221263:0:39571:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.221284:0:39571:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130299.221292:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b382e42580 00000100:00100000:2.0:1789130299.222944:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:37273:1876037626851584:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130299.222988:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130299.226191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.226309:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047552 00000100:00100000:2.0:1789130299.226329:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047552 00010000:00010000:2.0:1789130299.226398:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130299.226466:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789130299.226479:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+17:2369:x1876037605047552:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130299.226501:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789130299.226530:0:38711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xce:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:2.0:1789130299.226533:0:38711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xce:0x0] updating lvb mtime from disk: 0 -> 1789130298 00002000:00010000:2.0:1789130299.226536:0:38711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xce:0x0] updating lvb atime from disk: 0 -> 1789130298 00002000:00010000:2.0:1789130299.226538:0:38711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xce:0x0] updating lvb ctime from disk: 0 -> 1789130298 00010000:00010000:2.0:1789130299.226544:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.226788:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.226826:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceaa95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2bb expref: 17 pid: 37276 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.226850:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130299.226856:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130299.226862:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.226874:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.226907:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130299.226984:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+16:2369:x1876037605047552:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 507us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130299.226993:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00010000:00010000:0.0:1789130299.230251:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230273:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230311:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230320:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230329:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230337:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130299.230342:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230351:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230378:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.230387:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b5a5a60/0x5c74554e47ceaad4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130299.230503:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605047296:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 16443us (16686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130299.230514:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130299.236194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.236314:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047808 00000100:00100000:3.0:1789130299.236326:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047808 00000100:00100000:3.0:1789130299.236392:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130299.236404:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:40880:x1876037605047808:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:3.0:1789130299.236502:0:36591:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d0 expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130299.236840:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771516 00000001:00080000:3.0:1789130299.236888:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771517 00000001:00080000:3.0:1789130299.237429:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771518 00010000:00010000:3.0:1789130299.237485:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.237502:0:36591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 59 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.237511:0:36591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.237544:0:36591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 59 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.237562:0:36591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 59 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.237577:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626851712:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130299.237718:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130299.244157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.244679:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605047936 00000100:00100000:2.0:1789130299.244699:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605047936 00010000:00010000:2.0:1789130299.244765:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 60 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.244766:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:36591:1876037626851712:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130299.244814:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130299.244827:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+60:2370:x1876037605047936:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130299.244849:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130299.244858:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 60 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244874:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 60 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244908:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaa87 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2b4 expref: 60 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244928:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:2.0:1789130299.244933:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244944:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244952:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.244974:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130299.245064:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:2370:x1876037605047936:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 238us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130299.245073:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00010000:00010000:3.0:1789130299.246753:0:36591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.246783:0:36591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.246821:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130299.247062:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771519 00000001:00080000:3.0:1789130299.247341:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771520 00000100:00100000:3.0:1789130299.247491:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626851840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130299.247645:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130299.247702:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130299.247917:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626851840 00000100:00100000:1.0:1789130299.247932:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626851840 00000100:00100000:1.0:1789130299.248003:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130299.248014:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626851840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130299.248152:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626851840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130299.248160:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130299.248253:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626851840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130299.256381:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771521 00000100:00100000:1.0:1789130299.256532:0:36591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626851968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130299.256754:0:36591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130299.256802:0:36591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130299.256824:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626851968 00000100:00100000:2.0:1789130299.256834:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626851968 00000100:00100000:2.0:1789130299.256909:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130299.256920:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36591:x1876037626851968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130299.257174:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36591:x1876037626851968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 255us (421us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1789130299.257184:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789130299.257235:0:36591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e41680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:36591:1876037626851968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789130299.257325:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771522 00010000:00010000:3.0:1789130299.257380:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257394:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257403:0:36591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257410:0:36591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.257416:0:36591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257425:0:36591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257445:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:3.0:1789130299.257449:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789130299.257454:0:36591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.257475:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaadb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130299.258045:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130299.258184:0:36591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].18, 64 off9632 00000004:00080000:2.0:1789130299.258199:0:36591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1462355596676ns, next at 1463355594020ns, rc = 0 00000001:00080000:2.0:1789130299.258209:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771523 00010000:00010000:2.0:1789130299.258265:0:36591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b491c57a00) 00010000:00010000:2.0:1789130299.258269:0:36591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130299.258278:0:36591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceaac6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d0 expref: 63 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130299.258423:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:40880:x1876037605047808:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 22020us (22242us total) trans 30064771524 rc 0/0 00000100:00100000:2.0:1789130299.258433:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000020:00080000:2.0:1789130299.258438:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789130299.266703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130299.269136:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605048064 00000100:00100000:0.0:1789130299.269155:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605048064 00000100:00100000:0.0:1789130299.269234:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 503 00000100:00100000:0.0:1789130299.269245:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+62:40880:x1876037605048064:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130299.269269:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130299.269293:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaae2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2d7 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.269360:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaae2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d7 expref: 63 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.269375:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaae2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d7 expref: 63 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130299.269398:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130299.269401:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130299.269405:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:0.0:1789130299.269488:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+63:40880:x1876037605048064:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 244us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130299.269495:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 503 00000040:00080000:0.0:1789130299.271343:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130299.271354:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130299.273980:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789130299.274009:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130299.277192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130299.277515:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605048320 00000100:00100000:0.0:1789130299.277529:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605048320 00000100:00100000:0.0:1789130299.277709:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:0.0:1789130299.277722:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:40880:x1876037605048320:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130299.278018:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:40880:x1876037605048320:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 298us (838us total) trans 30064771525 rc 0/0 00000100:00100000:0.0:1789130299.278027:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1789130299.357681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.357862:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605048448 00000100:00100000:3.0:1789130299.357877:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605048448 00000100:00100000:3.0:1789130299.357960:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 504 00000100:00100000:3.0:1789130299.357979:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:40886:x1876037605048448:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130299.358011:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130299.358038:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2de expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358124:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358142:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358155:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358172:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358179:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358186:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358317:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358349:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358356:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130299.358404:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:3.0:1789130299.358409:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130299.358433:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358447:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358458:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358464:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358472:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358478:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.358483:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358491:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358505:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:3.0:1789130299.358515:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130299.358522:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358530:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaaf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358547:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358553:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358559:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358563:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.358566:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358573:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358582:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff90b496419c00) 00010000:00010000:3.0:1789130299.358584:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130299.358587:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358593:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceaaf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358697:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceaae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 66 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358725:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 65 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.358732:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.358735:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130299.358738:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35a00, rc 0) 00000100:00100000:3.0:1789130299.358820:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+65:40886:x1876037605048448:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 843us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.358830:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 504 00000100:00100000:1.0:1789130299.366529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.366712:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605048704 00000100:00100000:2.0:1789130299.366726:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605048704 00000100:00100000:2.0:1789130299.366802:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 505 00000100:00100000:2.0:1789130299.366816:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+65:40886:x1876037605048704:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130299.366846:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130299.366877:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceab05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2e5 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.367025:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.367045:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 66 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.367056:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.367106:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 66 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.367130:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 66 pid: 38734 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130299.367148:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626852096:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130299.367303:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130299.371864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.372044:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605048832 00000100:00100000:3.0:1789130299.372056:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605048832 00010000:00010000:3.0:1789130299.372113:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 67 pid: 38734 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.372166:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789130299.372178:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:2370:x1876037605048832:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130299.372199:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130299.372207:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 67 pid: 38734 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.372222:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 67 pid: 38734 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.372251:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.372257:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.372288:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.372297:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.372321:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130299.372388:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:2370:x1876037605048832:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 212us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.372395:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00010000:00010000:2.0:1789130299.373091:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceaafe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2de expref: 66 pid: 38734 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130299.373116:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626852096:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130299.373144:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.373155:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.373162:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130299.373190:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789130299.373425:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceab05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 67 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.373447:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.373457:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130299.373461:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130299.373465:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1c00, rc 0) 00000100:00100000:2.0:1789130299.373518:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+66:40886:x1876037605048704:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 6706us (7004us total) trans 30064771526 rc 0/0 00000100:00100000:2.0:1789130299.373527:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 505 00000100:00100000:1.0:1789130299.418504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.418673:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605049088 00000100:00100000:3.0:1789130299.418691:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605049088 00000100:00100000:3.0:1789130299.418827:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 506 00000100:00100000:3.0:1789130299.418839:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:40889:x1876037605049088:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130299.418876:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130299.418906:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2ec expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419005:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419022:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419035:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419052:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419083:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.419090:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423449:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceab2f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423481:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceab2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423497:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceab2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130299.423516:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1789130299.423703:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423712:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423720:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423727:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.423733:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423742:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423786:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:3.0:1789130299.423789:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130299.423795:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423803:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceab21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423821:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423828:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423833:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423838:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.423841:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423847:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423855:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff90b496419c00) 00010000:00010000:3.0:1789130299.423857:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130299.423860:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423865:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceab28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423944:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ec expref: 69 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423960:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceab2f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ec expref: 68 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.423968:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.423970:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130299.423973:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35000, rc 0) 00000100:00100000:3.0:1789130299.424084:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+68:40889:x1876037605049088:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5246us (5595us total) trans 30064771527 rc 0/0 00000100:00100000:3.0:1789130299.424095:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 506 00000100:00100000:1.0:1789130299.426970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.427078:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605049216 00000100:00100000:3.0:1789130299.427092:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605049216 00000100:00100000:3.0:1789130299.427175:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 507 00000100:00100000:3.0:1789130299.427187:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+68:40889:x1876037605049216:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789130299.427294:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.427316:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 68 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.427327:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.427378:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 68 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.427422:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 68 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.427442:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626852224:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130299.427572:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130299.435431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.435674:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605049472 00000100:00100000:2.0:1789130299.435688:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605049472 00000100:00100000:2.0:1789130299.435843:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130299.435855:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+69:31850:x1876037605049472:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130299.435999:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626852224:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130299.436030:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130299.436192:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+70:31850:x1876037605049472:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 338us (769us total) trans 30064771528 rc 0/0 00000100:00100000:2.0:1789130299.436200:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130299.443173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130299.448528:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605049600 00000100:00100000:0.0:1789130299.448546:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605049600 00010000:00010000:1.0:1789130299.448797:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 70 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130299.448863:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1789130299.448874:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+70:2370:x1876037605049600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130299.448890:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130299.448898:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 70 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.448913:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 70 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.448935:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceab0c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2e5 expref: 70 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.448963:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130299.448969:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.448979:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.448987:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.449026:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130299.449096:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+69:2370:x1876037605049600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 223us (5933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130299.449108:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00010000:00010000:3.0:1789130299.450531:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450545:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450589:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450596:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450637:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450644:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.450649:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450678:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450693:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.450696:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130299.450700:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.450706:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab3d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.450779:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+68:40889:x1876037605049216:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 23592us (23820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.450789:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 507 00000100:00100000:2.0:1789130299.453003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130299.453079:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605049856 00000100:00100000:0.0:1789130299.453088:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605049856 00000100:00100000:0.0:1789130299.453135:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:0.0:1789130299.453144:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+68:40889:x1876037605049856:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130299.461895:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:40889:x1876037605049856:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 8739us (8890us total) trans 30064771529 rc 0/0 00000100:00100000:1.0:1789130299.461922:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:0.0:1789130299.655051:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130299.655081:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b489048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626852352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130299.655175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130299.655403:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626852352 00000100:00100000:3.0:1789130299.655410:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626852352 00000100:00100000:3.0:1789130299.655480:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789130299.655490:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626852352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130299.655514:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130299.655573:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626852352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.655581:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130299.656594:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b489048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626852352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130299.665058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.667384:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605050112 00000100:00100000:2.0:1789130299.667403:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605050112 00000100:00100000:2.0:1789130299.667497:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 508 00000100:00100000:2.0:1789130299.667510:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+69:40901:x1876037605050112:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130299.667536:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130299.667571:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceab44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2f3 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667695:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667711:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667724:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667742:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667749:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667757:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667931:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667939:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.667947:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130299.667956:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789130299.668045:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668050:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668054:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668058:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130299.668062:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668066:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668075:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130299.668077:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130299.668080:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668084:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668094:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668097:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668100:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668104:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130299.668105:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668109:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668112:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff90b482b51300) 00010000:00010000:2.0:1789130299.668113:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130299.668115:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668119:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668148:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceab44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 72 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668156:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 71 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.668161:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130299.668163:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130299.668165:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130299.668220:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+71:40901:x1876037605050112:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 714us (3176us total) trans 30064771530 rc 0/0 00000100:00100000:2.0:1789130299.668227:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 508 00000100:00100000:0.0:1789130299.684598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.684778:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605050240 00000100:00100000:3.0:1789130299.684788:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605050240 00000100:00100000:3.0:1789130299.684854:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 509 00000100:00100000:3.0:1789130299.684865:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+71:40901:x1876037605050240:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789130299.684945:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.684976:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.684990:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685017:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685024:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685031:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685037:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130299.685041:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685048:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685059:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.685062:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130299.685066:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.685073:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.685152:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+71:40901:x1876037605050240:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 288us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.685167:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 509 00000100:00100000:1.0:1789130299.694197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.695697:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605050496 00000100:00100000:2.0:1789130299.695713:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605050496 00000100:00100000:2.0:1789130299.695783:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130299.695793:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+71:40901:x1876037605050496:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130299.696065:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+72:40901:x1876037605050496:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 272us (1877us total) trans 30064771531 rc 0/0 00000100:00100000:2.0:1789130299.696073:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130299.758103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.758180:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605050752 00000100:00100000:3.0:1789130299.758191:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605050752 00000100:00100000:3.0:1789130299.758284:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 510 00000100:00100000:3.0:1789130299.758296:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+72:40908:x1876037605050752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130299.758321:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130299.758343:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac2fa expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.758449:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.758465:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 73 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.758474:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.758508:0:36589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 73 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.758522:0:36589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 73 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.758536:0:36589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626852480:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130299.758683:0:36589:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490032480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130299.765795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.765962:0:36589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:36589:1876037626852480:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130299.766000:0:36589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.766087:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605050880 00000100:00100000:3.0:1789130299.766109:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605050880 00010000:00010000:3.0:1789130299.766143:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 74 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130299.766183:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789130299.766195:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+74:2369:x1876037605050880:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130299.766216:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130299.766223:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 74 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766236:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 74 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766271:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceab59 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2f3 expref: 74 pid: 36588 timeout: 1562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766286:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130299.766291:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766301:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766309:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130299.766336:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130299.766401:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+73:2369:x1876037605050880:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.766420:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00010000:00010000:1.0:1789130299.766677:0:36589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.766685:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130299.766705:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1789130299.766858:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceab6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2fa expref: 74 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.766874:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2fa expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.766882:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130299.766884:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130299.766887:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:1.0:1789130299.766914:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b489048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:40908:x1876037605050752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 8621us (8819us total) trans 30064771532 rc 0/0 00000100:00100000:1.0:1789130299.766921:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 510 00000100:00100000:3.0:1789130299.770495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130299.770579:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051136 00000100:00100000:2.0:1789130299.770590:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051136 00000100:00100000:2.0:1789130299.770681:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 511 00000100:00100000:2.0:1789130299.770691:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+73:40908:x1876037605051136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130299.770715:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130299.770718:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130299.770746:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceab75 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2fa expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.770764:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130299.770769:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130299.770782:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab83 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac301 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.770883:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.770896:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.770907:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130299.770919:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789130299.771040:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceab83 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac301 expref: 75 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.771054:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac301 expref: 74 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130299.771062:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130299.771066:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130299.771069:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1a00, rc 0) 00000100:00100000:2.0:1789130299.771329:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+74:40908:x1876037605051136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 637us (842us total) trans 30064771533 rc 0/0 00000100:00100000:2.0:1789130299.771336:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 511 00000100:00100000:3.0:1789130299.775851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.775910:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051392 00000100:00100000:1.0:1789130299.775921:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051392 00000100:00100000:1.0:1789130299.776024:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1789130299.776036:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+74:40908:x1876037605051392:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130299.776052:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130299.776078:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceab2f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2ec expref: 74 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.776100:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaae2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2d7 expref: 73 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.776111:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130299.776117:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130299.776172:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+72:40908:x1876037605051392:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 138us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130299.776180:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789130299.781236:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.781372:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051520 00000100:00100000:1.0:1789130299.781382:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051520 00000100:00100000:1.0:1789130299.781454:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 512 00000100:00100000:1.0:1789130299.781465:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+72:40908:x1876037605051520:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1789130299.781565:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.781581:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.781597:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130299.781953:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].10, 136 off9552 00000100:00100000:1.0:1789130299.782055:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+72:40908:x1876037605051520:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 589us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130299.782064:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 512 00000100:00100000:3.0:1789130299.784120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130299.784171:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051648 00000100:00100000:1.0:1789130299.784182:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051648 00000100:00100000:1.0:1789130299.784277:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 513 00000100:00100000:1.0:1789130299.784289:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+72:40908:x1876037605051648:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130299.784310:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130299.784332:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac308 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.784387:0:36589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.784399:0:36589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.784417:0:36589:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.784430:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.784443:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130299.785584:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130299.785595:0:36589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130299.785627:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d000, rc 0) 00000100:00100000:1.0:1789130299.785702:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:40908:x1876037605051648:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1415us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130299.785710:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 513 00010000:00010000:3.0:1789130299.845800:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130299.929529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.929662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.929708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.929749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130299.929804:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051904 00000100:00100000:3.0:1789130299.929820:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051904 00000100:00100000:2.0:1789130299.929821:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052160 00000100:00100000:2.0:1789130299.929838:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052160 00000100:00100000:3.0:1789130299.929916:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052032 00000100:00100000:3.0:1789130299.929922:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052032 00000100:00100000:2.0:1789130299.929950:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789130299.929966:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605052160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130299.929979:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:3.0:1789130299.929995:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605051904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130299.930074:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605052160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 111us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130299.930083:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:0.0:1789130299.930101:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605051776 00000100:00100000:0.0:1789130299.930107:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605051776 00000100:00100000:2.0:1789130299.930140:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789130299.930141:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:2.0:1789130299.930148:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605052032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130299.930148:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605051776:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789130299.930268:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130299.934979:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605051904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 4968us (5445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130299.935002:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:2.0:1789130299.936025:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605052032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 5864us (6263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130299.936042:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789130299.936851:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605051776:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 6697us (7135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130299.936863:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00000040:00080000:0.0:1789130300.293958:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130300.293969:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130300.294012:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 2 00000040:00080000:0.0:1789130300.294020:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130300.294185:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626852608:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130300.294304:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497426540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130300.298816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.299269:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052288 00000100:00100000:2.0:1789130300.299282:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052288 00000100:00100000:2.0:1789130300.299382:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 514 00000100:00100000:2.0:1789130300.299396:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605052288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130300.299457:0:36588:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130300.299649:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605052288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 257us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130300.299659:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 514 00000100:00080000:1.0:1789130300.300647:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130300.302021:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626852608:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130300.308384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.309314:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052416 00000100:00100000:1.0:1789130300.309332:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052416 00000100:00100000:1.0:1789130300.309422:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 515 00000100:00100000:1.0:1789130300.309444:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:40909:x1876037605052416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.309580:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309647:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309667:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309688:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309695:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309707:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309738:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309748:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309755:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130300.309808:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:1.0:1789130300.309814:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130300.309832:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309844:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309852:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309860:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309867:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.309872:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309880:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309896:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130300.309900:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130300.309906:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309913:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceaba6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309931:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309937:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309944:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309949:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ce00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.309953:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309959:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309967:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x26c361d7 (ffff90b491c57500) 00010000:00010000:1.0:1789130300.309969:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130300.309972:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.309978:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310000:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310007:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310013:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310019:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ca00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.310022:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310029:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310049:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130300.310052:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130300.310055:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.310061:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabb4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130300.310181:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:40909:x1876037605052416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 745us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.310191:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 515 00000100:00100000:2.0:1789130300.320006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.320137:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052672 00000100:00100000:1.0:1789130300.320151:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052672 00000100:00100000:1.0:1789130300.320246:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 516 00000100:00100000:1.0:1789130300.320269:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+73:40909:x1876037605052672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.320300:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130300.320330:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac30f expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.320490:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.320511:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.320526:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130300.320541:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1789130300.321023:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321034:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321042:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321049:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ce00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.321055:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321064:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321081:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130300.321086:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130300.321092:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321099:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabc2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321160:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabbb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac30f expref: 75 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321174:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130300.321176:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130300.321181:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac30f expref: 75 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.321193:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ca00, rc 0) 00000100:00100000:1.0:1789130300.324053:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605052672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3768us (4046us total) trans 30064771534 rc 301/301 00000100:00100000:1.0:1789130300.324074:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 516 00000100:00100000:3.0:1789130300.332774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.333048:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605052800 00000100:00100000:0.0:1789130300.333063:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605052800 00000100:00100000:0.0:1789130300.333155:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 517 00000100:00100000:0.0:1789130300.333167:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605052800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130300.333233:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130300.333589:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605052800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 422us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130300.334423:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 517 00000100:00100000:0.0:1789130300.338393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.338956:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053056 00000100:00100000:2.0:1789130300.338970:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053056 00000100:00100000:2.0:1789130300.339055:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 518 00000100:00100000:2.0:1789130300.339068:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605053056:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130300.339097:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130300.339102:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130300.339139:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaaa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac2c2 expref: 74 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.339165:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130300.339178:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130300.339199:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceabd0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac316 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130300.339895:0:38734:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcf:0x0], index 1: 0 00010000:00010000:2.0:1789130300.340157:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceabd7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.340175:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceabd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.340190:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceabd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.340260:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceabd0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac316 expref: 76 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.340293:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceabd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac316 expref: 75 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.340303:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b482b51900) 00010000:00010000:2.0:1789130300.340306:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130300.340309:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130300.340401:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+75:40909:x1876037605053056:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1335us (2023us total) trans 30064771535 rc 0/0 00000100:00100000:2.0:1789130300.340410:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 518 00000100:00100000:2.0:1789130300.354766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.355005:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053184 00000100:00100000:1.0:1789130300.355018:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053184 00000100:00100000:1.0:1789130300.355103:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 519 00000100:00100000:1.0:1789130300.355116:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+75:40909:x1876037605053184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.355151:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130300.355183:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac31d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.355294:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.355313:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.355327:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130300.355416:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130300.355422:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130300.355761:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.355969:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceabe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac31d expref: 77 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.355999:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac31d expref: 76 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.356009:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57500) 00010000:00010000:1.0:1789130300.356013:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130300.356017:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ce00, rc 0) 00000100:00100000:1.0:1789130300.356109:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+76:40909:x1876037605053184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 994us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.356119:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 519 00000100:00100000:3.0:1789130300.360384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.361654:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053440 00000100:00100000:0.0:1789130300.361674:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053440 00000100:00100000:0.0:1789130300.361766:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 520 00000100:00100000:0.0:1789130300.361780:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+76:40909:x1876037605053440:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130300.361867:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789130300.361910:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceabd7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac316 expref: 76 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.361938:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b482b51900) 00010000:00010000:0.0:1789130300.361960:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceabec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac31d expref: 75 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.361972:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57500) 00010000:00010000:0.0:1789130300.361980:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130300.362017:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362035:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362049:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362063:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362076:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362083:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362191:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362200:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362208:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362216:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130300.362362:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362374:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362385:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130300.362388:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130300.362392:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362401:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceabf3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362418:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362426:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362512:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362518:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130300.362522:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362531:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362550:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfdbd8780 (ffff90b497c01a00) 00010000:00010000:0.0:1789130300.362553:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130300.362556:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.362563:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceabfa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfdbd8780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.362789:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605053440:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1009us (2417us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130300.362800:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 520 00000100:00100000:0.0:1789130300.370940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.371811:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053568 00000100:00100000:1.0:1789130300.371827:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053568 00000100:00100000:1.0:1789130300.371913:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 521 00000100:00100000:1.0:1789130300.371925:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+74:40909:x1876037605053568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.371963:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130300.371997:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceac01 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac324 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372045:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372061:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372074:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372214:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceac01 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 76 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372425:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 75 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.372696:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:1.0:1789130300.372699:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130300.372703:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c600, rc 0) 00000100:00100000:1.0:1789130300.373156:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+75:40909:x1876037605053568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1231us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.373167:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 521 00000100:00100000:3.0:1789130300.379555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.379665:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053824 00000100:00100000:0.0:1789130300.379678:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053824 00000100:00100000:0.0:1789130300.379759:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 522 00000100:00100000:0.0:1789130300.379770:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:40909:x1876037605053824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130300.379893:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.379915:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.379931:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130300.381106:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].19, 88 off9648 00000004:00080000:0.0:1789130300.381125:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1463478522444ns, next at 1464478517442ns, rc = 0 00000004:00010000:0.0:1789130300.381222:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000054756cb2 reply state 00000000edbaa67b transno 30064771536 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.381234:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130300.394808:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+77:40909:x1876037605053824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 15021us (15255us total) trans 30064771536 rc 0/0 00000100:00100000:0.0:1789130300.394827:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 522 00010000:00010000:1.0:1789130300.404323:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404348:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404358:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404368:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.404375:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404385:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404410:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:1.0:1789130300.404414:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130300.404420:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.404439:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceac0f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130300.405163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.405271:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605053952 00000100:00100000:1.0:1789130300.405284:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605053952 00000100:00100000:1.0:1789130300.405362:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 523 00000100:00100000:1.0:1789130300.405381:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+76:40909:x1876037605053952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.405417:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130300.405460:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac32b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.405562:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 77 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.405580:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 77 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.405677:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:1.0:1789130300.405681:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130300.405684:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3de00, rc 0) 00000100:00100000:1.0:1789130300.416684:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+77:40909:x1876037605053952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 11287us (11508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.416704:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 523 00000100:00100000:3.0:1789130300.424438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.424567:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605054080 00000100:00100000:1.0:1789130300.424583:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605054080 00000100:00100000:1.0:1789130300.424853:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:1.0:1789130300.424875:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605054080:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789130300.425176:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605054080:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 312us (1158us total) trans 30064771215 rc 0/0 00000100:00100000:1.0:1789130300.425182:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:2.0:1789130300.429526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.429678:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605054336 00000100:00100000:1.0:1789130300.429696:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605054336 00000100:00100000:1.0:1789130300.429771:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:1.0:1789130300.429781:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+77:40909:x1876037605054336:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130300.430025:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+78:40909:x1876037605054336:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 244us (514us total) trans 30064771537 rc 0/0 00000100:00100000:1.0:1789130300.430033:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1789130300.439962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.440088:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605054592 00000100:00100000:1.0:1789130300.440105:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605054592 00000100:00100000:1.0:1789130300.440249:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 524 00000100:00100000:1.0:1789130300.440262:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+78:40909:x1876037605054592:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130300.440398:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+78:40909:x1876037605054592:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 139us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.440406:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 524 00000100:00100000:3.0:1789130300.445474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.446211:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605054720 00000100:00100000:0.0:1789130300.446227:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605054720 00000100:00100000:0.0:1789130300.446325:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 525 00000100:00100000:0.0:1789130300.446338:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:40909:x1876037605054720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130300.446368:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130300.446399:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceac1d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac332 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446518:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446550:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446565:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130300.446674:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130300.446699:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446731:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceac1d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac332 expref: 80 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446756:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac332 expref: 79 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.446767:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:0.0:1789130300.446771:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789130300.446776:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030400, rc 0) 00000100:00100000:0.0:1789130300.446861:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+79:40909:x1876037605054720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 526us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130300.446870:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 525 00000100:00100000:0.0:1789130300.450825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.450969:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605054848 00000100:00100000:1.0:1789130300.450985:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605054848 00000100:00100000:1.0:1789130300.451075:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:1.0:1789130300.451090:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037605054848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.451120:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130300.451155:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac339 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130300.451195:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f63c, blocks: 0x1 00010000:00010000:1.0:1789130300.451237:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=1463s v=(0 0) 00010000:00010000:1.0:1789130300.451243:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130300.451263:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 12 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.451290:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 12 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.451312:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ca00, rc 0) 00000100:00100000:1.0:1789130300.451408:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605054848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 321us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.451417:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789130300.459694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.459811:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055104 00000100:00100000:1.0:1789130300.459832:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055104 00000100:00100000:1.0:1789130300.459924:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 526 00000100:00100000:1.0:1789130300.459938:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+79:40909:x1876037605055104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130300.460123:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+79:40909:x1876037605055104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 188us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.460133:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 526 00000100:00100000:2.0:1789130300.464014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.464106:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055232 00000100:00100000:0.0:1789130300.464123:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055232 00000100:00100000:0.0:1789130300.464281:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:0.0:1789130300.464295:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:40909:x1876037605055232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130300.464320:0:37275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130300.464349:0:37275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac340 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.464393:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.464404:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130300.464410:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130300.464417:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.464475:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.464493:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 1563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.464512:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626852736:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130300.464726:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130300.472046:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626852736:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130300.472102:0:37275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.472131:0:37275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:2.0:1789130300.474175:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:40909:x1876037605055232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 9865us (10155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130300.474192:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:3.0:1789130300.486519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.490240:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055360 00000100:00100000:2.0:1789130300.490265:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055360 00010000:00010000:2.0:1789130300.490338:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 1563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.490405:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130300.490416:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605055360:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130300.490690:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130300.490727:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 1563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.490744:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 1563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.490773:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948aa9d1/0x5c74554e47ceac2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac339 expref: 13 pid: 37658 timeout: 1563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.490795:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130300.490800:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130300.490812:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.490823:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.490876:0:38711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.490894:0:38711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626852864:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130300.491026:0:38711:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130300.495254:0:38711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:38711:1876037626852864:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130300.495298:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130300.495352:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605055360:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4938us (8846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130300.495361:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789130300.499273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.505471:0:39572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055488 00000100:00100000:2.0:1789130300.505486:0:39572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055488 00002000:00100000:2.0:1789130300.505562:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcf:0x0] (0->23) req@ffff90b4876bf0c0 x1876037605055488/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:16/0 lens 512/0 e 0 to 0 dl 1789130311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130300.505575:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bf0c0 with x1876037605055488 ext(0->23) 00002000:00010000:2.0:1789130300.505583:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876bf0c0 00000100:00100000:0.0:1789130300.505766:0:39572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 369 00000100:00100000:0.0:1789130300.505794:0:39572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605055488:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130300.506515:0:39572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605055488:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 728us (7245us total) trans 30064771216 rc 0/0 00000100:00100000:0.0:1789130300.506526:0:39572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 369 00002000:00100000:0.0:1789130300.509022:0:39572:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcf:0x0] (0->23) req@ffff90b4876bf0c0 x1876037605055488/t30064771216(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:16/0 lens 512/448 e 0 to 0 dl 1789130311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130300.509037:0:39572:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4876bf0c0 with x1876037605055488 ext(0->23) 00002000:00010000:0.0:1789130300.509044:0:39572:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4876bf0c0 00000100:00100000:2.0:1789130300.511430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.511523:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055616 00000100:00100000:1.0:1789130300.511542:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055616 00000100:00100000:1.0:1789130300.511631:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 527 00000100:00100000:1.0:1789130300.511642:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+79:40909:x1876037605055616:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130300.586247:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771536 is committed 00000004:00080000:2.0:1789130300.586262:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000001:00080000:2.0:1789130300.586293:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771537 is committed 00000020:00080000:2.0:1789130300.586309:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4be62d900 refcount 2 committed 0 result 0 batchid 25769803912 00000020:00080000:2.0:1789130300.586314:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4be62d480 00000020:00080000:2.0:1789130300.586318:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48610a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4c197b400 00000004:00080000:2.0:1789130300.586353:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:0.0:1789130300.586404:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:40909:x1876037605055616:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 74759us (74977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130300.586416:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 527 00000020:00080000:3.0:1789130300.586466:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803912 committed batchid 25769803911 00000020:00080000:3.0:1789130300.586698:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803911 00000100:00100000:2.0:1789130300.586912:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130300.586929:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626852992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789130300.586989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130300.587044:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626852992 00000100:00100000:2.0:1789130300.587052:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626852992 00000100:00100000:2.0:1789130300.587105:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789130300.587114:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626852992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789130300.587139:0:37273:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:206 count 1 00002000:00010000:2.0:1789130300.587173:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xce:0x0] initial LVB size: 24, mtime: 0x6aa3f63a, atime: 0x6aa3f63a, ctime: 0x6aa3f63a, blocks: 0x1 00010000:00010000:2.0:1789130300.587181:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.587202:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=1463s v=(0 0) 00010000:00010000:2.0:1789130300.587207:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130300.587213:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.587229:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.587239:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.587247:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.587263:0:37273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130300.587281:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130300.587288:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.587295:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130300.587300:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.587441:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.587459:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.587467:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e497e903/0x5c74554e47ceac39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.587487:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130300.587489:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130300.587490:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130300.588101:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130300.588227:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626852992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1113us (1236us total) trans 30064771283 rc 0/0 00000100:00100000:2.0:1789130300.588237:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789130300.594298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130300.594380:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605055744 00000100:00100000:3.0:1789130300.594390:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605055744 00000100:00100000:3.0:1789130300.594452:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:3.0:1789130300.594463:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605055744:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1789130300.596428:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b498ac7480/2, rc 0, transno 30064771283 00000100:00100000:0.0:1789130300.596444:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626852992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789130300.596488:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626853120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789130300.596563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130300.596957:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626853120 00000100:00100000:3.0:1789130300.596963:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626853120 00000100:00100000:3.0:1789130300.597025:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789130300.597036:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626853120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789130300.597277:0:37275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:3.0:1789130300.597281:0:37275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1789130300 00002000:00010000:3.0:1789130300.597283:0:37275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789130300.597285:0:37275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1789130300 -> 1789130300 00002000:00010000:3.0:1789130300.597287:0:37275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789130300.597334:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626853120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (769us total) trans 30064771217 rc 0/0 00000100:00100000:3.0:1789130300.597343:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1789130300.597527:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789130300.597556:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4876be940/2, rc 0, transno 30064771217 00000100:00100000:0.0:1789130300.597562:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4876be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626853120:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789130300.689784:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771216 is committed 00000100:00100000:3.0:1789130300.689934:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605055744:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 95468us (95641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130300.689959:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:0.0:1789130300.695382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130300.695652:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056000 00000100:00100000:3.0:1789130300.695662:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056000 00000100:00100000:3.0:1789130300.695719:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 528 00000100:00100000:3.0:1789130300.695727:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:40909:x1876037605056000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130300.695772:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130300.695794:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceac24 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac332 expref: 52 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.695810:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:3.0:1789130300.695814:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130300.695842:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.695856:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.695867:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130300.696012:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000035429ea2 reply state 00000000786dc632 transno 30064771538 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130300.696019:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130300.696091:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:40909:x1876037605056000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 365us (719us total) trans 30064771538 rc 0/0 00000100:00100000:3.0:1789130300.696097:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 528 00000100:00100000:3.0:1789130300.702955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130300.703063:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703077:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703085:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703091:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130300.703096:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703103:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703120:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:1.0:1789130300.703124:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130300.703129:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.703136:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac40 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.703218:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056128 00000100:00100000:2.0:1789130300.703227:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056128 00000100:00100000:2.0:1789130300.703285:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:2.0:1789130300.703296:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605056128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130300.703512:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 24 -> 24 00002000:00010000:2.0:1789130300.703515:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 1789130300 -> 1789130298 00002000:00010000:2.0:1789130300.703518:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1789130298 00002000:00010000:2.0:1789130300.703520:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1789130300 -> 1789130298 00002000:00010000:2.0:1789130300.703523:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789130300.703634:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605056128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 307us (655us total) trans 30064771218 rc 0/0 00000100:00100000:2.0:1789130300.703643:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:0.0:1789130300.710908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.710975:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056384 00000100:00100000:1.0:1789130300.710983:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056384 00000100:00100000:1.0:1789130300.711034:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 529 00000100:00100000:1.0:1789130300.711042:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+52:40909:x1876037605056384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.711107:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.711122:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.711131:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.711168:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.711183:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 52 pid: 36588 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130300.711198:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626853248:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130300.711289:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130300.722956:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626853248:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130300.722982:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.723291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.723350:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056512 00000100:00100000:2.0:1789130300.723355:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056512 00010000:00010000:2.0:1789130300.723391:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 53 pid: 36588 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.723419:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789130300.723426:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+53:2370:x1876037605056512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130300.723437:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130300.723441:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 53 pid: 36588 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723450:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 53 pid: 36588 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723467:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceac08 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac324 expref: 53 pid: 36588 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723479:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:2.0:1789130300.723482:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723489:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723495:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.723522:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130300.723595:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:2370:x1876037605056512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 161us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130300.723632:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00010000:00010000:3.0:1789130300.723689:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723695:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723719:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723723:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723727:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723731:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130300.723734:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723738:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723745:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:3.0:1789130300.723747:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130300.723749:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.723753:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceac47 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130300.723783:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+51:40909:x1876037605056384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 12743us (12884us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130300.723805:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 529 00000100:00100000:0.0:1789130300.734197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130300.734291:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056640 00000100:00100000:3.0:1789130300.734302:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056640 00000100:00100000:3.0:1789130300.734366:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130300.734376:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:2368:x1876037605056640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789130300.734435:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.734456:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.734464:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130300.734469:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130300.734473:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 4/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.734508:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.734523:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 12 pid: 37275 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130300.734546:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cfe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626853376:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130300.734689:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c34cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130300.737016:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cfe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:37275:1876037626853376:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130300.737061:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.738786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.738989:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605056768 00000100:00100000:1.0:1789130300.739001:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605056768 00010000:00010000:1.0:1789130300.739057:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130300.739107:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789130300.739119:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605056768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130300.739138:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130300.739164:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.739177:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.739204:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac340 expref: 13 pid: 37275 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.739230:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130300.739235:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130300.739241:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.739252:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.739296:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130300.739354:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605056768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 237us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.739362:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00010000:00010000:0.0:1789130300.740042:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740055:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740083:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740092:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740100:0:37275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740114:0:37275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130300.740118:0:37275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740127:0:37275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740140:0:37275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.740148:0:37275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1177324/0x5c74554e47ceac4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130300.740208:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037605056640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 5833us (6021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130300.740226:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130300.744068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.744148:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057024 00000100:00100000:1.0:1789130300.744159:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057024 00000100:00100000:1.0:1789130300.744225:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 530 00000100:00100000:1.0:1789130300.744236:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:40909:x1876037605057024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130300.744315:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744331:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744344:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744597:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744849:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 52 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744857:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744894:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 52 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.744912:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 52 pid: 38734 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130300.744925:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626853504:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130300.745014:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130300.747640:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626853504:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130300.747672:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130300.755060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.760169:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057152 00000100:00100000:2.0:1789130300.760186:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057152 00010000:00010000:2.0:1789130300.760240:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 53 pid: 38734 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.760286:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789130300.760296:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+53:2370:x1876037605057152:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130300.760312:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130300.760319:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 53 pid: 38734 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760332:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 53 pid: 38734 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760357:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceac16 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac32b expref: 53 pid: 38734 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760373:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:2.0:1789130300.760713:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760724:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760729:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.760754:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130300.760807:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:2370:x1876037605057152:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 512us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130300.760812:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00010000:00010000:1.0:1789130300.762296:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130300.762310:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130300.762704:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771539 00000001:00080000:1.0:1789130300.762824:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771540 00000001:00080000:1.0:1789130300.762854:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771541 00000100:00100000:1.0:1789130300.762921:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626853632:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130300.762973:0:36588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130300.762996:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497426540 going to sleep for 11 seconds 00000100:00100000:3.0:1789130300.763054:0:40999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626853632 00000100:00100000:3.0:1789130300.763060:0:40999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626853632 00000100:00100000:3.0:1789130300.763098:0:40999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130300.763104:0:40999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:36588:x1876037626853632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789130300.763169:0:40999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3873512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:36588:x1876037626853632:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130300.763174:0:40999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789130300.763344:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626853632:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789130300.763986:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771542 00000100:00100000:1.0:1789130300.764041:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626853760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130300.765123:0:36588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130300.765159:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130300.766500:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626853760 00000100:00100000:3.0:1789130300.766513:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626853760 00000100:00100000:3.0:1789130300.766633:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130300.766645:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:36588:x1876037626853760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789130300.766936:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:36588:x1876037626853760:12345-0@lo:1000:mdt00_001.0 Request processed in 293us (1815us total) trans 30064771219 rc 0/0 00000100:00100000:3.0:1789130300.766944:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130300.767067:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:36588:1876037626853760:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789130300.767172:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771543 00010000:00010000:2.0:1789130300.767213:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767224:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767232:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767237:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130300.767242:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767249:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767264:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b491c57700) 00010000:00010000:2.0:1789130300.767268:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130300.767273:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767279:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceac5c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767308:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767314:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767321:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767326:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130300.767329:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767335:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767345:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130300.767347:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130300.767353:0:36588:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767364:0:36588:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767373:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.767420:0:36588:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.767434:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626853888:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130300.767503:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130300.773845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130300.773921:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057280 00000100:00100000:1.0:1789130300.773931:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057280 00000100:00100000:1.0:1789130300.773996:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130300.774007:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:40908:x1876037605057280:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:1.0:1789130300.774153:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:40908:x1876037605057280:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130300.774161:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:3.0:1789130300.782039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130300.783013:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057408 00000100:00100000:0.0:1789130300.783027:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057408 00000100:00100000:0.0:1789130300.783105:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:0.0:1789130300.783115:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:40908:x1876037605057408:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130300.783133:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130300.783155:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac347 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130300.783193:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6aa3f63a, atime: 0x6aa3f63a, ctime: 0x6aa3f63a, blocks: 0xb 00010000:00010000:0.0:1789130300.783223:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=1463s v=(0 0) 00010000:00010000:0.0:1789130300.783227:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130300.783237:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 12 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.783254:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 12 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130300.783268:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:0.0:1789130300.783333:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+12:40908:x1876037605057408:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 220us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130300.783341:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:2.0:1789130300.786970:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626853888:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130300.787015:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787027:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceab98 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787071:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787084:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787095:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787105:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787111:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787117:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787126:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130300.787130:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787137:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787148:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130300.787151:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130300.787155:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787160:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceac6a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787169:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.787175:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.788396:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.788404:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3da00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130300.788409:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.788417:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.788435:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130300.788438:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130300.788442:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130300.788459:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceac55 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130300.788761:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+56:40909:x1876037605057024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 44524us (44698us total) trans 30064771544 rc 0/0 00000100:00100000:2.0:1789130300.788773:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 530 00000020:00080000:2.0:1789130300.788779:0:36588:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1789130300.788865:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130300.788869:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130300.789399:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 2 00000040:00080000:3.0:1789130300.789408:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130300.790011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130300.792134:0:40189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057536 00000100:00100000:2.0:1789130300.792149:0:40189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057536 00002000:00100000:2.0:1789130300.792213:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcf:0x0] (0->4095) req@ffff90b381cfde00 x1876037605057536/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789130311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130300.792225:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381cfde00 with x1876037605057536 ext(0->4095) 00002000:00010000:2.0:1789130300.792230:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381cfde00 00000100:00100000:2.0:1789130300.792254:0:40189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 370 00000100:00100000:2.0:1789130300.792263:0:40189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605057536:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130300.794790:0:40189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605057536:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 2515us (4768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130300.794822:0:40189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 370 00002000:00100000:3.0:1789130300.794834:0:40189:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xcf:0x0] (0->4095) req@ffff90b381cfde00 x1876037605057536/t0(0) o3->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789130311 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130300.794843:0:40189:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381cfde00 with x1876037605057536 ext(0->4095) 00002000:00010000:3.0:1789130300.794849:0:40189:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b381cfde00 00000100:00100000:1.0:1789130300.795448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130300.795865:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057792 00000100:00100000:3.0:1789130300.795873:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057792 00000100:00100000:3.0:1789130300.795962:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:3.0:1789130300.795974:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+56:40909:x1876037605057792:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789130300.796898:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789130300.796997:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771545 00010000:00010000:3.0:1789130300.797123:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797139:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797150:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797159:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797166:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797173:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797203:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130300.797345:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:40909:x1876037605057792:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1373us (1897us total) trans 30064771546 rc 0/0 00000100:00100000:3.0:1789130300.797355:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000020:00080000:3.0:1789130300.797360:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130300.797451:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130300.797457:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797464:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130300.797468:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797476:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797489:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff90b496419600) 00010000:00010000:3.0:1789130300.797491:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130300.797496:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797656:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac71 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130300.797674:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130300.797675:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130300.797677:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130300.869940:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130301.893813:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130302.782732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130302.782966:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605057920 00000100:00100000:2.0:1789130302.782979:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605057920 00000100:00100000:2.0:1789130302.783115:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 531 00000100:00100000:2.0:1789130302.783126:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:40911:x1876037605057920:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130302.783154:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130302.783179:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceac78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac34e expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783252:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783268:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783283:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130302.783519:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130302.783524:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130302.783670:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783697:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceac78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac34e expref: 60 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783716:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac34e expref: 59 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130302.783724:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51c00) 00010000:00010000:2.0:1789130302.783727:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130302.783731:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130302.784012:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:40911:x1876037605057920:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 887us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130302.784020:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 531 00000100:00080000:0.0:1789130302.784172:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130302.798468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130302.798721:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605058048 00000100:00100000:3.0:1789130302.798733:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605058048 00000100:00100000:3.0:1789130302.799302:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 532 00000100:00100000:3.0:1789130302.799316:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+59:40911:x1876037605058048:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130302.799338:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130302.799358:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceac86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac355 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799421:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799436:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799448:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799463:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799469:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.799476:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800251:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800262:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800271:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130302.800321:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:3.0:1789130302.800325:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130302.800346:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800357:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800365:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800371:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800377:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800383:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130302.800387:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800395:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800408:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51c00) 00010000:00010000:3.0:1789130302.800411:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130302.800416:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800423:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceac8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800448:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800454:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800459:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800465:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130302.800468:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800473:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800482:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff90b496419600) 00010000:00010000:3.0:1789130302.800483:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130302.800486:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800492:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceac94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800793:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceac86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 61 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800809:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 60 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130302.800829:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130302.800832:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130302.800835:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:3.0:1789130302.800961:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+60:40911:x1876037605058048:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1647us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130302.800970:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 532 00010000:00010000:1.0:1789130302.919140:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130303.360911:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771283 is committed 00000001:00080000:0.0:1789130303.360941:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771281 is committed 00000100:00100000:3.0:1789130303.749845:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626854016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130303.749948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130303.751081:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626854144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.751148:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130303.753166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789130303.753280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130303.756705:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854272 00000100:00100000:1.0:1789130303.756728:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854272 00000100:00100000:1.0:1789130303.756925:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789130303.756941:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626854272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130303.757080:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626854272:12345-0@lo:400:kworker.0 Request processed in 143us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130303.757089:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789130303.757129:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626854400:0@lo:400:kworker.0 00000100:00100000:1.0:1789130303.757365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130303.757567:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626854656:0@lo:400:kworker.0 00000100:00100000:3.0:1789130303.757572:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626854528:0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.757637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130303.757660:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854016 00000100:00100000:3.0:1789130303.757668:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854016 00000100:00100000:2.0:1789130303.757696:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854144 00000100:00100000:2.0:1789130303.757704:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854144 00000100:00100000:3.0:1789130303.757721:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789130303.757732:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626854016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130303.757746:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789130303.757756:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626854144:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789130303.757773:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130303.757816:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626854016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (7868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130303.757824:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130303.757914:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626854144:12345-0@lo:400:kworker.0 Request processed in 158us (6764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130303.757921:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789130303.757958:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626854144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.757962:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854400 00000100:00100000:2.0:1789130303.757969:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854400 00000100:00100000:2.0:1789130303.758002:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789130303.758009:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626854400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.758042:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626854400:12345-0@lo:400:kworker.0 Request processed in 34us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130303.758049:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789130303.758067:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854656 00000100:00100000:2.0:1789130303.758071:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854656 00000100:00100000:2.0:1789130303.758112:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789130303.758120:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626854656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.758161:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626854656:12345-0@lo:400:kworker.0 Request processed in 42us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130303.758167:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789130303.758218:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626854656:0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.758269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130303.758310:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854528 00000100:00100000:2.0:1789130303.758314:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854528 00000100:00100000:2.0:1789130303.758356:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130303.758363:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130303.758398:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626854528:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130303.758404:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130303.758437:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626854528:0@lo:400:kworker.0 00000100:00100000:0.0:1789130303.759254:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771283 gen 2 00000004:00080000:0.0:1789130303.759269:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771282 committed transno 30064771283 00000004:00080000:0.0:1789130303.759297:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b498ac7480, transno 30064771283 00000100:00100000:0.0:1789130303.759333:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789130303.759348:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626854784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130303.759431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789130303.759494:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130303.759500:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130303.759503:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130303.760745:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626854016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130303.760985:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854784 00000100:00100000:3.0:1789130303.760995:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854784 00000100:00100000:3.0:1789130303.761072:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789130303.761084:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389780b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626854784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130303.761211:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389780b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626854784:12345-0@lo:400:kworker.0 Request processed in 129us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130303.761233:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1789130303.761266:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130303.761481:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626854784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130303.761748:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626854400:0@lo:400:kworker.0 00000040:00080000:2.0:1789130303.907203:0:41241:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130303.907215:0:41241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130303.907266:0:41241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 2 00000040:00080000:2.0:1789130303.907274:0:41241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130303.945669:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130303.987549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130303.987799:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605058304 00000100:00100000:1.0:1789130303.987815:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605058304 00000100:00100000:1.0:1789130303.987906:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 533 00000100:00100000:1.0:1789130303.987920:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+60:40923:x1876037605058304:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:1.0:1789130303.988725:0:36587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].11, 136 off9688 00000100:00100000:1.0:1789130303.988864:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+60:40923:x1876037605058304:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 945us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130303.989240:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 533 00000100:00100000:1.0:1789130304.773922:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626854912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130304.774029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130304.774092:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626854912 00000100:00100000:3.0:1789130304.774103:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626854912 00000100:00100000:3.0:1789130304.774182:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789130304.774195:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626854912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130304.774245:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130304.774320:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626854912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130304.774329:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130304.774491:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626854912:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789130304.902146:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130304.902160:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130304.902207:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1789130304.902216:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130304.902388:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386bec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626855040:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130304.902539:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d07f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130304.911432:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386bec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626855040:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130304.915435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130304.926260:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605058432 00000100:00100000:3.0:1789130304.926283:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605058432 00000100:00100000:3.0:1789130304.926471:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 534 00000100:00100000:3.0:1789130304.926487:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+60:40924:x1876037605058432:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130304.926542:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130304.926736:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+60:40924:x1876037605058432:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 253us (11315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130304.926766:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 534 00000100:00080000:0.0:1789130304.936738:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130304.940713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130304.940834:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605058688 00000100:00100000:2.0:1789130304.940849:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605058688 00000100:00100000:2.0:1789130304.940936:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 535 00000100:00100000:2.0:1789130304.940950:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:40924:x1876037605058688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130304.940979:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130304.941009:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceaca2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac35c expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941159:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941178:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941211:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130304.941225:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789130304.941373:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941390:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941533:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941540:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130304.941546:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941555:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941572:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130304.941575:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130304.941583:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941590:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceaca9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941691:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceaca2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac35c expref: 62 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941708:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130304.941711:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130304.941715:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceaca2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac35c expref: 62 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130304.941726:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130304.941825:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+61:40924:x1876037605058688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 878us (1130us total) trans 30064771547 rc 301/301 00000100:00100000:2.0:1789130304.941834:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 535 00000100:00100000:2.0:1789130304.950112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130304.950384:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605058944 00000100:00100000:0.0:1789130304.950399:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605058944 00000100:00100000:0.0:1789130304.950503:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 536 00000100:00100000:0.0:1789130304.950526:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+61:40924:x1876037605058944:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130304.950747:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.950771:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.950786:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951065:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951074:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951081:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951087:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130304.951092:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951101:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951120:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130304.951123:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130304.951129:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130304.951145:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceacb7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130304.951386:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+62:40924:x1876037605058944:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 860us (1289us total) trans 30064771548 rc 0/0 00000100:00100000:0.0:1789130304.951397:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 536 00000040:00080000:1.0:1789130304.951500:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130304.951507:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130304.952821:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 3 00000040:00080000:1.0:1789130304.952852:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130304.954297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130304.959103:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059200 00000100:00100000:1.0:1789130304.959143:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059200 00000100:00100000:1.0:1789130304.959267:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1789130304.959282:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:40924:x1876037605059200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130304.959996:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:40924:x1876037605059200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 711us (5704us total) trans 30064771549 rc 0/0 00000100:00100000:1.0:1789130304.960008:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00010000:00010000:1.0:1789130304.967099:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130305.049678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130305.049735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130305.049785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130305.049816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130305.049933:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059456 00000100:00100000:1.0:1789130305.049948:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059456 00000100:00100000:1.0:1789130305.050058:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059584 00000100:00100000:1.0:1789130305.050062:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059584 00000100:00100000:1.0:1789130305.050099:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:1.0:1789130305.050112:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605059456:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130305.050229:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605059456:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 119us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130305.050240:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:1.0:1789130305.050263:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:1.0:1789130305.050270:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037605059584:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130305.050301:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037605059584:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130305.050309:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:3.0:1789130305.050538:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059712 00000100:00100000:3.0:1789130305.050544:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059712 00000100:00100000:3.0:1789130305.050596:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:3.0:1789130305.050634:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605059712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130305.050675:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605059712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 72us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130305.050683:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789130305.051105:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059328 00000100:00100000:0.0:1789130305.051112:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059328 00000100:00100000:0.0:1789130305.051168:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:0.0:1789130305.051177:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605059328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130305.051404:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605059328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 228us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130305.051412:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00080000:2.0:1789130305.051503:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130305.051520:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130305.051523:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789130305.881289:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771218 is committed 00000001:00080000:1.0:1789130305.881318:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771219 is committed 00000001:00080000:1.0:1789130305.943881:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771548 is committed 00000001:00080000:1.0:1789130305.943908:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771549 is committed 00000020:00080000:1.0:1789130305.943923:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4856b7c00 refcount 2 committed 0 result 0 batchid 25769803913 00000020:00080000:1.0:1789130305.943931:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381a88300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b491d89a80 00000020:00080000:1.0:1789130305.943934:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381a88100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3868e1000 00000020:00080000:1.0:1789130305.943997:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803912 batchid updated 00000020:00080000:0.0:1789130305.944118:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803913 committed batchid 25769803912 00000020:00080000:0.0:1789130305.944466:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803912 00010000:00010000:1.0:1789130305.990454:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130307.013952:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130307.013967:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130307.014027:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1789130307.014037:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130307.014264:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130308.038085:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130308.870001:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626855552:0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.870045:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389782580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626855424:0@lo:400:kworker.0 00000100:00100000:2.0:1789130308.870234:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389783840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626855168:0@lo:400:kworker.0 00000100:00100000:3.0:1789130308.870309:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626855296:0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.873833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130308.874652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130308.874764:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855424 00000100:00100000:0.0:1789130308.874779:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855424 00000100:00100000:0.0:1789130308.874892:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789130308.874906:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626855424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.874969:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855552 00000100:00100000:1.0:1789130308.874974:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855552 00000100:00100000:1.0:1789130308.875010:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789130308.875013:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626855424:12345-0@lo:400:kworker.0 Request processed in 111us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130308.875017:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389781a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626855552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130308.875021:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789130308.875068:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389781a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626855552:12345-0@lo:400:kworker.0 Request processed in 51us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130308.875075:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789130308.875107:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771219 gen 2 00000100:00100000:0.0:1789130308.875112:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626855552:0@lo:400:kworker.0 00000004:00080000:1.0:1789130308.875114:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4876be940, transno 30064771217 00000004:00080000:1.0:1789130308.875139:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771219 committed transno 30064771219 00000100:00100000:1.0:1789130308.875163:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389782580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626855424:0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.875415:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626855936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130308.875468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130308.875529:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130308.875549:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855936 00000100:00100000:1.0:1789130308.875554:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855936 00000100:00100000:1.0:1789130308.875585:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789130308.875592:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626855936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130308.875649:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130308.875690:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626855936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130308.875697:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789130308.875928:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626855936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130308.876661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130308.876718:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389782940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626855680:0@lo:400:kworker.0 00000100:00100000:2.0:1789130308.876760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130308.877984:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855168 00000100:00100000:1.0:1789130308.878001:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855168 00000100:00100000:1.0:1789130308.878085:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789130308.878098:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626855168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.878206:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626855168:12345-0@lo:400:kworker.0 Request processed in 110us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130308.878215:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789130308.878328:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855680 00000100:00100000:0.0:1789130308.878335:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855680 00000100:00100000:0.0:1789130308.878485:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789130308.878495:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130308.878548:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626855680:12345-0@lo:400:kworker.0 Request processed in 56us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130308.878555:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789130308.878981:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389783840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626855168:0@lo:400:kworker.0 00000100:00100000:2.0:1789130308.879004:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389782940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626855680:0@lo:400:kworker.0 00000100:00080000:1.0:1789130308.879099:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130308.879847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130308.879909:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626855808:0@lo:400:kworker.0 00000100:00100000:3.0:1789130308.879962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130308.880155:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855296 00000100:00100000:1.0:1789130308.880164:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855296 00000100:00100000:1.0:1789130308.880239:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789130308.880250:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626855296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130308.880314:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626855296:12345-0@lo:400:kworker.0 Request processed in 66us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130308.880341:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789130308.880691:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130308.880730:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626855296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130308.880831:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626855808 00000100:00100000:0.0:1789130308.880837:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626855808 00000100:00100000:0.0:1789130308.880899:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789130308.880907:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130308.880961:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626855808:12345-0@lo:400:kworker.0 Request processed in 55us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130308.880968:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1789130308.881091:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130308.881113:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626855808:0@lo:400:kworker.0 00010000:00010000:1.0:1789130309.063202:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130309.898928:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626856064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130309.899056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130309.900668:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856064 00000100:00100000:0.0:1789130309.900688:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856064 00000100:00100000:0.0:1789130309.900795:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130309.900810:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626856064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130309.900865:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130309.900981:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626856064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130309.900990:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789130309.901884:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626856064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130310.086154:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130310.171405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130310.171466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130310.171504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130310.171543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130310.171577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130310.171654:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060352 00000100:00100000:2.0:1789130310.171669:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060352 00000100:00100000:2.0:1789130310.171760:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059968 00000100:00100000:2.0:1789130310.171764:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059968 00000100:00100000:2.0:1789130310.171793:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1789130310.171806:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605060352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130310.171912:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605060352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130310.171921:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1789130310.171941:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:2.0:1789130310.171948:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:2369:x1876037605059968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130310.171981:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:2369:x1876037605059968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130310.172002:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:2.0:1789130310.172024:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060096 00000100:00100000:2.0:1789130310.172028:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060096 00000100:00100000:2.0:1789130310.172060:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060224 00000100:00100000:2.0:1789130310.172063:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060224 00000100:00100000:2.0:1789130310.172087:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:2.0:1789130310.172094:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605060096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130310.172139:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605060096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130310.172149:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:2.0:1789130310.172162:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789130310.172168:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605060224:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130310.172193:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605060224:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130310.172199:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00080000:3.0:1789130310.173003:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130310.173013:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130310.173017:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130310.173546:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605059840 00000100:00100000:0.0:1789130310.173558:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605059840 00000100:00100000:0.0:1789130310.173669:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:0.0:1789130310.173681:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605059840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130310.173778:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605059840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130310.173787:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00000020:00080000:0.0:1789130311.012494:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803913 batchid updated 00000020:00080000:3.0:1789130311.012562:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00000020:00080000:3.0:1789130311.012589:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00010000:00010000:1.0:1789130311.110335:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130312.135186:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130313.159681:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130313.990870:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626856192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130313.990958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130313.991119:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856192 00000100:00100000:1.0:1789130313.991128:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856192 00000100:00100000:1.0:1789130313.991189:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789130313.991199:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626856192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130313.991236:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130313.991280:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626856192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130313.991287:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789130313.992321:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130313.992388:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626856192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130313.994396:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626856448:0@lo:400:kworker.0 00000100:00100000:1.0:1789130313.994476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130313.994538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130313.994543:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626856576:0@lo:400:kworker.0 00000100:00100000:1.0:1789130313.994571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130313.994626:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856576 00000100:00100000:1.0:1789130313.994633:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856576 00000100:00100000:1.0:1789130313.994679:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789130313.994689:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626856576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130313.994742:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626856576:12345-0@lo:400:kworker.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130313.994750:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789130313.994789:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626856576:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.994873:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626856704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.994920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130313.994950:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130313.994956:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389784780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626856320:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.994995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130313.995026:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626856832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.995049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130313.995279:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856448 00000100:00100000:2.0:1789130313.995285:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856448 00000100:00100000:2.0:1789130313.995335:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130313.995343:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626856448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130313.995404:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626856448:12345-0@lo:400:kworker.0 Request processed in 62us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130313.995410:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130313.995429:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856704 00000100:00100000:2.0:1789130313.995432:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856704 00000100:00100000:2.0:1789130313.995453:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856832 00000100:00100000:2.0:1789130313.995456:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856832 00000100:00100000:2.0:1789130313.995489:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789130313.995496:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626856704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130313.995527:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626856704:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130313.995532:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789130313.995541:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789130313.995546:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626856832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130313.995570:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626856832:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130313.995576:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789130313.995592:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856320 00000100:00100000:2.0:1789130313.995595:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856320 00000100:00100000:2.0:1789130313.995642:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789130313.995647:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130313.995673:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626856320:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130313.995678:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789130313.995722:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626856448:0@lo:400:kworker.0 00000100:00080000:3.0:1789130313.996394:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130313.996402:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130313.996428:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389784780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626856320:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.996440:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626856832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130313.996449:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626856704:0@lo:400:kworker.0 00010000:00010000:0.0:1789130314.182120:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130315.014219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130315.014244:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626856960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130315.014340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130315.014766:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626856960 00000100:00100000:0.0:1789130315.014774:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626856960 00000100:00080000:3.0:1789130315.014908:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130315.015072:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130315.015086:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626856960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130315.015127:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130315.015195:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386beda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626856960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130315.015212:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130315.015311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389785680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626856960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130315.205956:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130315.289080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130315.289152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130315.289303:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060608 00000100:00100000:0.0:1789130315.289314:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060608 00000100:00100000:0.0:1789130315.289407:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:0.0:1789130315.289419:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:2367:x1876037605060608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130315.289498:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:2367:x1876037605060608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130315.289510:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:3.0:1789130315.289767:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060864 00000100:00100000:3.0:1789130315.289772:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060864 00000100:00080000:2.0:1789130315.289847:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130315.290890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130315.290915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130315.290944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130315.290971:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060736 00000100:00100000:0.0:1789130315.290978:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060736 00000100:00100000:0.0:1789130315.291028:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1789130315.291037:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605060736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130315.291096:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605060736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130315.291104:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1789130315.291128:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060992 00000100:00100000:0.0:1789130315.291132:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060992 00000100:00100000:0.0:1789130315.291160:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:0.0:1789130315.291167:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605060992:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130315.291198:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389781e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605060992:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130315.291204:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00080000:0.0:1789130315.291220:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130315.291223:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130315.291399:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605060480 00000100:00100000:1.0:1789130315.291403:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605060480 00000100:00100000:1.0:1789130315.291440:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:1.0:1789130315.291448:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605060480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130315.291477:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605060480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130315.291484:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00080000:2.0:1789130315.295322:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130315.298577:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:3.0:1789130315.298622:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605060864:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130315.298721:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605060864:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 128us (9569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130315.298728:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00010000:00010000:1.0:1789130316.230011:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130317.254023:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130317.254032:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130317.254078:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1789130317.254088:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789130317.254629:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130318.277863:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130319.109925:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626857216:0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.109998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130319.110059:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626857728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.110086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130319.110118:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130319.110123:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626857344:0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.110145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130319.110175:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857216 00000100:00100000:3.0:1789130319.110182:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857216 00000100:00100000:3.0:1789130319.110233:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857344 00000100:00100000:3.0:1789130319.110236:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857344 00000100:00100000:3.0:1789130319.110284:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789130319.110294:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626857216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.110348:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626857216:12345-0@lo:400:kworker.0 Request processed in 55us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130319.110356:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789130319.110373:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789130319.110379:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626857344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.110421:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626857344:12345-0@lo:400:kworker.0 Request processed in 42us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130319.110428:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789130319.110445:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857728 00000100:00100000:3.0:1789130319.110448:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857728 00000100:00100000:3.0:1789130319.110472:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789130319.110479:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626857728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130319.110508:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626857728:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130319.110514:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1789130319.110530:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130319.110680:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626857472:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.110712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130319.110733:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789130319.110739:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626857088:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.110765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130319.110785:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626857600:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.110807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130319.110828:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857472 00000100:00100000:2.0:1789130319.110831:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857472 00000100:00100000:2.0:1789130319.110854:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857600 00000100:00100000:2.0:1789130319.110857:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857600 00000100:00100000:2.0:1789130319.110874:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789130319.110881:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626857472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.110915:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626857472:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130319.110922:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789130319.110933:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789130319.110939:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626857600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.110963:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626857600:12345-0@lo:400:kworker.0 Request processed in 24us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130319.110969:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789130319.111005:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626857600:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.111014:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626857472:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.111066:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626857344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.111076:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626857216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130319.111085:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626857728:0@lo:400:kworker.0 00000100:00080000:3.0:1789130319.111147:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130319.111152:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130319.111154:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130319.111235:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857088 00000100:00100000:0.0:1789130319.111239:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857088 00000100:00100000:0.0:1789130319.111291:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789130319.111299:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626857088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130319.111349:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626857088:12345-0@lo:400:kworker.0 Request processed in 51us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130319.111356:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789130319.112636:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626857088:0@lo:400:kworker.0 00000100:00100000:0.0:1789130319.113065:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626857856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130319.113128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130319.113317:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857856 00000100:00100000:1.0:1789130319.113324:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857856 00000100:00100000:1.0:1789130319.113377:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789130319.113385:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389782d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626857856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130319.113423:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130319.113493:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389782d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626857856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130319.113500:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789130319.113648:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626857856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789130319.302080:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130320.134326:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130320.134352:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389784780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626857984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130320.134438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130320.134563:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626857984 00000100:00100000:1.0:1789130320.134571:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626857984 00000100:00100000:1.0:1789130320.134653:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789130320.134664:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389780f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626857984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130320.134700:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130320.134749:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389780f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626857984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130320.134757:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130320.134777:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389784780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626857984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130320.325892:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130320.409885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.409952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.409992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.410025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.410053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.410087:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061120 00000100:00100000:0.0:1789130320.410096:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061120 00000100:00100000:0.0:1789130320.410148:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:0.0:1789130320.410157:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605061120:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130320.410245:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605061120:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130320.410254:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:0.0:1789130320.410289:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061248 00000100:00100000:0.0:1789130320.410292:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061248 00000100:00100000:0.0:1789130320.410328:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061632 00000100:00100000:0.0:1789130320.410332:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061632 00000100:00100000:0.0:1789130320.410352:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:0.0:1789130320.410358:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389780780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+51:2368:x1876037605061248:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130320.410392:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389780780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+51:2368:x1876037605061248:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130320.410398:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:0.0:1789130320.410409:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:0.0:1789130320.410415:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605061632:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130320.410437:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605061632:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130320.410443:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:3.0:1789130320.410973:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061504 00000100:00100000:3.0:1789130320.410980:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061504 00000100:00100000:3.0:1789130320.411022:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061376 00000100:00100000:3.0:1789130320.411026:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061376 00000100:00100000:3.0:1789130320.411056:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130320.411063:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389781680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037605061504:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130320.411105:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389781680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+11:2368:x1876037605061504:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130320.411112:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130320.411125:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:3.0:1789130320.411147:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037605061376:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130320.411173:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037605061376:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130320.411178:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00080000:3.0:1789130320.411197:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130320.411201:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130320.411203:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130320.877070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130320.877185:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061760 00000100:00100000:2.0:1789130320.877196:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061760 00000100:00100000:2.0:1789130320.877268:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130320.877280:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605061760:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130320.877334:0:38727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.877358:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 11 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.877372:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=20s v=(0 0) 00010000:00010000:2.0:1789130320.877377:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130320.877383:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.877418:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 11 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.877434:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 11 pid: 37276 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.877463:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626858112:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130320.877568:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822540 going to sleep for 11 seconds 00000100:00100000:3.0:1789130320.895049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.895140:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605061888 00000100:00100000:0.0:1789130320.895152:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605061888 00010000:00010000:0.0:1789130320.895206:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 12 pid: 37276 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130320.895264:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130320.895275:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605061888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130320.895291:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130320.895315:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 12 pid: 37276 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.895330:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 12 pid: 37276 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.895356:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130320.895361:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130320.895367:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.895378:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.895400:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130320.895472:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605061888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 198us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130320.895479:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00010000:00010000:2.0:1789130320.898147:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac03131b/0x5c74554e47ceac63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac347 expref: 11 pid: 37276 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.898189:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626858112:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130320.898251:0:38727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898265:0:38727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898273:0:38727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898504:0:38727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898514:0:38727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898523:0:38727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898531:0:38727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130320.898535:0:38727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898544:0:38727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898563:0:38727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.898570:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daa718a4/0x5c74554e47ceacbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.899008:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605061760:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 21727us (21947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130320.899019:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:3.0:1789130320.918576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130320.919092:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062144 00000100:00100000:1.0:1789130320.919114:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062144 00000100:00100000:1.0:1789130320.919188:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:1.0:1789130320.919199:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:40908:x1876037605062144:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:1.0:1789130320.919294:0:36590:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac301 expref: 51 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130320.919629:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771550 00000001:00080000:1.0:1789130320.922206:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771551 00010000:00010000:1.0:1789130320.923483:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.923509:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.923519:0:36590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.923527:0:36590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.923573:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.923591:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130320.923628:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626858240:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130320.924115:0:36590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130320.924127:0:36590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 54 pid: 36589 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130320.924137:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626858368:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130320.924164:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130320.939863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130320.939995:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626858240:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130320.940010:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:36590:1876037626858368:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130320.940042:0:36590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130320.940124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130320.949587:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062400 00000100:00100000:2.0:1789130320.949630:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062400 00010000:00010000:2.0:1789130320.949702:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 55 pid: 36589 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.949751:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062272 00000100:00100000:2.0:1789130320.949755:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062272 00010000:00010000:2.0:1789130320.949770:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 56 pid: 38734 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.949806:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130320.949816:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:2370:x1876037605062400:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130320.949833:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130320.949840:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.949851:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.949874:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceab9f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac308 expref: 56 pid: 36589 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.949890:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130320.949895:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.949904:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.949914:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130320.949993:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:2370:x1876037605062400:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 176us (10142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130320.950002:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789130320.950020:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:2.0:1789130320.950027:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386beed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:2370:x1876037605062272:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130320.950036:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130320.950041:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950051:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950063:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceac9b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac355 expref: 54 pid: 38734 timeout: 1584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950072:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130320.950076:0:36572:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950084:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950102:0:36572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950133:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130320.950153:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386beed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+53:2370:x1876037605062272:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 126us (10029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130320.950160:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00010000:00010000:2.0:1789130320.950345:0:36590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.950353:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130320.950485:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771552 00000001:00080000:2.0:1789130320.950767:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771553 00000100:00100000:2.0:1789130320.950881:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626858496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130320.950936:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130320.950962:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130320.951532:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626858496 00000100:00100000:3.0:1789130320.951541:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626858496 00000100:00100000:3.0:1789130320.951594:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130320.951630:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626858496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130320.951725:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626858496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130320.951733:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789130320.955410:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626858496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130320.959120:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771554 00000100:00100000:2.0:1789130320.959269:0:36590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626858624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130320.959363:0:36590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130320.959398:0:36590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130320.960660:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626858624 00000100:00100000:0.0:1789130320.960672:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626858624 00000100:00100000:0.0:1789130320.960735:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130320.960746:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:36590:x1876037626858624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130320.961058:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:36590:x1876037626858624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 312us (1693us total) trans 30064771220 rc 0/0 00000100:00100000:0.0:1789130320.961067:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130320.961535:0:36590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:36590:1876037626858624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130320.961631:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771555 00010000:00010000:2.0:1789130320.961694:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961705:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961713:0:36590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961724:0:36590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130320.961729:0:36590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961736:0:36590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961751:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130320.961754:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130320.961759:0:36590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130320.961764:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceacc5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130320.962067:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130320.962192:0:36590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].20, 64 off9712 00000004:00080000:2.0:1789130320.962204:0:36590:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1484059601267ns, next at 1485059598962ns, rc = 0 00000001:00080000:2.0:1789130320.962211:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771556 00010000:00010000:2.0:1789130320.962255:0:36590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130320.962259:0:36590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130320.962266:0:36590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceab8a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac301 expref: 57 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130320.962392:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:40908:x1876037605062144:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 43195us (43825us total) trans 30064771557 rc 0/0 00000100:00100000:2.0:1789130320.962400:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000020:00080000:2.0:1789130320.962404:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1789130320.965662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130320.966006:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062528 00000100:00100000:0.0:1789130320.966017:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062528 00000100:00100000:0.0:1789130320.966084:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 537 00000100:00100000:0.0:1789130320.966106:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+56:40908:x1876037605062528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130320.966140:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130320.966183:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaccc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac363 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.966293:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaccc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac363 expref: 57 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.966315:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaccc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac363 expref: 57 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130320.966336:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130320.966339:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130320.966344:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031e00, rc 0) 00000100:00100000:0.0:1789130320.966412:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+57:40908:x1876037605062528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 308us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130320.966419:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 537 00000100:00100000:3.0:1789130320.983928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130320.984241:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062784 00000100:00100000:1.0:1789130320.984253:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062784 00000100:00100000:2.0:1789130320.985870:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789130320.985892:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+57:40908:x1876037605062784:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130320.986161:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:40908:x1876037605062784:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 279us (2243us total) trans 30064771558 rc 0/0 00000100:00100000:2.0:1789130320.986170:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000001:00080000:3.0:1789130321.277911:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771552 is committed 00000001:00080000:3.0:1789130321.277931:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771558 is committed 00000004:00080000:3.0:1789130321.277939:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000020:00080000:3.0:1789130321.277966:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b49c2026c0 refcount 2 committed 0 result 0 batchid 25769803914 00000020:00080000:3.0:1789130321.277972:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b488816200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b498b7e780 00000020:00080000:3.0:1789130321.277976:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b488816000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3868e1c00 00000020:00080000:3.0:1789130321.278005:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803914 committed batchid 25769803913 00000020:00080000:3.0:1789130321.278200:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00000100:00100000:2.0:1789130321.278683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130321.278706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626858752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130321.278806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130321.278961:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626858752 00000100:00100000:1.0:1789130321.278969:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626858752 00000100:00100000:1.0:1789130321.279038:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789130321.279048:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626858752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789130321.279074:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:207 count 1 00002000:00010000:1.0:1789130321.279110:0:37275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6aa3f63a, atime: 0x6aa3f63a, ctime: 0x6aa3f63a, blocks: 0xb 00010000:00010000:1.0:1789130321.279118:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130321.279139:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=1484s v=(0 0) 00010000:00010000:1.0:1789130321.279144:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130321.279151:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130321.279167:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130321.279295:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130321.279303:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130321.279441:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130321.280207:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626858752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1158us (1398us total) trans 30064771221 rc 0/0 00000100:00100000:1.0:1789130321.280217:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1789130321.280320:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789130321.280675:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130321.280684:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130321.280695:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130321.280700:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130321.280710:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130321.280733:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130321.280742:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a0ece5/0x5c74554e47ceacd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130321.280768:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130321.280770:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130321.280772:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130321.281913:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3833e6940/2, rc 0, transno 30064771221 00000100:00100000:3.0:1789130321.281926:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626858752:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1789130321.285993:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771220 is committed 00010000:00010000:1.0:1789130321.351513:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130322.374064:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130323.404995:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130324.231232:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626858880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130324.231309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130324.231434:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626858880 00000100:00100000:1.0:1789130324.231443:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626858880 00000100:00100000:1.0:1789130324.231512:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130324.231524:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626858880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130324.231560:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130324.231643:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626858880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130324.231651:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130324.231690:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:1.0:1789130324.231696:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771220 committed transno 30064771220 00000100:00100000:1.0:1789130324.231718:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b3833e6940 x1876037626858752/t30064771221(30064771221) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130337 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130324.231735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626858880:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789130324.231812:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130324.232728:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626859136:0@lo:400:kworker.0 00000100:00100000:1.0:1789130324.232773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130324.232956:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626859392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130324.232991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130324.233020:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130324.233026:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626859008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130324.233055:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130324.233081:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626859520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130324.233105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130324.233133:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859008 00000100:00100000:3.0:1789130324.233138:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859008 00000100:00100000:3.0:1789130324.233184:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789130324.233192:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626859008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130324.233237:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626859008:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130324.233244:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789130324.233285:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626859008:0@lo:400:kworker.0 00000100:00100000:2.0:1789130324.233361:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859392 00000100:00100000:2.0:1789130324.233366:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859392 00000100:00100000:2.0:1789130324.233414:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859520 00000100:00100000:2.0:1789130324.233418:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859520 00000100:00100000:2.0:1789130324.233439:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789130324.233446:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626859392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130324.233482:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626859392:12345-0@lo:400:kworker.0 Request processed in 37us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130324.233489:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789130324.233500:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789130324.233507:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626859520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130324.233535:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626859520:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130324.233542:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789130324.233648:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859136 00000100:00100000:0.0:1789130324.233652:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859136 00000100:00100000:0.0:1789130324.233682:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789130324.233690:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626859136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130324.233728:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626859136:12345-0@lo:400:kworker.0 Request processed in 40us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130324.233734:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789130324.233907:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130324.233920:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626859264:0@lo:400:kworker.0 00000100:00100000:1.0:1789130324.233950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130324.233988:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626859136:0@lo:400:kworker.0 00000100:00100000:2.0:1789130324.234051:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859264 00000100:00100000:2.0:1789130324.234055:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859264 00000100:00100000:2.0:1789130324.234088:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789130324.234094:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130324.234134:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626859264:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130324.234141:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789130324.234217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626859264:0@lo:400:kworker.0 00000100:00080000:3.0:1789130324.234469:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130324.234475:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130324.234496:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626859520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130324.234507:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626859392:0@lo:400:kworker.0 00010000:00010000:0.0:1789130324.421994:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130325.253858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130325.253887:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626859648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130325.253960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130325.254042:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859648 00000100:00100000:0.0:1789130325.254049:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859648 00000100:00100000:0.0:1789130325.254093:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789130325.254102:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389783840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626859648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130325.254139:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130325.254197:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389783840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626859648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130325.254204:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789130325.254254:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626859648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130325.446381:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130325.531379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130325.531426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130325.531453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130325.531472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130325.531491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130325.531523:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063168 00000100:00100000:2.0:1789130325.531533:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063168 00000100:00100000:0.0:1789130325.531544:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605062912 00000100:00100000:0.0:1789130325.531549:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605062912 00000100:00100000:2.0:1789130325.531589:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063296 00000100:00100000:2.0:1789130325.531592:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063296 00000100:00100000:0.0:1789130325.531593:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:0.0:1789130325.531622:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605062912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130325.531630:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:2.0:1789130325.531637:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605063168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130325.531860:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605063168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 221us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130325.531868:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:1.0:1789130325.531877:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:1.0:1789130325.531886:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605063296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130325.531891:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063424 00000100:00100000:2.0:1789130325.531894:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063424 00000100:00100000:2.0:1789130325.531931:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063040 00000100:00100000:2.0:1789130325.531934:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063040 00000100:00100000:2.0:1789130325.531957:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:2.0:1789130325.531963:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605063424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130325.532242:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b58e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605062912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 638us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130325.532249:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:0.0:1789130325.532282:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:0.0:1789130325.532290:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+49:2369:x1876037605063040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130325.532323:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+49:2369:x1876037605063040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130325.532330:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:1.0:1789130325.532891:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605063296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1005us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130325.532901:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00080000:0.0:1789130325.535267:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130325.535276:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130325.535279:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130325.540298:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605063424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 8320us (8830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130325.540314:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00000020:00080000:3.0:1789130326.352445:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803914 batchid updated 00000020:00080000:2.0:1789130326.352510:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000020:00080000:2.0:1789130326.352522:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000001:00080000:1.0:1789130326.352930:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771221 is committed 00010000:00010000:0.0:1789130326.469852:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130327.496041:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130327.496057:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130327.496124:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1789130327.496139:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130327.498346:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130327.726280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130327.726985:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063552 00000100:00100000:0.0:1789130327.727210:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063552 00000100:00100000:0.0:1789130327.727304:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 538 00000100:00100000:0.0:1789130327.727315:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:40853:x1876037605063552:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130327.727466:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+49:40853:x1876037605063552:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 150us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130327.727477:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 538 00000100:00080000:2.0:1789130327.728709:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130327.732669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130327.733950:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605063808 00000100:00100000:3.0:1789130327.733968:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605063808 00000100:00100000:3.0:1789130327.734041:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789130327.735424:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+49:40853:x1876037605063808:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130327.736371:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+50:40853:x1876037605063808:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2309us (3706us total) trans 30064771559 rc 0/0 00000100:00100000:3.0:1789130327.736387:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00010000:00010000:0.0:1789130328.518346:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130329.350000:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626860032:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350097:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130329.350150:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626860544:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350170:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130329.350194:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789130329.350199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626859904:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130329.350246:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626860416:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130329.350290:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860032 00000100:00100000:2.0:1789130329.350297:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860032 00000100:00100000:2.0:1789130329.350342:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130329.350349:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626860032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350396:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626860032:12345-0@lo:400:kworker.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130329.350403:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130329.350426:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860544 00000100:00100000:2.0:1789130329.350430:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860544 00000100:00100000:2.0:1789130329.350455:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860416 00000100:00100000:2.0:1789130329.350458:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860416 00000100:00100000:2.0:1789130329.350478:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789130329.350483:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626860544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350514:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626860544:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130329.350520:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789130329.350531:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789130329.350537:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626860416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350563:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626860416:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130329.350569:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789130329.350589:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859904 00000100:00100000:2.0:1789130329.350592:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859904 00000100:00100000:2.0:1789130329.350650:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789130329.350658:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626859904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350688:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626859904:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130329.350694:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1789130329.350723:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130329.350728:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130329.350769:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626859904:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350782:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626860416:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350792:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626860032:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.350801:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626860544:0@lo:400:kworker.0 00000100:00100000:3.0:1789130329.351184:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626860160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130329.351232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130329.351268:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789130329.351274:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626859776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130329.351298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130329.351318:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626860288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130329.351344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130329.351375:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626859776 00000100:00100000:3.0:1789130329.351381:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626859776 00000100:00100000:3.0:1789130329.351420:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789130329.351426:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626859776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130329.351460:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130329.351503:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626859776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130329.351509:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789130329.351528:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860288 00000100:00100000:3.0:1789130329.351532:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860288 00000100:00100000:3.0:1789130329.351555:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789130329.351561:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626860288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130329.351592:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626860288:12345-0@lo:400:kworker.0 Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130329.351598:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1789130329.351642:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130329.351662:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771221 gen 2 00000004:00080000:3.0:1789130329.351668:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3833e6940, transno 30064771221 00000100:00100000:3.0:1789130329.351686:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626859776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130329.351698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626860288:0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.352696:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860160 00000100:00100000:2.0:1789130329.352706:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860160 00000100:00100000:2.0:1789130329.352792:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789130329.352803:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130329.352873:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626860160:12345-0@lo:400:kworker.0 Request processed in 73us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130329.352880:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789130329.353496:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626860160:0@lo:400:kworker.0 00010000:00010000:1.0:1789130329.547544:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130329.956766:0:41470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 08:38:47 (1789130327) 00000100:00100000:0.0:1789130330.374318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130330.374342:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626860672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130330.374409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130330.374542:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626860672 00000100:00100000:3.0:1789130330.374549:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626860672 00000100:00100000:3.0:1789130330.374621:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789130330.374632:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389782940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626860672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130330.374677:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130330.374726:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389782940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626860672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130330.374733:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789130330.375164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626860672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130330.485712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.485823:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064064 00000100:00100000:2.0:1789130330.485833:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064064 00000100:00100000:2.0:1789130330.485914:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 539 00000100:00100000:2.0:1789130330.485926:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389782580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+50:41541:x1876037605064064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130330.485950:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130330.485972:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceacda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac36a expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486069:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486083:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486096:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486111:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486119:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486125:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486556:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceacef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486566:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceacef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486573:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceacef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130330.486583:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789130330.486772:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486781:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486788:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486793:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130330.486798:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486804:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486818:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:2.0:1789130330.486821:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.486826:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486836:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceace1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486849:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486855:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486860:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486865:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130330.486868:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486874:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486881:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b482b51700) 00010000:00010000:2.0:1789130330.486883:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.486885:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.486891:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceace8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.487257:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceacda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac36a expref: 53 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.487276:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceacef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac36a expref: 52 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.487284:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130330.487286:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.487288:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1e00, rc 0) 00000100:00100000:2.0:1789130330.487359:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389782580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+52:41541:x1876037605064064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1436us (1658us total) trans 30064771560 rc 0/0 00000100:00100000:2.0:1789130330.487367:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 539 00000100:00080000:3.0:1789130330.487749:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130330.514087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.514305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130330.514805:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064320 00000100:00100000:1.0:1789130330.514814:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064320 00000100:00100000:1.0:1789130330.514889:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789130330.514900:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+52:2367:x1876037605064320:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130330.514916:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130330.514941:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceacef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac36a expref: 52 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.514960:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130330.514964:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130330.515022:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:2367:x1876037605064320:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 124us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130330.515029:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130330.526360:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064192 00000100:00100000:2.0:1789130330.526377:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064192 00000100:00100000:2.0:1789130330.526450:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 540 00000100:00100000:2.0:1789130330.526460:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:41541:x1876037605064192:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130330.526574:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:41541:x1876037605064192:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 115us (12497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130330.526582:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 540 00010000:00010000:0.0:1789130330.565976:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130330.566256:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130330.566262:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130330.567373:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 3 00000040:00080000:2.0:1789130330.567389:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130330.656234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.656276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.656297:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.656321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.656357:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064576 00000100:00100000:3.0:1789130330.656368:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064576 00000100:00100000:1.0:1789130330.656419:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064704 00000100:00100000:1.0:1789130330.656424:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064704 00000100:00100000:1.0:1789130330.656471:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:1.0:1789130330.656482:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605064704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130330.656554:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605064704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130330.656561:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00080000:1.0:1789130330.656585:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130330.656667:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064960 00000100:00100000:2.0:1789130330.656672:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064960 00000100:00100000:2.0:1789130330.656712:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1789130330.656720:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:2369:x1876037605064576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130330.656764:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+51:2369:x1876037605064576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130330.656771:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1789130330.656784:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:2.0:1789130330.656790:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605064960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130330.656815:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605064960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130330.656822:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:0.0:1789130330.656968:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064448 00000100:00100000:0.0:1789130330.656973:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064448 00000100:00100000:0.0:1789130330.657014:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789130330.657022:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605064448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130330.657049:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605064448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130330.657066:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00080000:0.0:1789130330.657102:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130330.665521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.665617:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605064832 00000100:00100000:2.0:1789130330.665626:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605064832 00000100:00100000:2.0:1789130330.665704:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789130330.665715:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4afb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605064832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:3.0:1789130330.665843:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130330.667293:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4afb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605064832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1571us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130330.667308:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:1.0:1789130330.712287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.712348:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065088 00000100:00100000:3.0:1789130330.712359:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065088 00000100:00100000:3.0:1789130330.712430:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 541 00000100:00100000:3.0:1789130330.712441:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:41562:x1876037605065088:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130330.712464:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130330.712489:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceacfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac371 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.712570:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.712586:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.712598:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.712913:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.712979:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.712989:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713379:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713388:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713395:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713401:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.713405:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713413:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713427:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51c00) 00010000:00010000:0.0:1789130330.713430:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.713435:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713441:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47cead04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713454:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713460:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713466:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713471:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.713474:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713481:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713492:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff90b497c01900) 00010000:00010000:0.0:1789130330.713495:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.713498:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713503:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713540:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceacfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac371 expref: 52 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713551:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51c00) 00010000:00010000:0.0:1789130330.713554:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.713557:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceacfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac371 expref: 52 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.713567:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34e00, rc 0) 00000100:00100000:0.0:1789130330.713857:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+51:41562:x1876037605065088:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1416us (1578us total) trans 0 rc 301/301 00000100:00100000:0.0:1789130330.713866:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 541 00000100:00100000:0.0:1789130330.718752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.718831:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065344 00000100:00100000:2.0:1789130330.718841:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065344 00000100:00100000:2.0:1789130330.718894:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 542 00000100:00100000:2.0:1789130330.718901:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389783c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+51:41562:x1876037605065344:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789130330.718962:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130330.718990:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceac7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac34e expref: 51 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.719797:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51c00) 00010000:00010000:2.0:1789130330.719812:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130330.720830:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.720844:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.720851:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.720859:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.720863:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.720867:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130330.722351:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00010000:00010000:2.0:1789130330.722370:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722380:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722387:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722393:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130330.722398:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722406:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722439:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130330.722442:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.722448:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.722454:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130330.722474:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f6f683bb reply state 0000000070b7a206 transno 30064771561 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130330.722482:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130330.722595:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389783c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+52:41562:x1876037605065344:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 3690us (3846us total) trans 30064771561 rc 0/0 00000100:00100000:2.0:1789130330.722624:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 542 00010000:00010000:1.0:1789130330.725377:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725394:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725402:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725408:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130330.725413:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725421:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725437:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff90b482b51b00) 00010000:00010000:1.0:1789130330.725440:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130330.725444:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.725450:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cead19 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130330.753529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130330.753869:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065472 00000100:00100000:3.0:1789130330.753880:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065472 00000100:00100000:3.0:1789130330.753948:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 543 00000100:00100000:3.0:1789130330.753959:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+51:41563:x1876037605065472:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:3.0:1789130330.753985:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130330.754022:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cead20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac378 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754228:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754247:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754258:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130330.754319:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130330.754322:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130330.754367:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754391:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cead20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac378 expref: 53 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754409:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac378 expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130330.754417:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:3.0:1789130330.754420:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130330.754423:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35000, rc 0) 00000100:00100000:3.0:1789130330.754496:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+52:41563:x1876037605065472:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 539us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130330.754504:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 543 00000100:00100000:3.0:1789130330.757721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130330.757916:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065600 00000100:00100000:0.0:1789130330.757926:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065600 00000100:00100000:0.0:1789130330.757993:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 544 00000100:00100000:0.0:1789130330.758005:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+52:41563:x1876037605065600:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:0.0:1789130330.758023:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130330.758044:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac37f expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758251:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758269:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758282:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758296:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758302:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758309:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758418:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758427:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758434:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130330.758474:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000004:00200000:0.0:1789130330.758479:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130330.758509:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758523:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758529:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758535:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758541:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.758546:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758554:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758567:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:0.0:1789130330.758570:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.758575:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758582:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758596:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758643:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758648:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758654:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.758657:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758663:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758670:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff90b497c01900) 00010000:00010000:0.0:1789130330.758672:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.758675:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.758681:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.760223:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac37f expref: 54 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.760244:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac37f expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.760253:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130330.760255:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130330.760259:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:0.0:1789130330.760354:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:41563:x1876037605065600:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 2350us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130330.760364:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 544 00000100:00100000:1.0:1789130330.778552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.789881:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065856 00000100:00100000:2.0:1789130330.789901:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065856 00000100:00100000:2.0:1789130330.789990:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 545 00000100:00100000:2.0:1789130330.790002:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+53:41563:x1876037605065856:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:2.0:1789130330.790082:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130330.790112:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead43 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac37f expref: 53 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.790134:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130330.790146:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130330.790179:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.790198:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.790208:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130330.790786:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c99f3853 reply state 00000000945fa23f transno 30064771562 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130330.790797:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789130330.790809:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000100:00100000:2.0:1789130330.791008:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41563:x1876037605065856:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 1006us (12468us total) trans 30064771562 rc 0/0 00000100:00100000:2.0:1789130330.791017:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 545 00010000:00010000:1.0:1789130330.801194:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801212:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801221:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801227:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130330.801232:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801241:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801257:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130330.801260:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130330.801265:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130330.801271:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47cead4a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130330.824651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.827503:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605065984 00000100:00100000:2.0:1789130330.827520:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605065984 00000100:00100000:0.0:1789130330.827711:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 546 00000100:00100000:0.0:1789130330.827723:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:41564:x1876037605065984:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130330.827755:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130330.827776:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac386 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827843:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827858:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827869:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827883:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827890:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.827897:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828036:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828044:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828062:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130330.828108:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000004:00200000:0.0:1789130330.828112:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130330.828137:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828149:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828156:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828163:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828169:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.828173:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828180:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828194:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:0.0:1789130330.828197:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.828203:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828209:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828224:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828234:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828240:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828244:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.828247:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828253:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828260:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff90b497c01900) 00010000:00010000:0.0:1789130330.828262:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.828265:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828271:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828302:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac386 expref: 55 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828316:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac386 expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.828528:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130330.828530:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130330.828534:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:0.0:1789130330.828666:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:41564:x1876037605065984:12345-192.168.201.39@tcp:101:rm.0 Request processed in 944us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130330.828674:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 546 00000100:00100000:3.0:1789130330.845557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130330.845781:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605066112 00000100:00100000:0.0:1789130330.845791:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605066112 00000100:00100000:0.0:1789130330.845855:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 547 00000100:00100000:0.0:1789130330.845867:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:41564:x1876037605066112:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130330.845887:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130330.845908:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead6d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac38d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.845988:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846014:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846027:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846042:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846060:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846075:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846149:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846157:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846164:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846170:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.846174:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846181:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846193:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130330.846196:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.846201:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846208:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47cead74 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846221:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846226:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846232:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846237:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130330.846240:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846245:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846253:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b497c01900) 00010000:00010000:0.0:1789130330.846255:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.846258:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846264:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47cead7b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846297:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead6d lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac38d expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846308:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130330.846310:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130330.846314:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47cead6d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac38d expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130330.846553:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:0.0:1789130330.846664:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:41564:x1876037605066112:12345-192.168.201.39@tcp:101:rm.0 Request processed in 799us (1115us total) trans 0 rc 301/301 00000100:00100000:0.0:1789130330.846672:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 547 00000100:00100000:3.0:1789130330.850771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130330.850989:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605066240 00000100:00100000:2.0:1789130330.850998:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605066240 00000100:00100000:2.0:1789130330.851074:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 548 00000100:00100000:2.0:1789130330.851086:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41564:x1876037605066240:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:2.0:1789130330.851109:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130330.851130:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cead82 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac394 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851194:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851208:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851223:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851236:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851243:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851250:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851313:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851475:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851482:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851488:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130330.851492:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851499:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851510:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130330.851513:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.851517:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851524:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47cead89 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851536:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851541:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851546:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851550:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130330.851553:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851558:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851564:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b482b51c00) 00010000:00010000:2.0:1789130330.851567:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.851569:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851574:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead90 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851733:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cead82 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac394 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851750:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130330.851752:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130330.851755:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cead82 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac394 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130330.851765:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130330.851821:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41564:x1876037605066240:12345-192.168.201.39@tcp:101:rm.0 Request processed in 738us (1060us total) trans 0 rc 301/301 00000100:00100000:2.0:1789130330.851828:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 548 00000100:00100000:1.0:1789130331.008636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130331.008730:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605066496 00000100:00100000:2.0:1789130331.008740:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605066496 00000100:00100000:2.0:1789130331.008802:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 549 00000100:00100000:2.0:1789130331.008814:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:41570:x1876037605066496:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130331.008836:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130331.008857:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cead97 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac39b expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.008994:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.009023:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.009038:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.009065:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.009074:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.009080:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011667:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceadac lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011686:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceadac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011698:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceadac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130331.011711:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:2.0:1789130331.011743:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011751:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011757:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011764:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130331.011768:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011775:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011792:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130331.011794:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130331.011799:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011806:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cead9e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130331.011820:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000079932c8a reply state 0000000033819682 transno 30064771563 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130331.011829:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130331.011862:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cead97 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac39b expref: 57 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011878:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceadac lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac39b expref: 56 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.011886:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789130331.011888:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130331.011891:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0200, rc 0) 00000100:00100000:2.0:1789130331.011976:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+57:41570:x1876037605066496:12345-192.168.201.39@tcp:101:dd.500 Request processed in 3164us (3380us total) trans 30064771563 rc 0/0 00000100:00100000:2.0:1789130331.011986:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 549 00000100:00100000:3.0:1789130331.031155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130331.031641:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605066752 00000100:00100000:0.0:1789130331.031652:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605066752 00000100:00100000:0.0:1789130331.031724:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:0.0:1789130331.031736:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:41570:x1876037605066752:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:0.0:1789130331.032090:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41570:x1876037605066752:12345-192.168.201.39@tcp:35:dd.500 Request processed in 356us (945us total) trans 30064771564 rc 0/0 00000100:00100000:0.0:1789130331.032098:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00010000:00010000:1.0:1789130331.034276:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034304:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034312:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034318:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130331.034323:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034329:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034346:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b482b51c00) 00010000:00010000:1.0:1789130331.034350:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130331.034356:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.034362:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceada5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130331.254356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130331.254469:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605067008 00000100:00100000:1.0:1789130331.254479:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605067008 00000100:00100000:1.0:1789130331.254540:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 550 00000100:00100000:1.0:1789130331.254551:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+57:41580:x1876037605067008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130331.254576:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130331.254596:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceadba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3a2 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130331.254756:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00010000:00010000:1.0:1789130331.255118:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceadba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3a2 expref: 59 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.255133:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:1.0:1789130331.255136:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130331.255141:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceadba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3a2 expref: 59 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.255156:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c400, rc 0) 00000100:00100000:1.0:1789130331.255222:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+58:41580:x1876037605067008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 673us (875us total) trans 30064771565 rc 301/301 00000100:00100000:1.0:1789130331.255233:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 550 00000100:00100000:2.0:1789130331.269759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130331.270189:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605067264 00000100:00100000:0.0:1789130331.270201:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605067264 00000100:00100000:0.0:1789130331.270265:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130331.270276:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41580:x1876037605067264:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130331.270575:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:41580:x1876037605067264:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 300us (826us total) trans 30064771566 rc 0/0 00000100:00100000:0.0:1789130331.270583:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130331.455005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130331.455153:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605067520 00000100:00100000:2.0:1789130331.455165:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605067520 00000100:00100000:2.0:1789130331.455241:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 551 00000100:00100000:2.0:1789130331.455253:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389781680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:41586:x1876037605067520:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130331.455277:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130331.455298:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceadc8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3a9 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.457302:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceadcf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.458189:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceadcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.458211:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceadcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130331.458234:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:2.0:1789130331.459315:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceadc8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3a9 expref: 62 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.459483:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceadcf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3a9 expref: 61 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.459493:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789130331.459496:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130331.459500:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:1.0:1789130331.460563:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389781680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:41586:x1876037605067520:12345-192.168.201.39@tcp:101:dd.500 Request processed in 5307us (5563us total) trans 30064771567 rc 0/0 00000100:00100000:1.0:1789130331.460574:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 551 00000100:00100000:2.0:1789130331.471946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130331.472015:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605067776 00000100:00100000:0.0:1789130331.472031:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605067776 00000100:00100000:0.0:1789130331.472174:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:0.0:1789130331.472186:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+61:41586:x1876037605067776:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:0.0:1789130331.474295:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:41586:x1876037605067776:12345-192.168.201.39@tcp:35:dd.500 Request processed in 2099us (2352us total) trans 30064771568 rc 0/0 00000100:00100000:0.0:1789130331.474312:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000001:00080000:1.0:1789130331.520808:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771566 is committed 00000100:00100000:2.0:1789130331.580309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130331.580445:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605068032 00000100:00100000:0.0:1789130331.580457:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605068032 00000100:00100000:0.0:1789130331.580536:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 552 00000100:00100000:0.0:1789130331.580555:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:41592:x1876037605068032:12345-192.168.201.39@tcp:36:truncate.500 00010000:00010000:0.0:1789130331.580814:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130331.580842:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceadcf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3a9 expref: 54 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.580867:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789130331.580872:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130331.581408:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.581425:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.581437:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130331.581638:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771569 00000004:00010000:2.0:1789130331.581668:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a7d1aa59 reply state 00000000750d8c00 transno 30064771570 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130331.581678:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130331.581855:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+56:41592:x1876037605068032:12345-192.168.201.39@tcp:36:truncate.500 Request processed in 1302us (1555us total) trans 30064771570 rc 0/0 00000100:00100000:2.0:1789130331.581861:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 552 00000020:00080000:2.0:1789130331.581866:0:38734:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130331.586636:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586657:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586665:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586672:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130331.586676:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586684:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586705:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130331.586708:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130331.586712:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.586718:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceaddd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.589933:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130331.668906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130331.669174:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605068160 00000100:00100000:1.0:1789130331.669184:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605068160 00000100:00100000:1.0:1789130331.669253:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 553 00000100:00100000:1.0:1789130331.669263:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+55:41598:x1876037605068160:12345-192.168.201.39@tcp:101:truncate.500 00010000:00010000:1.0:1789130331.669338:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130331.669360:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceade4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3b0 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669426:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669441:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669451:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669468:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669474:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.669541:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670403:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670415:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670425:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130331.670457:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 256 00000004:00200000:1.0:1789130331.670462:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130331.670694:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670708:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670717:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670725:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670732:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670737:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130331.670741:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670748:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670760:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130331.670763:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130331.670767:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670773:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceadeb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670785:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670796:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670802:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670807:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130331.670810:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670815:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670821:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b491c57400) 00010000:00010000:1.0:1789130331.670823:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130331.670826:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670831:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceadf2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670863:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceade4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b0 expref: 57 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670876:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b0 expref: 56 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.670884:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130331.670886:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130331.670889:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130331.670969:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:41598:x1876037605068160:12345-192.168.201.39@tcp:101:truncate.500 Request processed in 1706us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130331.670977:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 553 00000100:00100000:3.0:1789130331.677587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130331.678166:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605068416 00000100:00100000:1.0:1789130331.678178:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605068416 00000100:00100000:1.0:1789130331.678249:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 554 00000100:00100000:1.0:1789130331.678259:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:41598:x1876037605068416:12345-192.168.201.39@tcp:36:truncate.500 00010000:00010000:1.0:1789130331.678315:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130331.678345:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceadf9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b0 expref: 56 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.678366:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130331.678371:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130331.678661:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.678678:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.678690:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130331.678747:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771571 00000004:00010000:1.0:1789130331.678774:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a3bd4a69 reply state 00000000272db3b7 transno 30064771572 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130331.678784:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130331.678886:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41598:x1876037605068416:12345-192.168.201.39@tcp:36:truncate.500 Request processed in 628us (1307us total) trans 30064771572 rc 0/0 00000100:00100000:1.0:1789130331.678896:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 554 00000020:00080000:1.0:1789130331.678902:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130331.683941:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.683958:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.683966:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.683971:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130331.683976:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.683984:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.684002:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130331.684004:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130331.684010:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.684016:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceae00 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130331.796953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130331.797070:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605068672 00000100:00100000:2.0:1789130331.797082:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605068672 00000100:00100000:2.0:1789130331.797147:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 555 00000100:00100000:2.0:1789130331.797156:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+57:41605:x1876037605068672:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130331.797179:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130331.797197:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceae07 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3b7 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797557:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797568:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797576:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797589:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797593:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.797597:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799480:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceae1c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799501:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceae1c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799512:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceae1c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130331.799525:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:2.0:1789130331.799642:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799653:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799659:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799665:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130331.799670:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799681:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799693:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130331.799696:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130331.799700:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799707:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae0e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799721:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799726:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799729:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799732:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130331.799734:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799737:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799741:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b482b51600) 00010000:00010000:2.0:1789130331.799743:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130331.799744:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.799748:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceae15 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.801672:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceae07 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b7 expref: 60 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.801697:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceae1c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b7 expref: 59 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.801707:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789130331.801710:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130331.801714:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130331.803154:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+59:41605:x1876037605068672:12345-192.168.201.39@tcp:101:dd.500 Request processed in 5990us (6204us total) trans 30064771573 rc 0/0 00000100:00100000:2.0:1789130331.803168:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 555 00000100:00100000:2.0:1789130331.814451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130331.814540:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605068800 00000100:00100000:1.0:1789130331.814550:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605068800 00000100:00100000:1.0:1789130331.814843:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789130331.814855:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:2367:x1876037605068800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130331.814872:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130331.814900:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceae1c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3b7 expref: 59 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130331.814918:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130331.814924:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130331.814972:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:2367:x1876037605068800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 120us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130331.814980:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789130331.818347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130331.818469:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605069056 00000100:00100000:0.0:1789130331.818479:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605069056 00000100:00100000:0.0:1789130331.818579:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 556 00000100:00100000:0.0:1789130331.818590:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41605:x1876037605069056:12345-192.168.201.39@tcp:36:dd.500 00010000:00010000:0.0:1789130331.820147:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.820170:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.820184:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130331.820244:0:36588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771574 00000004:00010000:0.0:1789130331.820273:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000995c1962 reply state 000000001efe8353 transno 30064771575 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130331.820283:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130331.820394:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+61:41605:x1876037605069056:12345-192.168.201.39@tcp:36:dd.500 Request processed in 1803us (2053us total) trans 30064771575 rc 0/0 00000100:00100000:0.0:1789130331.820403:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 556 00000020:00080000:0.0:1789130331.820409:0:36588:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130331.829733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130331.830071:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605069312 00000100:00100000:3.0:1789130331.830082:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605069312 00000100:00100000:3.0:1789130331.830147:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:3.0:1789130331.830157:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:41605:x1876037605069312:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:3.0:1789130331.830476:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:41605:x1876037605069312:12345-192.168.201.39@tcp:35:dd.500 Request processed in 319us (752us total) trans 30064771576 rc 0/0 00000100:00100000:3.0:1789130331.830486:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00010000:00010000:0.0:1789130331.831116:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831127:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831136:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831142:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130331.831147:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831155:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831170:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789130331.831174:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130331.831179:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130331.831184:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae2a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130331.986088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130331.986235:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605069568 00000100:00100000:2.0:1789130331.986244:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605069568 00000100:00100000:2.0:1789130331.986297:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 557 00000100:00100000:2.0:1789130331.986307:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:41615:x1876037605069568:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130331.986329:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130331.986348:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3be expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130331.986749:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00010000:00010000:2.0:1789130331.986949:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3be expref: 63 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.986965:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:2.0:1789130331.986968:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130331.986975:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceae31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3be expref: 63 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130331.987059:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1e00, rc 0) 00000100:00100000:2.0:1789130331.987266:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:41615:x1876037605069568:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 959us (1185us total) trans 30064771577 rc 301/301 00000100:00100000:2.0:1789130331.987274:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 557 00000100:00100000:2.0:1789130331.996317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130331.996464:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605069824 00000100:00100000:3.0:1789130331.996475:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605069824 00000100:00100000:3.0:1789130331.996539:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789130331.996550:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:41615:x1876037605069824:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130331.997175:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:41615:x1876037605069824:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 625us (867us total) trans 30064771578 rc 0/0 00000100:00100000:3.0:1789130331.997184:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789130332.139516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.139675:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605069952 00000100:00100000:2.0:1789130332.139684:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605069952 00000100:00100000:2.0:1789130332.139755:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 558 00000100:00100000:2.0:1789130332.139767:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+63:41621:x1876037605069952:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130332.139789:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130332.139809:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceae3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3c5 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.139871:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.139885:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.139898:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130332.140283:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789130332.140357:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00000004:00200000:2.0:1789130332.140361:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130332.140443:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.140904:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceae3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3c5 expref: 65 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.140924:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3c5 expref: 64 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.140934:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130332.140937:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130332.140941:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0800, rc 0) 00000100:00100000:2.0:1789130332.141010:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605069952:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1245us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.141018:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 558 00000100:00100000:2.0:1789130332.148443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.148687:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070080 00000100:00100000:0.0:1789130332.148697:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070080 00000100:00100000:0.0:1789130332.148758:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 559 00000100:00100000:0.0:1789130332.148769:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605070080:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130332.148789:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130332.148809:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae4d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3cc expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.148881:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.148895:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.148905:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130332.149082:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:0.0:1789130332.149087:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130332.149181:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.149327:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.149361:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae4d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3cc expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.149382:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3cc expref: 65 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.149390:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789130332.149393:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130332.149396:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030000, rc 0) 00000100:00100000:0.0:1789130332.149705:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+65:41621:x1876037605070080:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 936us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.149714:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 559 00000100:00100000:0.0:1789130332.166427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.166562:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070336 00000100:00100000:2.0:1789130332.166573:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070336 00000100:00100000:0.0:1789130332.166750:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 560 00000100:00100000:0.0:1789130332.166763:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+65:41621:x1876037605070336:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130332.166784:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130332.166819:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae5b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3d3 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.166931:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae62 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.166946:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.166957:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130332.166968:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:0.0:1789130332.167111:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae5b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3d3 expref: 68 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.167131:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3d3 expref: 67 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.167140:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789130332.167143:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130332.167147:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:0.0:1789130332.167542:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:41621:x1876037605070336:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 712us (1055us total) trans 30064771579 rc 0/0 00000100:00100000:0.0:1789130332.167552:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 560 00000100:00100000:3.0:1789130332.175641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.175874:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070592 00000100:00100000:1.0:1789130332.175883:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070592 00000100:00100000:1.0:1789130332.175946:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130332.175956:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:41621:x1876037605070592:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130332.175971:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789130332.176004:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceae62 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3d3 expref: 67 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.176035:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceae54 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3cc expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.176048:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceadac lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac39b expref: 65 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.176058:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130332.176071:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130332.176132:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605070592:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 178us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.176140:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130332.180578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.180768:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070720 00000100:00100000:0.0:1789130332.180778:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070720 00000100:00100000:0.0:1789130332.180837:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 561 00000100:00100000:0.0:1789130332.180847:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605070720:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:0.0:1789130332.180967:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.180999:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.181011:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130332.181367:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].12, 136 off9824 00000100:00100000:0.0:1789130332.181476:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605070720:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 629us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.181485:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 561 00000100:00100000:2.0:1789130332.190284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.190428:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070848 00000100:00100000:0.0:1789130332.190437:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070848 00000100:00100000:0.0:1789130332.190497:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 562 00000100:00100000:0.0:1789130332.190507:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+64:41621:x1876037605070848:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130332.190528:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130332.190548:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3da expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190645:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190723:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 65 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190745:0:36588:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190763:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 65 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190778:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130332.190781:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130332.190785:0:36588:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 65 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.190944:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030c00, rc 0) 00000100:00100000:0.0:1789130332.191091:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+65:41621:x1876037605070848:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 584us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.191099:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 562 00000040:00080000:2.0:1789130332.614307:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130332.614317:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130332.614352:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 13 count 4 00000040:00080000:2.0:1789130332.614360:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130332.614505:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626860800:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130332.614628:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789130332.615481:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130332.620526:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626860800:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130332.630284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.630472:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605070976 00000100:00100000:0.0:1789130332.630482:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605070976 00000100:00100000:0.0:1789130332.630548:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 563 00000100:00100000:0.0:1789130332.630559:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+65:41622:x1876037605070976:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130332.630594:0:36589:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130332.630753:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+65:41622:x1876037605070976:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 195us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.630761:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 563 00000100:00100000:2.0:1789130332.647096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.647307:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605071104 00000100:00100000:1.0:1789130332.647319:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605071104 00000100:00100000:1.0:1789130332.647392:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 564 00000100:00100000:1.0:1789130332.647403:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+65:41622:x1876037605071104:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130332.647506:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647524:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647537:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647554:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647561:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647567:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647591:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647599:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647638:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130332.647691:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:1.0:1789130332.647695:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130332.647709:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647720:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647726:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647733:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647739:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130332.647743:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647751:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647762:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130332.647765:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130332.647770:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647776:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceae7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647799:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647806:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647811:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647816:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130332.647819:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647825:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647832:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x898fe5e1 (ffff90b491c57400) 00010000:00010000:1.0:1789130332.647835:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130332.647838:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647843:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceae85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647856:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647861:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647866:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647871:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130332.647874:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647878:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647885:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:1.0:1789130332.647887:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130332.647889:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.647894:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceae8c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.648600:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+65:41622:x1876037605071104:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1194us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.648834:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 564 00000100:00100000:3.0:1789130332.652155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.653582:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605071360 00000100:00100000:2.0:1789130332.653596:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605071360 00000100:00100000:2.0:1789130332.654381:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 565 00000100:00100000:2.0:1789130332.654394:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+65:41622:x1876037605071360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130332.654416:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130332.654441:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47ceae93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3e1 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655382:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655401:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655413:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130332.655425:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:2.0:1789130332.655759:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655768:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655774:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655780:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130332.655785:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655793:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.655806:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130332.656248:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130332.656258:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.656266:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceae9a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.656318:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47ceae93 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3e1 expref: 67 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.656330:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789130332.656332:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130332.656336:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47ceae93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3e1 expref: 67 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.656345:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0400, rc 0) 00000100:00100000:2.0:1789130332.656428:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605071360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2036us (4282us total) trans 30064771580 rc 301/301 00000100:00100000:2.0:1789130332.656437:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 565 00000100:00100000:2.0:1789130332.669094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.669345:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605071488 00000100:00100000:0.0:1789130332.669355:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605071488 00000100:00100000:0.0:1789130332.669421:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 566 00000100:00100000:0.0:1789130332.669433:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605071488:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130332.669660:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130332.669806:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605071488:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 375us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.669814:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 566 00000100:00100000:3.0:1789130332.694850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.694997:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605071744 00000100:00100000:1.0:1789130332.695005:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605071744 00000100:00100000:1.0:1789130332.695079:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 567 00000100:00100000:1.0:1789130332.695090:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605071744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130332.695113:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130332.695117:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130332.695147:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceae46 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3c5 expref: 66 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.695165:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130332.695170:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130332.695194:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceaea8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3e8 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130332.696561:0:38723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcf:0x0], index 0: 0 00010000:00010000:1.0:1789130332.697356:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaeaf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.697376:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaeaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.697387:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaeaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.697540:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceaea8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3e8 expref: 68 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.697571:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaeaf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3e8 expref: 67 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.697580:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b491c57400) 00010000:00010000:1.0:1789130332.697583:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130332.697586:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d200, rc 0) 00000100:00100000:1.0:1789130332.698110:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:41622:x1876037605071744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2868us (3115us total) trans 30064771581 rc 0/0 00000100:00100000:1.0:1789130332.698121:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 567 00000100:00100000:3.0:1789130332.704862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.704946:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072000 00000100:00100000:2.0:1789130332.704964:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072000 00000100:00100000:2.0:1789130332.705033:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 568 00000100:00100000:2.0:1789130332.705043:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+67:41622:x1876037605072000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130332.705105:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130332.705130:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaeaf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3e8 expref: 67 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705151:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b491c57400) 00010000:00010000:2.0:1789130332.705161:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130332.705194:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705207:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705217:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705231:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705239:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705245:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705785:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705794:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705805:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705820:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130332.705824:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705831:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705841:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130332.705844:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130332.705847:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705854:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceaebd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705863:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705869:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705875:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705880:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130332.705883:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705893:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705899:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x2fe36eda (ffff90b482b51600) 00010000:00010000:2.0:1789130332.705901:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130332.705904:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.705909:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceaec4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2fe36eda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130332.705990:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605072000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 947us (1140us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130332.705998:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 568 00000100:00100000:2.0:1789130332.710314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.710383:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072128 00000100:00100000:0.0:1789130332.710394:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072128 00000100:00100000:0.0:1789130332.710587:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 569 00000100:00100000:0.0:1789130332.710641:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+66:41622:x1876037605072128:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130332.710666:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130332.710690:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaecb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3ef expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710748:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710764:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710780:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710909:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaecb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 68 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710928:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 67 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.710936:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130332.710939:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130332.710943:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030000, rc 0) 00000100:00100000:0.0:1789130332.711025:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+67:41622:x1876037605072128:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 416us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130332.711875:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 569 00000100:00100000:1.0:1789130332.737873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.738066:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072384 00000100:00100000:0.0:1789130332.738079:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072384 00000100:00100000:0.0:1789130332.738157:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 570 00000100:00100000:0.0:1789130332.738167:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:41622:x1876037605072384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130332.738249:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.738264:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.738274:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130332.738757:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].19, 88 off9720 00000004:00080000:0.0:1789130332.738770:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1495836166913ns, next at 1496836163791ns, rc = 0 00000004:00010000:0.0:1789130332.738858:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008c4f89cb reply state 00000000689c193d transno 30064771582 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130332.738866:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130332.738951:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+69:41622:x1876037605072384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 785us (1088us total) trans 30064771582 rc 0/0 00000100:00100000:0.0:1789130332.738957:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 570 00010000:00010000:1.0:1789130332.752663:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752686:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752693:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752699:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130332.752704:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752712:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752731:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130332.752734:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130332.752739:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.752745:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaed9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.755774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130332.756909:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072512 00000100:00100000:3.0:1789130332.756925:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072512 00000100:00100000:3.0:1789130332.757008:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 571 00000100:00100000:3.0:1789130332.757029:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+68:41622:x1876037605072512:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130332.757057:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130332.757082:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3f6 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.757154:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 69 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.757171:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 69 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.757192:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130332.757195:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130332.757199:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34200, rc 0) 00000100:00100000:3.0:1789130332.757274:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+69:41622:x1876037605072512:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 248us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130332.758118:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 571 00000100:00100000:3.0:1789130332.775155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.775312:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072640 00000100:00100000:2.0:1789130332.775324:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072640 00000100:00100000:2.0:1789130332.775405:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:2.0:1789130332.775417:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605072640:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789130332.775907:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130332.777164:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605072640:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 1739us (2009us total) trans 30064771284 rc 0/0 00000100:00100000:2.0:1789130332.777177:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:2.0:1789130332.792026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130332.792407:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605072896 00000100:00100000:3.0:1789130332.792420:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605072896 00000100:00100000:3.0:1789130332.792500:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:3.0:1789130332.792511:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:41622:x1876037605072896:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130332.794838:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:41622:x1876037605072896:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2306us (2810us total) trans 30064771583 rc 0/0 00000100:00100000:2.0:1789130332.794855:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:0.0:1789130332.800722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.800818:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073152 00000100:00100000:2.0:1789130332.800833:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073152 00000100:00100000:2.0:1789130332.800889:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 572 00000100:00100000:2.0:1789130332.800897:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+70:41622:x1876037605073152:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130332.801003:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+70:41622:x1876037605073152:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.801011:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 572 00000100:00100000:2.0:1789130332.805771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.806445:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073280 00000100:00100000:1.0:1789130332.806457:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073280 00000100:00100000:1.0:1789130332.806523:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 573 00000100:00100000:1.0:1789130332.806680:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:41622:x1876037605073280:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130332.806704:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130332.806730:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceaee7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac3fd expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807074:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807091:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807103:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130332.807144:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130332.807167:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807194:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceaee7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3fd expref: 72 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807211:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3fd expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.807219:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130332.807222:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130332.807225:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d800, rc 0) 00000100:00100000:1.0:1789130332.807547:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+71:41622:x1876037605073280:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1015us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.807556:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 573 00000100:00100000:1.0:1789130332.814001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.814206:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073408 00000100:00100000:2.0:1789130332.814217:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073408 00000100:00100000:2.0:1789130332.814286:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:2.0:1789130332.814297:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605073408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130332.814317:0:37658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130332.814338:0:37658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac404 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130332.814364:0:37658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f65c, blocks: 0x1 00010000:00010000:2.0:1789130332.814385:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=1495s v=(0 0) 00010000:00010000:2.0:1789130332.814390:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130332.814399:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 15 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.814416:0:37658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 15 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.814738:0:37658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1a00, rc 0) 00000100:00100000:2.0:1789130332.814807:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605073408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 512us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.814815:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:0.0:1789130332.820114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.820307:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073664 00000100:00100000:1.0:1789130332.820319:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073664 00000100:00100000:1.0:1789130332.820384:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 574 00000100:00100000:1.0:1789130332.820394:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+71:41622:x1876037605073664:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130332.820518:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38866f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+71:41622:x1876037605073664:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 125us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.820526:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 574 00000100:00100000:1.0:1789130332.825751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.825950:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073792 00000100:00100000:2.0:1789130332.825971:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073792 00000100:00100000:2.0:1789130332.826038:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:2.0:1789130332.826050:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:41622:x1876037605073792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130332.826069:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130332.826090:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac40b expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.826124:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.826133:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130332.826138:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130332.826143:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.826184:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.826199:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130332.826215:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626860928:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130332.826329:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130332.832333:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3833e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626860928:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130332.832376:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130332.832397:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130332.832471:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+16:41622:x1876037605073792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 6423us (6729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.832480:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:0.0:1789130332.835900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.836189:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605073920 00000100:00100000:1.0:1789130332.836200:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605073920 00010000:00010000:1.0:1789130332.836259:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.836309:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130332.836320:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037605073920:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130332.836336:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130332.836357:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.836371:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.836392:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001801369/0x5c74554e47ceaef5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac404 expref: 16 pid: 37658 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.836410:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130332.836415:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130332.836477:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.836487:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.836539:0:36572:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.836553:0:36572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389784f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626861056:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130332.837304:0:36572:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130332.851834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130332.852070:0:40395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074048 00000100:00100000:3.0:1789130332.852082:0:40395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074048 00002000:00100000:3.0:1789130332.852144:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcf:0x0] (0->1023) req@ffff90b381cfc3c0 x1876037605074048/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:48/0 lens 1512/0 e 0 to 0 dl 1789130343 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130332.852160:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381cfc3c0 with x1876037605074048 ext(0->1023) 00002000:00010000:3.0:1789130332.852167:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381cfc3c0 00000100:00100000:3.0:1789130332.852205:0:40395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 371 00000100:00100000:3.0:1789130332.852214:0:40395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+16:2370:x1876037605074048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130332.852766:0:40395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:587d445f-41ce-47d3-97fe-edc16e866648+18:2370:x1876037605074048:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 551us (952us total) trans 30064771285 rc 0/0 00000100:00100000:3.0:1789130332.852775:0:40395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 371 00002000:00100000:3.0:1789130332.852783:0:40395:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0xcf:0x0] (0->1023) req@ffff90b381cfc3c0 x1876037605074048/t30064771285(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:48/0 lens 1512/448 e 0 to 0 dl 1789130343 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130332.852791:0:40395:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b381cfc3c0 with x1876037605074048 ext(0->1023) 00002000:00010000:3.0:1789130332.852795:0:40395:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b381cfc3c0 00000100:00100000:2.0:1789130332.855206:0:36572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389784f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:36572:1876037626861056:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130332.855237:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130332.855305:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037605073920:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 18987us (19416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.855317:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130332.859082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.859737:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074176 00000100:00100000:1.0:1789130332.859748:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074176 00000100:00100000:1.0:1789130332.859811:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 575 00000100:00100000:1.0:1789130332.859939:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3833e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+71:41622:x1876037605074176:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789130332.909151:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771582 is committed 00000004:00080000:0.0:1789130332.909167:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000001:00080000:0.0:1789130332.909215:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771583 is committed 00000100:00100000:3.0:1789130332.909404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130332.909741:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3833e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:41622:x1876037605074176:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 49916us (50664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.909754:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 575 00000100:00100000:1.0:1789130332.913800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130332.914214:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074304 00000100:00100000:2.0:1789130332.914227:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074304 00000100:00100000:2.0:1789130332.914297:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:2.0:1789130332.914309:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+17:2370:x1876037605074304:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789130332.925816:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626861184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789130332.926767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130332.927273:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626861184 00000100:00100000:1.0:1789130332.927282:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626861184 00000100:00100000:1.0:1789130332.927337:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789130332.927347:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626861184:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789130332.928192:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789130332.928914:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1789130332.928921:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1789130332 00002000:00010000:1.0:1789130332.928924:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130332.928927:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1789130332 -> 1789130332 00002000:00010000:1.0:1789130332.928930:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789130332.929026:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626861184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1667us (2246us total) trans 30064771286 rc 0/0 00000100:00100000:1.0:1789130332.929037:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000004:00080000:0.0:1789130332.930307:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3828ea580/2, rc 0, transno 30064771286 00000100:00100000:0.0:1789130332.930320:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626861184:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789130332.962194:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771284 is committed 00000001:00080000:3.0:1789130332.962213:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771285 is committed 00000100:00100000:2.0:1789130332.962394:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389785680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605074304:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 48082us (48600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130332.962406:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:2.0:1789130332.966845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.967086:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074560 00000100:00100000:1.0:1789130332.967097:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074560 00000100:00100000:1.0:1789130332.967168:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 576 00000100:00100000:1.0:1789130332.967178:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41622:x1876037605074560:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130332.967234:0:36587:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130332.967265:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceaeee lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3fd expref: 54 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.967287:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130332.967294:0:36587:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130332.967329:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.967345:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.967357:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130332.968161:0:36587:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b902b995 reply state 0000000074491a79 transno 30064771584 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.968172:0:36587:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130332.968302:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:41622:x1876037605074560:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1124us (1465us total) trans 30064771584 rc 0/0 00000100:00100000:1.0:1789130332.968313:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 576 00010000:00010000:1.0:1789130332.971988:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972007:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972025:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972031:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130332.972036:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972044:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972061:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130332.972065:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130332.972070:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.972076:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceaf03 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130332.974150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130332.974255:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074688 00000100:00100000:3.0:1789130332.974266:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074688 00000100:00100000:3.0:1789130332.974327:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:3.0:1789130332.974337:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605074688:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789130332.974580:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1789130332.974584:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 1789130332 -> 1789130331 00002000:00010000:3.0:1789130332.974586:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1789130330 00002000:00010000:3.0:1789130332.974589:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1789130332 -> 1789130331 00002000:00010000:3.0:1789130332.974592:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789130332.974691:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605074688:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 355us (556us total) trans 30064771287 rc 0/0 00000100:00100000:3.0:1789130332.974699:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:2.0:1789130332.978910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130332.979125:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605074944 00000100:00100000:0.0:1789130332.979136:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605074944 00000100:00100000:0.0:1789130332.979201:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 577 00000100:00100000:0.0:1789130332.979213:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:41622:x1876037605074944:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789130332.979287:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.979306:0:38734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.979316:0:38734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.979356:0:38734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130332.979372:0:38734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 54 pid: 38734 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130332.979392:0:38734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626861312:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130332.979492:0:38734:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383c53000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130332.983407:0:38734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:38734:1876037626861312:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130332.983451:0:38734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130332.985276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.985374:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075072 00000100:00100000:1.0:1789130332.985384:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075072 00010000:00010000:1.0:1789130332.985439:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 55 pid: 38734 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.985483:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1789130332.985494:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605075072:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130332.985511:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130332.985519:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 55 pid: 38734 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985542:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 55 pid: 38734 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985565:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaed2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3ef expref: 55 pid: 38734 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985582:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130332.985588:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985597:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985660:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.985695:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130332.985749:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2369:x1876037605075072:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 257us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130332.985759:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00010000:00010000:3.0:1789130332.986448:0:38734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986458:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986490:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986498:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986504:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986510:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130332.986514:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986522:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986678:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130332.986681:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130332.986686:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130332.986692:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf0a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130332.986768:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+53:41622:x1876037605074944:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 7555us (7867us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130332.986776:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 577 00000100:00100000:2.0:1789130332.992593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130332.993367:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075200 00000100:00100000:1.0:1789130332.993382:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075200 00000100:00100000:1.0:1789130332.993470:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:1.0:1789130332.993482:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+15:2370:x1876037605075200:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789130332.993539:0:37658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.993561:0:37658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.993571:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcf:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789130332.993576:0:37658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130332.993581:0:37658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.993643:0:37658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130332.993658:0:37658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 15 pid: 38727 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130332.993671:0:37658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626861440:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130332.993749:0:37658:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130332.997486:0:37658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:37658:1876037626861440:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130332.997522:0:37658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130332.999977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130333.000143:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075328 00000100:00100000:0.0:1789130333.000153:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075328 00010000:00010000:0.0:1789130333.000195:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130333.000237:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789130333.000248:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+16:2369:x1876037605075328:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130333.000267:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130333.000293:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.000307:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.000334:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47ceaefc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac40b expref: 16 pid: 38727 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.000354:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130333.000359:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130333.000365:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.000375:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.000415:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130333.000483:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605075328:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 237us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130333.000491:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00010000:00010000:1.0:1789130333.000579:0:37658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000589:0:37658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000650:0:37658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000660:0:37658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000670:0:37658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000678:0:37658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130333.000682:0:37658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000690:0:37658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000703:0:37658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.000710:0:37658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa551901/0x5c74554e47ceaf11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130333.000760:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605075200:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7280us (8175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130333.000768:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:1.0:1789130333.008810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130333.009067:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075584 00000100:00100000:0.0:1789130333.009077:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075584 00000100:00100000:0.0:1789130333.009134:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 578 00000100:00100000:0.0:1789130333.009144:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:41622:x1876037605075584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130333.009227:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009243:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009255:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009571:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009583:0:38723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 54 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009597:0:38723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009667:0:38723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 54 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.009681:0:38723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 54 pid: 36588 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130333.009694:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626861568:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130333.009773:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383c53000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130333.013845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130333.013933:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075712 00000100:00100000:1.0:1789130333.013942:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075712 00010000:00010000:1.0:1789130333.013987:0:36574:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 55 pid: 36588 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130333.014030:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789130333.014041:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605075712:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130333.014057:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130333.014064:0:36574:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 55 pid: 36588 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.014077:0:36574:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 55 pid: 36588 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.014100:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130333.014106:0:36574:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.014116:0:36574:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.014124:0:36574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.014144:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130333.014203:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605075712:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 163us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130333.014211:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00010000:00010000:0.0:1789130333.015210:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceaee0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3f6 expref: 54 pid: 36588 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130333.015232:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626861568:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130333.015259:0:38723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.015268:0:38723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.015273:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130333.015463:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771585 00000001:00080000:0.0:1789130333.015665:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771586 00000001:00080000:0.0:1789130333.015709:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771587 00000100:00100000:0.0:1789130333.016175:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626861696:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789130333.016240:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130333.016331:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383c53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130333.017440:0:36593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626861696 00000100:00100000:2.0:1789130333.017455:0:36593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626861696 00000100:00100000:2.0:1789130333.017532:0:36593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130333.017736:0:36593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38723:x1876037626861696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130333.018138:0:36593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38723:x1876037626861696:12345-0@lo:1000:mdt00_003.0 Request processed in 405us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130333.018145:0:36593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130333.018833:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626861696:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789130333.019488:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771588 00000100:00100000:0.0:1789130333.020069:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626861824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789130333.020136:0:38723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130333.020168:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383c53000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130333.020283:0:40999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626861824 00000100:00100000:1.0:1789130333.020290:0:40999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626861824 00000100:00100000:1.0:1789130333.020340:0:40999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130333.020351:0:40999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:38723:x1876037626861824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789130333.020572:0:40999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:38723:x1876037626861824:12345-0@lo:1000:mdt00_003.0 Request processed in 222us (434us total) trans 30064771288 rc 0/0 00000100:00100000:1.0:1789130333.020580:0:40999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130333.020809:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:38723:1876037626861824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789130333.020859:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020871:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020879:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020886:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130333.020891:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020899:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020916:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130333.020919:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130333.020924:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020931:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf1f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020978:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020984:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020989:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.020994:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130333.020996:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.021002:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.021017:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:3.0:1789130333.021020:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130333.021028:0:38723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.021041:0:38723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.021051:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130333.021081:0:38723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130333.021097:0:38723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626861952:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130333.021172:0:38723:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d07000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130333.027775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130333.027865:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605075840 00000100:00100000:1.0:1789130333.027876:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605075840 00000100:00100000:1.0:1789130333.027933:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:1.0:1789130333.027944:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41621:x1876037605075840:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:1.0:1789130333.028101:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41621:x1876037605075840:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130333.028110:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130333.028658:0:38723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:38723:1876037626861952:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130333.028686:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028697:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceae70 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028731:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028745:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028757:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028768:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028774:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028780:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028786:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130333.028790:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028797:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028808:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130333.028811:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130333.028828:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028835:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf26 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028846:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028852:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028857:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028862:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130333.028865:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028872:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028884:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130333.028886:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130333.028889:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.028894:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf18 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130333.029142:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+57:41622:x1876037605075584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 19997us (20341us total) trans 30064771589 rc 0/0 00000100:00100000:0.0:1789130333.029151:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 578 00000020:00080000:0.0:1789130333.029156:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789130333.029476:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130333.029482:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130333.030017:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 4 00000040:00080000:3.0:1789130333.030027:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789130333.034551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130333.034752:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605076096 00000100:00100000:1.0:1789130333.034762:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605076096 00000100:00100000:3.0:1789130333.034903:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 579 00000100:00100000:3.0:1789130333.034916:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:41621:x1876037605076096:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:3.0:1789130333.035311:0:36588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].13, 136 off9960 00000100:00100000:3.0:1789130333.035400:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:41621:x1876037605076096:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 486us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130333.035408:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 579 00000100:00100000:1.0:1789130333.040509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130333.040813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130333.041151:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605076352 00000100:00100000:0.0:1789130333.041162:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605076352 00000100:00100000:0.0:1789130333.041207:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605076608 00000100:00100000:0.0:1789130333.041210:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605076608 00000100:00100000:0.0:1789130333.041222:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1789130333.041232:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41622:x1876037605076352:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130333.042451:0:36591:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130333.043486:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771590 00010000:00010000:2.0:1789130333.043758:0:36591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.043776:0:36591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.043788:0:36591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.044036:0:36591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.044044:0:36591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.044055:0:36591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130333.044126:0:36591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130333.044264:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:41622:x1876037605076352:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3028us (3761us total) trans 30064771591 rc 0/0 00000100:00100000:2.0:1789130333.044274:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000020:00080000:2.0:1789130333.044280:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130333.044311:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:2.0:1789130333.044326:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:41621:x1876037605076608:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:2.0:1789130333.044479:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:41621:x1876037605076608:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 159us (3665us total) trans 30064771592 rc 0/0 00000100:00100000:2.0:1789130333.044485:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00010000:00010000:1.0:1789130333.051049:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130333.051066:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.051079:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130333.051084:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.051095:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.051116:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:1.0:1789130333.051119:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130333.051167:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.051173:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1c00/0x5c74554e47ceaf2d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130333.051202:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130333.051204:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130333.051206:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130333.093273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130333.093435:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605076736 00000100:00100000:3.0:1789130333.093446:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605076736 00000100:00100000:3.0:1789130333.093508:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 580 00000100:00100000:3.0:1789130333.093518:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+60:41624:x1876037605076736:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130333.093555:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130333.093577:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaf34 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac412 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.094949:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.094971:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.094984:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095019:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095027:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095034:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095370:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095380:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095387:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130333.095419:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00000004:00200000:0.0:1789130333.095423:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130333.095442:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095453:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095461:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095467:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095477:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095483:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130333.095487:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095494:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095507:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130333.095510:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130333.095515:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095522:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf3b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095534:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095540:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095546:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095550:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130333.095553:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095563:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095570:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b497c01700) 00010000:00010000:0.0:1789130333.095572:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130333.095575:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.095581:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.096315:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceaf34 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac412 expref: 62 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.096337:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac412 expref: 61 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130333.096344:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130333.096347:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130333.096349:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:0.0:1789130333.096432:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+61:41624:x1876037605076736:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2911us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130333.096443:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 580 00010000:00010000:1.0:1789130333.637894:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130334.088210:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130334.088223:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130334.088280:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789130334.088288:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130334.088725:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381cff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626862080:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130334.088826:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491761a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130334.098013:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381cff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626862080:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130334.121423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130334.121466:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605076864 00000100:00100000:1.0:1789130334.121474:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605076864 00000100:00080000:3.0:1789130334.121513:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130334.122206:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 581 00000100:00100000:1.0:1789130334.122293:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+61:41635:x1876037605076864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130334.122336:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130334.122458:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+61:41635:x1876037605076864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 241us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.122467:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 581 00000040:00080000:0.0:1789130334.129025:0:41521:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130334.129890:0:41521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130334.130200:0:41521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789130334.130209:0:41521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130334.136916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130334.137046:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605077120 00000100:00100000:0.0:1789130334.137057:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605077120 00000100:00100000:0.0:1789130334.137315:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 582 00000100:00100000:0.0:1789130334.137326:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:41635:x1876037605077120:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130334.137358:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130334.137379:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac419 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.137481:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf57 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.137496:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf57 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.137510:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf57 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130334.137522:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:0.0:1789130334.137789:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceaf50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac419 expref: 64 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.137804:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf57 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac419 expref: 63 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.137818:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130334.137821:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130334.137825:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:0.0:1789130334.137890:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:41635:x1876037605077120:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 566us (985us total) trans 30064771593 rc 0/0 00000100:00100000:0.0:1789130334.137897:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 582 00000100:00100000:0.0:1789130334.143782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130334.144737:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605077248 00000100:00100000:1.0:1789130334.144748:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605077248 00000100:00100000:1.0:1789130334.144816:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130334.144827:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+63:2370:x1876037605077248:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130334.144871:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130334.144896:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceaf57 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac419 expref: 63 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130334.144917:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:1.0:1789130334.144923:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130334.145002:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:2370:x1876037605077248:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 177us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.145010:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130334.149922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130334.152873:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605077504 00000100:00100000:0.0:1789130334.152891:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605077504 00000100:00100000:0.0:1789130334.152982:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 583 00000100:00100000:0.0:1789130334.153005:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+62:41635:x1876037605077504:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130334.153095:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153112:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153124:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153314:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153321:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153327:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153576:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130334.153582:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153591:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153618:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130334.153621:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130334.153626:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130334.153632:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceaf65 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130334.153794:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+63:41635:x1876037605077504:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 801us (3881us total) trans 30064771594 rc 0/0 00000100:00100000:0.0:1789130334.153803:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 583 00000040:00080000:0.0:1789130334.153914:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130334.153919:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130334.154625:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:0.0:1789130334.154637:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130334.158205:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130334.158243:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605077760 00000100:00100000:0.0:1789130334.158251:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605077760 00000100:00100000:0.0:1789130334.158304:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1789130334.158315:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:41635:x1876037605077760:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130334.158538:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:41635:x1876037605077760:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 224us (342us total) trans 30064771595 rc 0/0 00000100:00100000:0.0:1789130334.158547:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1789130334.469862:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38975cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626862464:0@lo:400:kworker.0 00000100:00100000:1.0:1789130334.469902:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626862592:0@lo:400:kworker.0 00000100:00100000:0.0:1789130334.469936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130334.469948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130334.470001:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626862336:0@lo:400:kworker.0 00000100:00100000:0.0:1789130334.470081:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862464 00000100:00100000:0.0:1789130334.470090:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862464 00000100:00100000:3.0:1789130334.470093:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626862208:0@lo:400:kworker.0 00000100:00100000:0.0:1789130334.470152:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789130334.470162:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626862464:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789130334.471828:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130334.471922:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130334.472015:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626862976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130334.472251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130334.472286:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862976 00000100:00100000:1.0:1789130334.472294:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862976 00000100:00100000:1.0:1789130334.472410:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789130334.472419:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626862976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130334.472458:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 211222528 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130334.472501:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626862976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.472509:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789130334.472555:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626862976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130334.473412:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862592 00000100:00100000:1.0:1789130334.473423:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862592 00000100:00100000:1.0:1789130334.473467:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789130334.473476:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626862592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130334.473546:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626862592:12345-0@lo:400:kworker.0 Request processed in 70us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.473554:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789130334.474741:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626862592:0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.478971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130334.479052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626862848:0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.479093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130334.479149:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862336 00000100:00100000:2.0:1789130334.479157:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862336 00000100:00100000:2.0:1789130334.479209:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789130334.479220:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626862336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.479275:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bd9a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626862336:12345-0@lo:400:kworker.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130334.479283:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789130334.479325:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626862336:0@lo:400:kworker.0 00000100:00080000:1.0:1789130334.480862:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130334.481019:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862848 00000100:00100000:1.0:1789130334.481030:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862848 00000100:00100000:1.0:1789130334.481265:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789130334.481277:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626862848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130334.481432:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626862848:12345-0@lo:400:kworker.0 Request processed in 157us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.481440:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:2.0:1789130334.482208:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130334.482269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626862848:0@lo:400:kworker.0 00000100:00100000:0.0:1789130334.485410:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626862464:12345-0@lo:400:kworker.0 Request processed in 15240us (15463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130334.485426:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789130334.485562:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38975cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626862464:0@lo:400:kworker.0 00000100:00100000:3.0:1789130334.508094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130334.508325:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862208 00000100:00100000:2.0:1789130334.508336:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862208 00000100:00100000:2.0:1789130334.508406:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130334.508418:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626862208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.508477:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626862208:12345-0@lo:400:kworker.0 Request processed in 62us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130334.508484:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130334.508574:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626862208:0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.508588:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626862720:0@lo:400:kworker.0 00000100:00100000:2.0:1789130334.508644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130334.508895:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626862720 00000100:00100000:1.0:1789130334.508901:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626862720 00000100:00100000:1.0:1789130334.508959:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789130334.508967:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626862720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130334.509026:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626862720:12345-0@lo:400:kworker.0 Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130334.509033:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789130334.509105:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626862720:0@lo:400:kworker.0 00000100:00080000:2.0:1789130334.509159:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130334.663549:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130335.494862:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130335.494891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626863104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130335.494991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130335.495167:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626863104 00000100:00100000:2.0:1789130335.495179:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626863104 00000100:00100000:2.0:1789130335.495240:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130335.495250:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626863104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130335.495290:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130335.495337:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626863104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130335.495345:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130335.495485:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3839e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626863104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130335.685945:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130335.786804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130335.786846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130335.786874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130335.786897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130335.787878:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078016 00000100:00100000:1.0:1789130335.787893:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078016 00000100:00100000:1.0:1789130335.788192:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078400 00000100:00100000:1.0:1789130335.788197:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078400 00000100:00100000:1.0:1789130335.788240:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:1.0:1789130335.788251:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:2369:x1876037605078016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130335.788687:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:2369:x1876037605078016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 336us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130335.788697:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:1.0:1789130335.788718:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:1.0:1789130335.788727:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605078400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130335.788833:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2370:x1876037605078400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130335.788840:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:1.0:1789130335.788864:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078144 00000100:00100000:1.0:1789130335.788869:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078144 00000100:00100000:1.0:1789130335.788901:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:1.0:1789130335.789506:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605078144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130335.789555:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605078144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 646us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130335.789563:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00080000:1.0:1789130335.790083:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130335.790091:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130335.799103:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605077888 00000100:00100000:2.0:1789130335.799120:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605077888 00000100:00100000:2.0:1789130335.799181:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:2.0:1789130335.799191:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605077888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130335.799273:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605077888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (12426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130335.799281:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:3.0:1789130335.799589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130335.800194:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078272 00000100:00100000:2.0:1789130335.800201:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078272 00000100:00100000:2.0:1789130335.800249:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:2.0:1789130335.800257:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605078272:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130335.800307:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605078272:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130335.800314:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00080000:2.0:1789130335.800332:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789130336.109840:0:41572:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130336.109851:0:41572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130336.109903:0:41572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789130336.110047:0:41572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130336.365945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130336.366021:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078656 00000100:00100000:3.0:1789130336.366032:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078656 00000100:00100000:3.0:1789130336.366106:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 584 00000100:00100000:3.0:1789130336.366118:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+64:41654:x1876037605078656:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130336.366142:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130336.366166:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceaf6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac420 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130336.366422:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00010000:00010000:3.0:1789130336.366629:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceaf6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac420 expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.366644:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:3.0:1789130336.366647:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130336.366652:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceaf6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac420 expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.366665:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35600, rc 0) 00000100:00100000:3.0:1789130336.366726:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38975cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+65:41654:x1876037605078656:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 611us (788us total) trans 30064771596 rc 301/301 00000100:00100000:3.0:1789130336.366733:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 584 00000100:00080000:2.0:1789130336.366982:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130336.377525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130336.377597:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605078912 00000100:00100000:3.0:1789130336.377632:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605078912 00000100:00100000:3.0:1789130336.377683:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:3.0:1789130336.377693:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+65:41654:x1876037605078912:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130336.378399:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:41654:x1876037605078912:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 703us (880us total) trans 30064771597 rc 0/0 00000100:00100000:2.0:1789130336.378409:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00010000:00010000:1.0:1789130336.709974:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130336.727959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130336.732233:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079040 00000100:00100000:1.0:1789130336.732245:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079040 00000100:00100000:1.0:1789130336.732323:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 585 00000100:00100000:1.0:1789130336.732335:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:41681:x1876037605079040:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130336.732362:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130336.732384:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceaf7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac427 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732478:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732494:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732506:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130336.732776:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00000004:00200000:1.0:1789130336.732780:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130336.732864:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732893:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceaf7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac427 expref: 68 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732911:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac427 expref: 67 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.732918:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130336.732921:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130336.732925:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d200, rc 0) 00000100:00100000:1.0:1789130336.733011:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+67:41681:x1876037605079040:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 677us (5131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130336.733019:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 585 00000100:00100000:1.0:1789130336.750565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130336.750999:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079296 00000100:00100000:2.0:1789130336.751012:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079296 00000100:00100000:2.0:1789130336.751084:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 586 00000100:00100000:2.0:1789130336.751096:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+67:41681:x1876037605079296:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789130336.751169:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130336.751203:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47cead27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac378 expref: 67 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.751224:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419600) 00010000:00010000:2.0:1789130336.751237:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130336.752588:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+66:41681:x1876037605079296:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 1488us (2027us total) trans 0 rc -17/-17 00000100:00100000:2.0:1789130336.752625:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 586 00000100:00100000:2.0:1789130336.809727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130336.810346:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079424 00000100:00100000:1.0:1789130336.810357:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079424 00000100:00100000:1.0:1789130336.810429:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 587 00000100:00100000:1.0:1789130336.810440:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+66:41682:x1876037605079424:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:1.0:1789130336.810463:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130336.810487:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceaf88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac42e expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.810552:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.810566:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.810577:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130336.812123:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130336.812134:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130336.812264:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.812302:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceaf88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac42e expref: 68 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.812323:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac42e expref: 67 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.812333:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57b00) 00010000:00010000:1.0:1789130336.812335:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130336.812338:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3dc00, rc 0) 00000100:00100000:1.0:1789130336.812420:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:41682:x1876037605079424:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 1981us (2704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130336.812429:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 587 00000100:00100000:1.0:1789130336.816361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130336.816508:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079680 00000100:00100000:2.0:1789130336.816518:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079680 00000100:00100000:2.0:1789130336.816591:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 588 00000100:00100000:2.0:1789130336.816635:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:41682:x1876037605079680:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:2.0:1789130336.816698:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130336.816742:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceaf81 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac427 expref: 67 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.816776:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47cead66 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac386 expref: 66 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.817137:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130336.817149:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130336.817182:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.817197:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.817208:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130336.820187:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bb8dc68a reply state 0000000070b2be32 transno 30064771598 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130336.820210:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789130336.820354:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00000100:00100000:2.0:1789130336.820541:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:41682:x1876037605079680:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 3936us (4186us total) trans 30064771598 rc 0/0 00000100:00100000:2.0:1789130336.820550:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 588 00010000:00010000:0.0:1789130336.823689:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823709:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823717:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823733:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130336.823737:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823746:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823776:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b482b51300) 00010000:00010000:0.0:1789130336.823794:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130336.823800:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.823807:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceaf96 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130336.858767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130336.859010:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079808 00000100:00100000:3.0:1789130336.859021:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079808 00000100:00100000:3.0:1789130336.859090:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 589 00000100:00100000:3.0:1789130336.859102:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+66:41683:x1876037605079808:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:3.0:1789130336.859128:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130336.859151:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceaf9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac435 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859217:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859233:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859245:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859261:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859270:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859276:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859691:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859702:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859709:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130336.859813:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00000004:00200000:3.0:1789130336.859818:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130336.859896:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859910:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859917:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859924:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859930:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130336.859933:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859953:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859966:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57b00) 00010000:00010000:3.0:1789130336.859968:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130336.859973:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859979:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceafa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859991:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.859997:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860002:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860007:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130336.860009:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860015:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860022:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff90b496419c00) 00010000:00010000:3.0:1789130336.860024:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130336.860027:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860037:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceafab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860068:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceaf9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac435 expref: 68 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860080:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac435 expref: 67 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.860086:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:3.0:1789130336.860089:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130336.860091:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35800, rc 0) 00000100:00100000:3.0:1789130336.860154:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+67:41683:x1876037605079808:12345-192.168.201.39@tcp:101:rm.0 Request processed in 1055us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130336.860161:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 589 00000100:00100000:3.0:1789130336.868971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130336.869267:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605079936 00000100:00100000:0.0:1789130336.869277:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605079936 00000100:00100000:0.0:1789130336.869394:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130336.869425:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605079936:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130336.869446:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130336.869468:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac43c expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130336.869505:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 1024, mtime: 0x6aa3f65b, atime: 0x6aa3f65a, ctime: 0x6aa3f65b, blocks: 0xb 00010000:00010000:0.0:1789130336.869535:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=1499s v=(0 0) 00010000:00010000:0.0:1789130336.869540:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130336.869551:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 15 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.869568:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 15 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.869582:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2400, rc 0) 00000100:00100000:0.0:1789130336.869678:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+15:2369:x1876037605079936:12345-192.168.201.39@tcp:101:rm.0 Request processed in 275us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130336.869687:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:1.0:1789130336.882680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130336.882784:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605080192 00000100:00100000:3.0:1789130336.882796:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605080192 00000100:00100000:3.0:1789130336.882853:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 590 00000100:00100000:3.0:1789130336.882864:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:41683:x1876037605080192:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130336.882932:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130336.882971:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceaf49 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac412 expref: 67 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883066:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceae77 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac3da expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883086:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:3.0:1789130336.883099:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130336.883122:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883136:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883148:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883164:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883172:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883178:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883489:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883499:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.883506:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130336.885221:0:36589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].20, 64 off9784 00000004:00080000:3.0:1789130336.885235:0:36589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1499982632068ns, next at 1500982628823ns, rc = 0 00010000:00010000:3.0:1789130336.885374:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885389:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885398:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885534:0:36589:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885541:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885547:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885728:0:36589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130336.885754:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885760:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885766:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885772:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130336.885776:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885784:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885795:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130336.885797:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130336.885802:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885808:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceafce lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885838:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885844:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885849:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885855:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130336.885857:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885864:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885871:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:3.0:1789130336.885873:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130336.885876:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130336.885881:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceafc0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130336.885906:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001fcf786f reply state 0000000052f68739 transno 30064771599 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130336.885916:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130336.886040:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:41683:x1876037605080192:12345-192.168.201.39@tcp:36:rm.0 Request processed in 3174us (3366us total) trans 30064771599 rc 0/0 00000100:00100000:3.0:1789130336.886050:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 590 00010000:00010000:0.0:1789130336.887548:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130336.887559:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.887569:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130336.887572:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.887582:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.887595:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130336.887598:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130336.887777:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.887785:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceafd5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.887807:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130336.887810:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130336.887812:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130336.889377:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889392:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889398:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889413:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130336.889509:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889519:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889535:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b496419200) 00010000:00010000:1.0:1789130336.889538:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130336.889543:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130336.889549:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceafc7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130336.961118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130336.961249:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605080448 00000100:00100000:2.0:1789130336.961259:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605080448 00000100:00100000:2.0:1789130336.961319:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 591 00000100:00100000:2.0:1789130336.961328:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+66:41689:x1876037605080448:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130336.961352:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130336.961372:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceafdc lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac443 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961508:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961523:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961535:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961550:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961556:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130336.961563:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963105:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2000/0x5c74554e47ceaff1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963124:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2000/0x5c74554e47ceaff1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963136:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2000/0x5c74554e47ceaff1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130336.963149:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:0.0:1789130336.963179:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963186:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963193:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963199:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130336.963204:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963211:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963222:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:0.0:1789130336.963225:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130336.963230:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963236:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1e00/0x5c74554e47ceafe3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130336.963250:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b2e998f0 reply state 00000000fa8ebbc4 transno 30064771600 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130336.963259:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130336.963291:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47ceafdc lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac443 expref: 69 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963312:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2000/0x5c74554e47ceaff1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac443 expref: 68 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.963320:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130336.963322:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789130336.963324:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2000, rc 0) 00000100:00100000:0.0:1789130336.963413:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+69:41689:x1876037605080448:12345-192.168.201.39@tcp:101:dd.500 Request processed in 2085us (2303us total) trans 30064771600 rc 0/0 00000100:00100000:0.0:1789130336.963422:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 591 00010000:00010000:0.0:1789130336.965159:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965184:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965192:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965199:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130336.965209:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965217:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965233:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b482b51c00) 00010000:00010000:0.0:1789130336.965237:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130336.965248:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130336.965256:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1a00/0x5c74554e47ceafea lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130336.970322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130336.971775:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605080704 00000100:00100000:2.0:1789130336.971791:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605080704 00000100:00100000:2.0:1789130336.971878:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1789130336.971890:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+68:41689:x1876037605080704:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:2.0:1789130336.973058:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+69:41689:x1876037605080704:12345-192.168.201.39@tcp:35:dd.500 Request processed in 1166us (2742us total) trans 30064771601 rc 0/0 00000100:00100000:2.0:1789130336.973069:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:3.0:1789130337.081170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130337.081350:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605080960 00000100:00100000:2.0:1789130337.081361:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605080960 00000100:00100000:2.0:1789130337.081428:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 592 00000100:00100000:2.0:1789130337.081439:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:41699:x1876037605080960:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130337.081479:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130337.081502:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceafff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac44a expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130337.081716:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00010000:00010000:2.0:1789130337.082111:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceafff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac44a expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.082127:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57b00) 00010000:00010000:2.0:1789130337.082130:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130337.082135:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0200/0x5c74554e47ceafff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac44a expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.082149:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0200, rc 0) 00000100:00100000:2.0:1789130337.082221:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:41699:x1876037605080960:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 783us (1062us total) trans 30064771602 rc 301/301 00000100:00100000:2.0:1789130337.082229:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 592 00000100:00100000:3.0:1789130337.085400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130337.085482:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605081216 00000100:00100000:2.0:1789130337.085493:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605081216 00000100:00100000:2.0:1789130337.085557:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:2.0:1789130337.085568:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+70:41699:x1876037605081216:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130337.086206:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+71:41699:x1876037605081216:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 636us (813us total) trans 30064771603 rc 0/0 00000100:00100000:2.0:1789130337.086215:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:3.0:1789130337.168298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.168560:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605081472 00000100:00100000:1.0:1789130337.168571:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605081472 00000100:00100000:1.0:1789130337.168719:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 593 00000100:00100000:1.0:1789130337.168732:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+71:41705:x1876037605081472:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:1.0:1789130337.168758:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.168781:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb00d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac451 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.168903:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceb014 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.168919:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceb014 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.168943:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceb014 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.168965:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:1.0:1789130337.169112:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb00d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac451 expref: 74 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.169132:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceb014 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac451 expref: 73 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.169141:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.169144:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130337.169148:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d000, rc 0) 00000100:00100000:1.0:1789130337.169225:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:41705:x1876037605081472:12345-192.168.201.39@tcp:101:dd.500 Request processed in 496us (937us total) trans 30064771604 rc 0/0 00000100:00100000:1.0:1789130337.169235:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 593 00000100:00100000:3.0:1789130337.173335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130337.173574:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605081728 00000100:00100000:0.0:1789130337.173585:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605081728 00000100:00100000:0.0:1789130337.173842:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:0.0:1789130337.173855:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+73:41705:x1876037605081728:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:0.0:1789130337.174172:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+74:41705:x1876037605081728:12345-192.168.201.39@tcp:35:dd.500 Request processed in 319us (859us total) trans 30064771605 rc 0/0 00000100:00100000:0.0:1789130337.174182:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000040:00080000:0.0:1789130337.224535:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130337.224545:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130337.224596:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789130337.225157:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130337.291441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130337.291528:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605081984 00000100:00100000:0.0:1789130337.291537:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605081984 00000100:00100000:0.0:1789130337.291590:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 594 00000100:00100000:0.0:1789130337.291598:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+74:41711:x1876037605081984:12345-192.168.201.39@tcp:36:truncate.500 00010000:00010000:0.0:1789130337.291773:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130337.291802:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d000/0x5c74554e47ceb014 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac451 expref: 74 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.291821:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130337.291826:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130337.300128:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.300153:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.300167:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130337.300232:0:38723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771606 00000004:00010000:1.0:1789130337.300258:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007843762c reply state 000000004e647b8f transno 30064771607 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130337.301471:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130337.301842:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+76:41711:x1876037605081984:12345-192.168.201.39@tcp:36:truncate.500 Request processed in 10237us (10487us total) trans 30064771607 rc 0/0 00000100:00100000:1.0:1789130337.301853:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 594 00000020:00080000:1.0:1789130337.301859:0:38723:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130337.313831:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313851:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313860:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313866:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.313871:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313880:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313907:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.313910:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.313916:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.313922:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb022 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130337.422158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.423713:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605082112 00000100:00100000:1.0:1789130337.423730:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605082112 00000100:00100000:1.0:1789130337.423804:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 595 00000100:00100000:1.0:1789130337.423816:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+75:41717:x1876037605082112:12345-192.168.201.39@tcp:101:truncate.500 00010000:00010000:1.0:1789130337.423845:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.423866:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb029 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac458 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.423960:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.423976:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.423987:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.424002:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.424011:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.424017:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.424146:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.424156:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.426954:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.427024:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 256 00000004:00200000:1.0:1789130337.427029:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130337.427051:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427067:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427077:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427084:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427091:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427100:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.427105:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427112:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427128:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:1.0:1789130337.427131:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.427136:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427142:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb030 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427173:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427181:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427187:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427192:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.427195:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427201:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427213:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b491c57900) 00010000:00010000:1.0:1789130337.427216:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.427219:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427225:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb037 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427279:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb029 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac458 expref: 77 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427294:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac458 expref: 76 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.427301:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.427304:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130337.427306:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3cc00, rc 0) 00000100:00100000:1.0:1789130337.427950:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+76:41717:x1876037605082112:12345-192.168.201.39@tcp:101:truncate.500 Request processed in 4132us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130337.427961:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 595 00000100:00100000:3.0:1789130337.433749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.433843:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605082368 00000100:00100000:1.0:1789130337.433854:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605082368 00000100:00100000:1.0:1789130337.433918:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 596 00000100:00100000:1.0:1789130337.433928:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+76:41717:x1876037605082368:12345-192.168.201.39@tcp:36:truncate.500 00010000:00010000:1.0:1789130337.433995:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130337.434027:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb03e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac458 expref: 76 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.434051:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.434057:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130337.434515:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.434530:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.434541:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130337.434595:0:36589:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771608 00000004:00010000:1.0:1789130337.434681:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008c1e898a reply state 000000009391de60 transno 30064771609 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130337.434691:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130337.434783:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:41717:x1876037605082368:12345-192.168.201.39@tcp:36:truncate.500 Request processed in 855us (1043us total) trans 30064771609 rc 0/0 00000100:00100000:1.0:1789130337.434790:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 596 00000020:00080000:1.0:1789130337.434795:0:36589:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130337.437908:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.437942:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.437950:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.437957:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130337.437963:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.437971:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.437988:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130337.437991:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130337.437996:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130337.438003:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d400/0x5c74554e47ceb045 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130337.516700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.517439:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605082624 00000100:00100000:1.0:1789130337.517456:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605082624 00000100:00100000:1.0:1789130337.517549:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 597 00000100:00100000:1.0:1789130337.517662:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+77:41723:x1876037605082624:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:1.0:1789130337.517705:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.517743:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb04c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac45f expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518423:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518447:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518465:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518487:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518495:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.518503:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519025:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceb061 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519038:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceb061 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519048:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceb061 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.519061:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 2048 00010000:00010000:1.0:1789130337.519207:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519221:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519229:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519236:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.519242:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519252:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519267:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:1.0:1789130337.519271:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.519278:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519284:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb053 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519301:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519309:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519316:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519322:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.519325:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519333:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519340:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b491c57900) 00010000:00010000:1.0:1789130337.519343:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.519346:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519353:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb05a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519413:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3cc00/0x5c74554e47ceb04c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac45f expref: 80 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519431:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceb061 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac45f expref: 79 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.519439:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.519442:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789130337.519444:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3da00, rc 0) 00000100:00100000:1.0:1789130337.519867:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+79:41723:x1876037605082624:12345-192.168.201.39@tcp:101:dd.500 Request processed in 2209us (3181us total) trans 30064771610 rc 0/0 00000100:00100000:1.0:1789130337.519879:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 597 00000100:00100000:2.0:1789130337.526205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130337.526290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130337.526373:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605083008 00000100:00100000:3.0:1789130337.526385:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605083008 00000100:00100000:3.0:1789130337.526508:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130337.526521:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+79:2370:x1876037605083008:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130337.526542:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130337.526586:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3da00/0x5c74554e47ceb061 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac45f expref: 79 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130337.526629:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130337.526635:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130337.526708:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:2370:x1876037605083008:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 189us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130337.526716:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130337.536264:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605082880 00000100:00100000:1.0:1789130337.536290:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605082880 00000100:00100000:1.0:1789130337.536401:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 598 00000100:00100000:1.0:1789130337.536415:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+78:41723:x1876037605082880:12345-192.168.201.39@tcp:36:dd.500 00010000:00010000:1.0:1789130337.536877:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.537044:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.537058:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130337.537132:0:38734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771611 00000004:00010000:1.0:1789130337.537162:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001e0c2354 reply state 00000000279ee0dc transno 30064771612 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130337.537173:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130337.537308:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+81:41723:x1876037605082880:12345-192.168.201.39@tcp:36:dd.500 Request processed in 894us (11115us total) trans 30064771612 rc 0/0 00000100:00100000:1.0:1789130337.537317:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 598 00000020:00080000:1.0:1789130337.537324:0:38734:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130337.543276:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543303:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543312:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543319:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3de00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130337.543325:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543333:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543356:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.543359:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130337.543365:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.543371:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb06f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130337.549624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130337.550039:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605083264 00000100:00100000:3.0:1789130337.550052:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605083264 00000100:00100000:3.0:1789130337.550127:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:3.0:1789130337.550140:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+80:41723:x1876037605083264:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:3.0:1789130337.551203:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+81:41723:x1876037605083264:12345-192.168.201.39@tcp:35:dd.500 Request processed in 466us (1017us total) trans 30064771613 rc 0/0 00000100:00100000:3.0:1789130337.551218:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:2.0:1789130337.689330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.689438:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605083520 00000100:00100000:1.0:1789130337.689451:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605083520 00000100:00100000:1.0:1789130337.689531:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 599 00000100:00100000:1.0:1789130337.689541:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+81:41733:x1876037605083520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130337.689578:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.689674:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac466 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.689869:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb07d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.689899:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb07d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.689914:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb07d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.689936:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00010000:00010000:1.0:1789130337.690112:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac466 expref: 84 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.690147:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb07d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac466 expref: 83 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.690156:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:1.0:1789130337.690160:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130337.690165:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d200, rc 0) 00000100:00100000:1.0:1789130337.690238:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+83:41733:x1876037605083520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 698us (921us total) trans 30064771614 rc 0/0 00000100:00100000:1.0:1789130337.690247:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 599 00010000:00010000:1.0:1789130337.737003:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130337.855202:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130337.855363:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605083648 00000100:00100000:2.0:1789130337.855374:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605083648 00000100:00100000:2.0:1789130337.855434:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 600 00000100:00100000:2.0:1789130337.855455:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+83:41739:x1876037605083648:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130337.855481:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130337.855514:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47ceb08b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac46d expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855583:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855599:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855648:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130337.855742:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 7680 00000004:00200000:2.0:1789130337.855746:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130337.855782:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855819:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0400/0x5c74554e47ceb08b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac46d expref: 85 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855845:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac46d expref: 84 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130337.855855:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:2.0:1789130337.855863:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130337.855868:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0800, rc 0) 00000100:00100000:2.0:1789130337.855967:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605083648:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 524us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130337.855976:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 600 00000100:00100000:0.0:1789130337.862745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.862909:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605083776 00000100:00100000:1.0:1789130337.862919:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605083776 00000100:00100000:1.0:1789130337.862993:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 601 00000100:00100000:1.0:1789130337.863005:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605083776:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130337.863027:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.863050:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb099 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac474 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863125:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863140:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863153:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.863201:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00000004:00200000:1.0:1789130337.863206:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130337.863227:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863240:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863264:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb099 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac474 expref: 86 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863282:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac474 expref: 85 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.863291:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.863294:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130337.863298:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c400, rc 0) 00000100:00100000:1.0:1789130337.863362:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+85:41739:x1876037605083776:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 360us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130337.863369:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 601 00000100:00100000:3.0:1789130337.883407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.883846:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084032 00000100:00100000:1.0:1789130337.883857:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084032 00000100:00100000:1.0:1789130337.883945:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 602 00000100:00100000:1.0:1789130337.883955:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+85:41739:x1876037605084032:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130337.883977:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.884000:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb0a7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac47b expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.884115:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0ae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.884129:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.884141:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130337.884152:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:1.0:1789130337.884338:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb0a7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac47b expref: 88 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.884358:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac47b expref: 87 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.884368:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.884371:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130337.884374:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d600, rc 0) 00000100:00100000:1.0:1789130337.884550:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+87:41739:x1876037605084032:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 595us (1153us total) trans 30064771615 rc 0/0 00000100:00100000:1.0:1789130337.884559:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 602 00000100:00100000:0.0:1789130337.889066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.889173:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084288 00000100:00100000:1.0:1789130337.889183:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084288 00000100:00100000:1.0:1789130337.889242:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130337.889252:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+87:41739:x1876037605084288:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130337.889281:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789130337.889309:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0ae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac47b expref: 87 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.889332:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0a0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac474 expref: 86 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.889347:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2000/0x5c74554e47ceaff1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac443 expref: 85 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.889358:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130337.889368:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130337.889425:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876bed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605084288:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 174us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130337.889433:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1789130337.892663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.893766:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084416 00000100:00100000:1.0:1789130337.893779:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084416 00000100:00100000:1.0:1789130337.893844:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 603 00000100:00100000:1.0:1789130337.893855:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605084416:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1789130337.893980:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.893997:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.894008:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130337.894303:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].14, 136 off10096 00000100:00100000:1.0:1789130337.898003:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4876be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605084416:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 4139us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130337.898019:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 603 00000100:00100000:2.0:1789130337.906708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130337.908729:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084544 00000100:00100000:1.0:1789130337.908744:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084544 00000100:00100000:1.0:1789130337.908827:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 604 00000100:00100000:1.0:1789130337.908839:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+84:41739:x1876037605084544:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130337.908862:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130337.908886:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac482 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.908984:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.908997:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 85 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.909018:0:36587:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.909033:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 85 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.909049:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:1.0:1789130337.909052:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130337.909057:0:36587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 85 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130337.909065:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3d600, rc 0) 00000100:00100000:1.0:1789130337.909185:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+85:41739:x1876037605084544:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 347us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130337.909192:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 604 00000001:00080000:3.0:1789130338.128497:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771288 is committed 00000001:00080000:3.0:1789130338.128520:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771287 is committed 00000001:00080000:0.0:1789130338.187561:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771605 is committed 00000020:00080000:0.0:1789130338.187597:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b383c53f00 refcount 2 committed 0 result 0 batchid 25769803915 00000020:00080000:0.0:1789130338.187645:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b383c53540 00000020:00080000:0.0:1789130338.187648:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b483969100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b387b4e400 00000001:00080000:0.0:1789130338.187669:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771615 is committed 00000004:00080000:0.0:1789130338.187711:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000100:00100000:0.0:1789130338.187865:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626863232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789130338.188149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130338.188236:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626863232 00000100:00100000:0.0:1789130338.188244:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626863232 00000100:00100000:0.0:1789130338.188300:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789130338.188310:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626863232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789130338.188339:0:38727:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:207 count 1 00010000:00010000:0.0:1789130338.188366:0:38727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.188390:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 13 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.188399:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789130338.188403:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130338.188409:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.188460:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 13 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.188475:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.188488:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626863360:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130338.188549:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29f00 going to sleep for 11 seconds 00000100:00080000:0.0:1789130338.188561:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1789130338.193296:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803915 committed batchid 25769803914 00000020:00080000:3.0:1789130338.193529:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000100:00100000:3.0:1789130338.194214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.194290:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084672 00000100:00100000:2.0:1789130338.194299:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084672 00010000:00010000:2.0:1789130338.194355:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 14 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.194391:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:2.0:1789130338.194402:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605084672:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130338.194418:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130338.194425:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 14 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.194440:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 14 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.194470:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130338.194475:0:38711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130338.194482:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.194492:0:38711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.194513:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130338.194564:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+14:2370:x1876037605084672:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130338.194572:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00080000:3.0:1789130338.194883:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130338.198758:0:38727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceafb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac43c expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.198786:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:38727:1876037626863360:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130338.198826:0:38727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.199002:0:38727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.199012:0:38727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.199024:0:38727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.199032:0:38727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.199063:0:38727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130338.200272:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382e41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626863232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11958us (12118us total) trans 30064771289 rc 0/0 00000100:00100000:1.0:1789130338.200284:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00010000:0.0:1789130338.200414:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130338.200422:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.200433:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130338.200437:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.200447:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.200468:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.200476:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f26a82a3/0x5c74554e47ceb0ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.200502:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130338.200503:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130338.200505:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130338.200691:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771288 gen 2 00000004:00080000:2.0:1789130338.200699:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3828ea580, transno 30064771286 00000004:00080000:2.0:1789130338.200713:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771288 committed transno 30064771288 00000100:00100000:2.0:1789130338.200738:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b382e40780 x1876037626863232/t30064771289(30064771289) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130354 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789130338.200750:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b382e40780/2, rc 0, transno 30064771289 00000100:00100000:2.0:1789130338.200757:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382e40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626863232:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1789130338.245824:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130338.245833:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130338.246159:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 15 count 6 00000040:00080000:0.0:1789130338.246168:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789130338.246298:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626863488:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130338.246403:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130338.261173:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626863488:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130338.262382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.265289:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084800 00000100:00100000:1.0:1789130338.265303:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084800 00000100:00100000:1.0:1789130338.265389:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 605 00000100:00100000:1.0:1789130338.265399:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:41740:x1876037605084800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130338.265431:0:38723:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x3b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130338.265533:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:41740:x1876037605084800:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 135us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.265555:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 605 00000100:00080000:3.0:1789130338.266309:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130338.275822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.276482:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605084928 00000100:00100000:0.0:1789130338.276493:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605084928 00000100:00100000:0.0:1789130338.276552:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 606 00000100:00100000:0.0:1789130338.276563:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:41740:x1876037605084928:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789130338.276668:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276685:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276710:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276726:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276734:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276741:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276762:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276770:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.276777:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130338.277199:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00000004:00200000:0.0:1789130338.277204:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130338.277216:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277229:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277236:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277243:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277249:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130338.277254:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277261:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277275:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130338.277278:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130338.277283:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277290:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb0d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277302:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277308:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277314:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277320:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130338.277322:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277328:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277335:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x397b4152 (ffff90b497c01f00) 00010000:00010000:0.0:1789130338.277337:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130338.277340:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277346:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x397b4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277364:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277371:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277376:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277381:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130338.277384:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277390:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277397:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:0.0:1789130338.277399:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130338.277402:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.277407:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb0df lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.277482:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4be5f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:41740:x1876037605084928:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 918us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.277491:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 606 00000100:00100000:0.0:1789130338.284910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.285058:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605085184 00000100:00100000:3.0:1789130338.285066:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605085184 00000100:00100000:3.0:1789130338.285116:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 607 00000100:00100000:3.0:1789130338.285123:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+53:41740:x1876037605085184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130338.285142:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130338.285160:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb0e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac489 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285250:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285262:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285274:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130338.285282:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:3.0:1789130338.285397:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285402:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285407:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285411:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130338.285414:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285419:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285428:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:3.0:1789130338.285430:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130338.285435:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285441:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb0ed lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285497:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb0e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac489 expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285513:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130338.285515:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130338.285519:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb0e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac489 expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.285528:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34800, rc 0) 00000100:00100000:3.0:1789130338.285586:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 463us (689us total) trans 30064771616 rc 301/301 00000100:00100000:3.0:1789130338.285592:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 607 00000100:00100000:2.0:1789130338.288930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.289104:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605085312 00000100:00100000:3.0:1789130338.289113:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605085312 00000100:00100000:3.0:1789130338.289161:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 608 00000100:00100000:3.0:1789130338.289167:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085312:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130338.289199:0:38734:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x3b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130338.289289:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085312:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 122us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130338.289294:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 608 00000100:00100000:2.0:1789130338.300045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.300177:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605085568 00000100:00100000:0.0:1789130338.300186:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605085568 00000100:00100000:0.0:1789130338.300267:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 609 00000100:00100000:0.0:1789130338.300274:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130338.300293:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130338.300295:0:36589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130338.300318:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0800/0x5c74554e47ceb092 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac46d expref: 54 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.300332:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:0.0:1789130338.300335:0:36589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130338.300346:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0fb lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac490 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130338.301222:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd0:0x0], index 1: 0 00010000:00010000:0.0:1789130338.301496:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb102 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.301511:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb102 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.301523:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb102 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.301585:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb0fb lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac490 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.301637:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb102 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac490 expref: 55 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.301646:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130338.301650:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130338.301652:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2400, rc 0) 00000100:00100000:0.0:1789130338.301724:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605085568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1448us (1685us total) trans 30064771617 rc 0/0 00000100:00100000:0.0:1789130338.301733:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 609 00000100:00100000:0.0:1789130338.309176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.309341:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605085824 00000100:00100000:3.0:1789130338.309353:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605085824 00000100:00100000:3.0:1789130338.309418:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 610 00000100:00100000:3.0:1789130338.309429:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605085824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130338.309497:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130338.309525:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb102 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac490 expref: 55 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309549:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:3.0:1789130338.309561:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130338.309582:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309596:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309768:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309794:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309802:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.309808:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310104:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310113:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310120:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310127:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130338.310132:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310141:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310151:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:3.0:1789130338.310154:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130338.310157:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310163:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb110 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310172:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310178:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310184:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310189:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130338.310375:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310383:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310393:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x99683ed5 (ffff90b496419c00) 00010000:00010000:3.0:1789130338.310395:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130338.310398:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.310405:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb117 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x99683ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130338.310558:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1129us (1390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130338.310567:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 610 00000100:00100000:3.0:1789130338.317304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.317562:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605085952 00000100:00100000:2.0:1789130338.317574:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605085952 00000100:00100000:2.0:1789130338.317673:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 611 00000100:00100000:2.0:1789130338.317685:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605085952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130338.317713:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130338.317745:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceb11e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac497 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.317810:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.317826:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.317838:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.318020:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47ceb11e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 56 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.318040:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.318047:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130338.318051:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130338.318054:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130338.318292:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605085952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 608us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130338.318300:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 611 00000100:00100000:2.0:1789130338.328379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.328507:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605086208 00000100:00100000:1.0:1789130338.328518:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605086208 00000100:00100000:1.0:1789130338.328588:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 612 00000100:00100000:1.0:1789130338.328628:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605086208:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130338.328949:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.328967:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.328979:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130338.329821:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].21, 88 off9800 00000004:00080000:1.0:1789130338.329840:0:38723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1501427237308ns, next at 1502427232175ns, rc = 0 00000004:00010000:1.0:1789130338.329946:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fca2f74d reply state 00000000cd4aa36a transno 30064771618 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.329957:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130338.330076:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+57:41740:x1876037605086208:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1476us (1708us total) trans 30064771618 rc 0/0 00000100:00100000:1.0:1789130338.330085:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 612 00010000:00010000:0.0:1789130338.344200:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344218:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344226:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344232:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3de00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130338.344237:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344245:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344263:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130338.344266:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130338.344270:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.344276:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3de00/0x5c74554e47ceb12c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.348305:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.348461:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605086336 00000100:00100000:3.0:1789130338.348470:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605086336 00000100:00100000:3.0:1789130338.348532:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 613 00000100:00100000:3.0:1789130338.348542:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+56:41740:x1876037605086336:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130338.348567:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130338.348589:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac49e expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.348681:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.348696:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 57 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.348715:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:3.0:1789130338.348719:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130338.348724:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35200, rc 0) 00000100:00100000:3.0:1789130338.349142:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:41740:x1876037605086336:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 238us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130338.349157:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 613 00000100:00100000:2.0:1789130338.357514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.357595:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605086464 00000100:00100000:0.0:1789130338.357640:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605086464 00000100:00100000:0.0:1789130338.357715:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:0.0:1789130338.357726:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605086464:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789130338.358197:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:587d445f-41ce-47d3-97fe-edc16e866648+11:2370:x1876037605086464:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 471us (691us total) trans 30064771222 rc 0/0 00000100:00100000:0.0:1789130338.358206:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00080000:3.0:1789130338.360470:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130338.366040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.366138:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605086720 00000100:00100000:3.0:1789130338.366149:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605086720 00000100:00100000:3.0:1789130338.366417:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:3.0:1789130338.366428:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:41740:x1876037605086720:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130338.369490:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41740:x1876037605086720:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3051us (3447us total) trans 30064771619 rc 0/0 00000100:00100000:2.0:1789130338.369505:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:2.0:1789130338.379580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.380021:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605086976 00000100:00100000:1.0:1789130338.380033:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605086976 00000100:00100000:1.0:1789130338.380102:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 614 00000100:00100000:1.0:1789130338.380113:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41740:x1876037605086976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130338.385035:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41740:x1876037605086976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 4912us (5456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.385053:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 614 00000100:00100000:0.0:1789130338.388686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.388768:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087104 00000100:00100000:1.0:1789130338.388789:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087104 00000100:00100000:1.0:1789130338.388849:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 615 00000100:00100000:1.0:1789130338.388859:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+58:41740:x1876037605087104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130338.388891:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130338.389053:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceb13a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4a5 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389139:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389153:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389166:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130338.389285:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130338.389307:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389336:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d800/0x5c74554e47ceb13a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4a5 expref: 60 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389353:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4a5 expref: 59 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.389361:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130338.389365:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130338.389369:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ca00, rc 0) 00000100:00100000:1.0:1789130338.389479:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+59:41740:x1876037605087104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 621us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.389486:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 615 00000100:00100000:2.0:1789130338.398553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.398651:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087232 00000100:00100000:0.0:1789130338.398662:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087232 00000100:00100000:0.0:1789130338.398722:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:0.0:1789130338.398733:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605087232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130338.398752:0:37273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130338.398774:0:37273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4ac expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130338.398820:0:37273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f662, blocks: 0x1 00010000:00010000:0.0:1789130338.398840:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=1501s v=(0 0) 00010000:00010000:0.0:1789130338.398845:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130338.398855:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 12 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.398876:0:37273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 12 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.398923:0:37273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130338.399009:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605087232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 278us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.399018:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:2.0:1789130338.402587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.402698:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087488 00000100:00100000:3.0:1789130338.402708:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087488 00000100:00100000:3.0:1789130338.402762:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 616 00000100:00100000:3.0:1789130338.402771:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab0f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:41740:x1876037605087488:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130338.403120:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab0f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:41740:x1876037605087488:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 347us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130338.403129:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 616 00000100:00100000:1.0:1789130338.409855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.410039:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087616 00000100:00100000:3.0:1789130338.410051:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087616 00000100:00100000:3.0:1789130338.410113:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1789130338.410124:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:41740:x1876037605087616:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130338.410145:0:38727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130338.410167:0:38727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4b3 expref: -99 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.410214:0:38727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.410224:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130338.410229:0:38727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130338.410235:0:38727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.410271:0:38727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130338.410286:0:38727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130338.410301:0:38727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626863616:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130338.410393:0:38727:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383c53540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130338.414811:0:38727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:38727:1876037626863616:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130338.414855:0:38727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.414890:0:38727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34800, rc 0) 00000100:00100000:1.0:1789130338.416115:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:41740:x1876037605087616:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5985us (6263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.416128:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1789130338.417442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.418299:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087744 00000100:00100000:1.0:1789130338.418310:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087744 00010000:00010000:1.0:1789130338.418361:0:36573:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.418446:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789130338.418457:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605087744:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130338.418474:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130338.418499:0:36573:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.418513:0:36573:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.418536:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ceb148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ac expref: 13 pid: 37273 timeout: 1601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.418566:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130338.418570:0:36573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130338.418579:0:36573:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.418589:0:36573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.418668:0:36573:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.418684:0:36573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626863744:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130338.418775:0:36573:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130338.425636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.425670:0:39571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605087872 00000100:00100000:3.0:1789130338.425680:0:39571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605087872 00002000:00100000:3.0:1789130338.425735:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd0:0x0] (0->1023) req@ffff90b3897d2d00 x1876037605087872/t0(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:54/0 lens 1512/0 e 0 to 0 dl 1789130349 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130338.425748:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d2d00 with x1876037605087872 ext(0->1023) 00002000:00010000:3.0:1789130338.425754:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d2d00 00000100:00100000:3.0:1789130338.425795:0:39571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 372 00000100:00100000:3.0:1789130338.425805:0:39571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605087872:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789130338.426151:0:36573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:36573:1876037626863744:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130338.426181:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130338.426240:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605087744:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 7785us (8805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.426249:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:3.0:1789130338.427529:0:39571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605087872:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 1718us (1922us total) trans 30064771223 rc 0/0 00000100:00100000:3.0:1789130338.427541:0:39571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 372 00002000:00100000:3.0:1789130338.427551:0:39571:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd0:0x0] (0->1023) req@ffff90b3897d2d00 x1876037605087872/t30064771223(0) o4->587d445f-41ce-47d3-97fe-edc16e866648@192.168.201.39@tcp:54/0 lens 1512/448 e 0 to 0 dl 1789130349 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130338.427575:0:39571:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d2d00 with x1876037605087872 ext(0->1023) 00002000:00010000:3.0:1789130338.427581:0:39571:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d2d00 00000100:00100000:2.0:1789130338.432008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.432088:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088000 00000100:00100000:1.0:1789130338.432097:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088000 00000100:00100000:1.0:1789130338.432198:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 617 00000100:00100000:1.0:1789130338.432209:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:41740:x1876037605088000:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789130338.506429:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771617 is committed 00000001:00080000:0.0:1789130338.506450:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771618 is committed 00000004:00080000:0.0:1789130338.506454:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000001:00080000:0.0:1789130338.506466:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771619 is committed 00000020:00080000:0.0:1789130338.506474:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803915 batchid updated 00000100:00100000:1.0:1789130338.506552:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605088000:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 74340us (74547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130338.506564:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 617 00000020:00080000:0.0:1789130338.506576:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803915 00000020:00080000:0.0:1789130338.506585:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803915 00000100:00100000:0.0:1789130338.506597:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626863872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789130338.506673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130338.506735:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626863872 00000100:00100000:0.0:1789130338.506743:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626863872 00000100:00100000:0.0:1789130338.506806:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789130338.506816:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626863872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789130338.507014:0:37658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1789130338.507018:0:37658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb mtime from disk: 0 -> 1789130338 00002000:00010000:0.0:1789130338.507020:0:37658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130338.507022:0:37658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb ctime from disk: 1789130338 -> 1789130338 00002000:00010000:0.0:1789130338.507024:0:37658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130338.507061:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626863872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (387us total) trans 30064771224 rc 0/0 00000100:00100000:0.0:1789130338.507070:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000004:00080000:0.0:1789130338.507118:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b390cecb40/2, rc 0, transno 30064771224 00000100:00100000:0.0:1789130338.507124:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626863872:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789130338.507232:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130338.509311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.509399:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088128 00000100:00100000:2.0:1789130338.509409:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088128 00000100:00100000:2.0:1789130338.509466:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:2.0:1789130338.509477:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:2369:x1876037605088128:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789130338.588314:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771224 is committed 00000001:00080000:0.0:1789130338.588331:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771222 is committed 00000001:00080000:1.0:1789130338.588508:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771223 is committed 00000100:00100000:3.0:1789130338.589501:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605088128:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 80018us (80193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130338.589515:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1789130338.599522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.599782:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088384 00000100:00100000:2.0:1789130338.599807:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088384 00000100:00100000:2.0:1789130338.599887:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 618 00000100:00100000:2.0:1789130338.599900:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605088384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130338.599978:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130338.600011:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb141 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4a5 expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.600033:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130338.600039:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130338.600071:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.600085:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.600094:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130338.600325:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cf7c515b reply state 000000006fd9362c transno 30064771620 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.600332:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130338.601277:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:41740:x1876037605088384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1377us (1763us total) trans 30064771620 rc 0/0 00000100:00100000:2.0:1789130338.601286:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 618 00010000:00010000:1.0:1789130338.607155:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607174:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607182:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607189:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130338.607194:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607203:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607221:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130338.607223:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130338.607228:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.607235:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47ceb156 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.608652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130338.608963:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088512 00000100:00100000:3.0:1789130338.608974:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088512 00000100:00100000:3.0:1789130338.609034:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:3.0:1789130338.609046:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2369:x1876037605088512:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789130338.609324:0:38727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1789130338.609328:0:38727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb mtime from disk: 1789130338 -> 1789130337 00002000:00010000:3.0:1789130338.609330:0:38727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb atime from disk: 0 -> 1789130336 00002000:00010000:3.0:1789130338.609333:0:38727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb ctime from disk: 1789130338 -> 1789130337 00002000:00010000:3.0:1789130338.609335:0:38727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xd0:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789130338.609408:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+12:2369:x1876037605088512:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 364us (765us total) trans 30064771225 rc 0/0 00000100:00100000:3.0:1789130338.609416:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:2.0:1789130338.615695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130338.615960:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088768 00000100:00100000:1.0:1789130338.615971:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088768 00000100:00100000:1.0:1789130338.616032:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 619 00000100:00100000:1.0:1789130338.616043:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:41740:x1876037605088768:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789130338.616129:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.616147:0:36588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.616156:0:36588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.616187:0:36588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.616201:0:36588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 55 pid: 36587 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.616216:0:36588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626864000:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130338.616303:0:36588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130338.622578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.622682:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605088896 00000100:00100000:0.0:1789130338.622691:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605088896 00010000:00010000:0.0:1789130338.622729:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 56 pid: 36587 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.622769:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:0.0:1789130338.622778:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:2370:x1876037605088896:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130338.622809:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130338.622817:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 56 pid: 36587 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.622831:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 56 pid: 36587 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.622853:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130338.623048:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.623061:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.623070:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.623090:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130338.623154:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:2370:x1876037605088896:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 376us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.623162:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00010000:00010000:2.0:1789130338.624146:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb125 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac497 expref: 55 pid: 36587 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.624167:0:36588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fda580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:36588:1876037626864000:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130338.624200:0:36588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624209:0:36588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624219:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624246:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624253:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624260:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624266:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.624269:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624276:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624288:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130338.624397:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130338.624402:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.624408:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb15d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.624478:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605088768:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 8436us (8792us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130338.624487:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 619 00000100:00100000:1.0:1789130338.629664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.629825:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089024 00000100:00100000:0.0:1789130338.629837:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089024 00000100:00100000:0.0:1789130338.629919:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:0.0:1789130338.630035:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2367:x1876037605089024:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789130338.630085:0:37273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.630105:0:37273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.630114:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130338.630119:0:37273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130338.630124:0:37273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.630162:0:37273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.630177:0:37273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 12 pid: 38727 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.630202:0:37273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:37273:1876037626864128:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130338.630283:0:37273:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130338.634169:0:37273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:37273:1876037626864128:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130338.634208:0:37273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130338.635757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.636485:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089152 00000100:00100000:0.0:1789130338.636497:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089152 00010000:00010000:0.0:1789130338.636552:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.636595:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130338.636676:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605089152:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130338.636695:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130338.636723:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.636737:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.638141:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007753e52c/0x5c74554e47ceb14f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4b3 expref: 13 pid: 38727 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.638176:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130338.638181:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130338.638262:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.638275:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.638451:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130338.638533:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+12:2370:x1876037605089152:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1856us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.638546:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00010000:00010000:2.0:1789130338.641151:0:37273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641173:0:37273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641269:0:37273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641278:0:37273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641286:0:37273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641362:0:37273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130338.641367:0:37273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641377:0:37273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641396:0:37273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.641405:0:37273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a99f2f/0x5c74554e47ceb164 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.641662:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605089024:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 11729us (12004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130338.641673:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789130338.646362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.646784:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089408 00000100:00100000:2.0:1789130338.646996:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089408 00000100:00100000:2.0:1789130338.647120:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 620 00000100:00100000:2.0:1789130338.647134:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:41740:x1876037605089408:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130338.647233:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647250:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647262:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647475:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647487:0:36587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647496:0:36587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647531:0:36587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 55 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.647564:0:36587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 55 pid: 36588 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.647578:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626864256:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130338.647704:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130338.654564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.655115:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089536 00000100:00100000:0.0:1789130338.655125:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089536 00010000:00010000:0.0:1789130338.655172:0:38711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 56 pid: 36588 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130338.655422:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789130338.655434:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:2369:x1876037605089536:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130338.655452:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130338.655460:0:38711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 56 pid: 36588 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.655475:0:38711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 56 pid: 36588 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.655499:0:38711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130338.655506:0:38711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.655516:0:38711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.655523:0:38711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.655560:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130338.655632:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:2369:x1876037605089536:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 200us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.655640:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00010000:00010000:2.0:1789130338.660508:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb133 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac49e expref: 55 pid: 36588 timeout: 1601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.660781:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626864256:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130338.660814:0:36587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.660826:0:36587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.660832:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130338.661057:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771621 00000001:00080000:2.0:1789130338.661207:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771622 00000001:00080000:2.0:1789130338.661248:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771623 00000100:00100000:2.0:1789130338.661346:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626864384:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130338.661414:0:36587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130338.661454:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487ec2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130338.661816:0:36592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626864384 00000100:00100000:0.0:1789130338.661824:0:36592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626864384 00000100:00100000:0.0:1789130338.661881:0:36592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130338.661891:0:36592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626864384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130338.662024:0:36592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626864384:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.662032:0:36592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130338.662763:0:36587:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771224 gen 2 00000004:00080000:2.0:1789130338.662772:0:36587:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b390cecb40, transno 30064771224 00000100:00100000:2.0:1789130338.662782:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626864384:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789130338.663325:0:36587:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771624 00000100:00100000:2.0:1789130338.663397:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626864512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130338.663440:0:36587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130338.663467:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4917610c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130338.664143:0:40999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626864512 00000100:00100000:1.0:1789130338.664152:0:40999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626864512 00000100:00100000:1.0:1789130338.664216:0:40999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789130338.664226:0:40999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:36587:x1876037626864512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130338.664432:0:40999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:36587:x1876037626864512:12345-0@lo:1000:mdt00_000.0 Request processed in 207us (990us total) trans 30064771226 rc 0/0 00000100:00100000:1.0:1789130338.664441:0:40999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130338.665162:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:36587:1876037626864512:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789130338.665212:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665224:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665232:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665237:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.665242:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665250:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665266:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130338.665269:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130338.665275:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665282:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb172 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665467:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665476:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665483:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665488:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.665491:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665498:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665507:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:2.0:1789130338.665510:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130338.665518:0:36587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 58 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665530:0:36587:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 58 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665554:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 58 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.665587:0:36587:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 58 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.665630:0:36587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626864640:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130338.665715:0:36587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4917610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130338.671302:0:36587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:36587:1876037626864640:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130338.671333:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671344:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c400/0x5c74554e47ceb0bc lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671376:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671389:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671401:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671412:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671418:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671424:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671430:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.671433:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671441:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671456:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:2.0:1789130338.671459:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130338.671463:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671469:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb179 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671478:0:36587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671484:0:36587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671490:0:36587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671494:0:36587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.671497:0:36587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671503:0:36587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671510:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:2.0:1789130338.671512:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130338.671515:0:36587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.671520:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb16b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130338.671776:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41740:x1876037605089408:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 24645us (25484us total) trans 30064771625 rc 0/0 00000100:00100000:2.0:1789130338.671787:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 620 00000020:00080000:2.0:1789130338.671793:0:36587:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789130338.672174:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130338.672179:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130338.672803:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 6 00000040:00080000:0.0:1789130338.672811:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130338.673249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.674037:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089664 00000100:00100000:0.0:1789130338.674049:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089664 00000100:00100000:0.0:1789130338.674119:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:0.0:1789130338.674129:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41739:x1876037605089664:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:0.0:1789130338.674380:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+58:41739:x1876037605089664:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 251us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130338.674388:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130338.679268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.679392:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605089920 00000100:00100000:2.0:1789130338.679401:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605089920 00000100:00100000:2.0:1789130338.679458:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 621 00000100:00100000:2.0:1789130338.679468:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+58:41739:x1876037605089920:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:2.0:1789130338.679889:0:38723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].15, 136 off10232 00000100:00100000:2.0:1789130338.679998:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+58:41739:x1876037605089920:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 530us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130338.680006:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 621 00000100:00100000:1.0:1789130338.683279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.683491:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605090176 00000100:00100000:2.0:1789130338.683502:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605090176 00000100:00100000:2.0:1789130338.683564:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:2.0:1789130338.683575:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+58:41739:x1876037605090176:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:2.0:1789130338.683876:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:41739:x1876037605090176:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 288us (591us total) trans 30064771626 rc 0/0 00000100:00100000:2.0:1789130338.683885:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:3.0:1789130338.691185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130338.691287:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605090432 00000100:00100000:0.0:1789130338.691306:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605090432 00000100:00100000:0.0:1789130338.691362:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:0.0:1789130338.691373:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:41740:x1876037605090432:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130338.692139:0:36590:0:(mdd_object.c:4024:mdd_close()) Object [0x2000032e1:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789130338.692244:0:36590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771627 00010000:00010000:0.0:1789130338.692293:0:36590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692310:0:36590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692322:0:36590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692332:0:36590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692339:0:36590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692345:0:36590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130338.692357:0:36590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130338.692451:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:41740:x1876037605090432:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1078us (1274us total) trans 30064771628 rc 0/0 00000100:00100000:0.0:1789130338.692460:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000020:00080000:0.0:1789130338.692465:0:36590:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130338.693838:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130338.693849:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.693868:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130338.693873:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.693882:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.693898:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3d:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130338.693901:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130338.693906:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.693920:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb180 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130338.693947:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130338.693950:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130338.693952:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130338.734239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130338.734337:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605090560 00000100:00100000:2.0:1789130338.734349:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605090560 00000100:00100000:2.0:1789130338.734414:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 622 00000100:00100000:2.0:1789130338.734424:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+61:41742:x1876037605090560:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130338.734449:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130338.734472:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb187 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4ba expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734550:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734565:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734577:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734593:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734640:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734649:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.734991:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735001:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735009:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130338.735043:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 2048 00000004:00200000:2.0:1789130338.735048:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130338.735067:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735084:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735092:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735099:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735105:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735112:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.735117:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735124:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735136:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:2.0:1789130338.735139:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130338.735143:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735150:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb18e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735162:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735168:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735175:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735180:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130338.735182:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735188:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735196:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff90b482b51700) 00010000:00010000:2.0:1789130338.735198:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130338.735201:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735207:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb195 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735238:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb187 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ba expref: 63 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735251:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ba expref: 62 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130338.735259:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:2.0:1789130338.735262:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130338.735264:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1400, rc 0) 00000100:00100000:2.0:1789130338.735342:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:41742:x1876037605090560:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 919us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130338.735354:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 622 00010000:00010000:0.0:1789130338.758680:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130339.595272:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626864768:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595390:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626865280:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789130339.595450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626864896:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595497:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626865408:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595545:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626865152:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595586:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130339.595591:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595640:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.595669:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626864768 00000100:00100000:2.0:1789130339.595675:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626864768 00000100:00100000:2.0:1789130339.595721:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789130339.595730:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626864768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595778:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626864768:12345-0@lo:400:kworker.0 Request processed in 50us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.595786:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789130339.595817:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865280 00000100:00100000:2.0:1789130339.595821:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865280 00000100:00100000:2.0:1789130339.595868:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865408 00000100:00100000:2.0:1789130339.595872:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865408 00000100:00100000:2.0:1789130339.595904:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865152 00000100:00100000:2.0:1789130339.595908:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865152 00000100:00100000:2.0:1789130339.595920:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789130339.595926:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626865280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.595959:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626865280:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.595966:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789130339.595977:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789130339.595983:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596009:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626865408:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.596015:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789130339.596025:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789130339.596031:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596061:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626865152:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.596067:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789130339.596085:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626864896 00000100:00100000:2.0:1789130339.596089:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626864896 00000100:00100000:2.0:1789130339.596112:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865024 00000100:00100000:2.0:1789130339.596115:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865024 00000100:00100000:2.0:1789130339.596133:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789130339.596140:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596169:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626864896:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.596175:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789130339.596185:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789130339.596191:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626865024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596216:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626865024:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.596222:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789130339.596271:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626864896:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596283:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626865408:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596291:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626864768:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596299:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626865280:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596339:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789130339.596348:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626865152:0@lo:400:kworker.0 00000100:00080000:1.0:1789130339.597981:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130339.599039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626865536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130339.599109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130339.599219:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865536 00000100:00100000:2.0:1789130339.599227:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865536 00000100:00100000:2.0:1789130339.599284:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789130339.599293:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626865536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130339.599317:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 0 free 3767533568 avail 3764387840 00000100:00100000:2.0:1789130339.608998:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626865536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9695us (9879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130339.609013:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130339.614833:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626865536:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789130339.720339:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130339.720349:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130339.720392:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:1.0:1789130339.720400:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130339.720529:0:36624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626865664:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130339.720779:0:36624:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130339.743318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130339.743351:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605090688 00000100:00100000:1.0:1789130339.743359:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605090688 00000100:00100000:1.0:1789130339.743406:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 623 00000100:00100000:1.0:1789130339.743415:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:41753:x1876037605090688:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130339.743446:0:36587:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000032e1:0x3b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130339.743542:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:41753:x1876037605090688:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130339.743551:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 623 00000100:00100000:3.0:1789130339.745224:0:36624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:36624:1876037626865664:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130339.757260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130339.757311:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605090944 00000100:00100000:3.0:1789130339.757322:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605090944 00000100:00100000:3.0:1789130339.757378:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 624 00000100:00100000:3.0:1789130339.757389:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+62:41753:x1876037605090944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130339.757413:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130339.757439:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4c1 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.757541:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb1aa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.757557:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb1aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.757570:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb1aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130339.757580:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 2048 00010000:00010000:3.0:1789130339.757725:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c1 expref: 65 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.757744:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb1aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c1 expref: 64 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.757753:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:3.0:1789130339.757756:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130339.757760:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35400, rc 0) 00000100:00100000:3.0:1789130339.757815:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+64:41753:x1876037605090944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 429us (609us total) trans 30064771629 rc 0/0 00000100:00100000:3.0:1789130339.757824:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 624 00000100:00100000:1.0:1789130339.763712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130339.763767:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091072 00000100:00100000:1.0:1789130339.763777:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091072 00000100:00100000:1.0:1789130339.763851:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130339.763861:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:2368:x1876037605091072:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130339.763876:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130339.763915:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb1aa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c1 expref: 64 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130339.763932:0:36572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:1.0:1789130339.763938:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130339.763994:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:2368:x1876037605091072:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 134us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130339.764002:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000040:00080000:0.0:1789130339.765160:0:41628:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130339.765169:0:41628:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130339.765229:0:41628:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:0.0:1789130339.765237:0:41628:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789130339.786927:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130339.787671:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130339.790032:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091328 00000100:00100000:3.0:1789130339.790050:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091328 00000100:00100000:3.0:1789130339.790131:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 625 00000100:00100000:3.0:1789130339.790143:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+63:41753:x1876037605091328:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789130339.790231:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790249:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790262:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790559:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790568:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790576:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790583:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130339.790587:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790594:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790627:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:3.0:1789130339.790630:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130339.790636:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130339.790646:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1b8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130339.790815:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:41753:x1876037605091328:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 673us (3147us total) trans 30064771630 rc 0/0 00000100:00100000:3.0:1789130339.790824:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 625 00000040:00080000:3.0:1789130339.796556:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130339.796566:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130339.799725:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 7 00000040:00080000:3.0:1789130339.799743:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789130339.813540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130339.813628:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091584 00000100:00100000:0.0:1789130339.813638:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091584 00000100:00100000:0.0:1789130339.813695:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:0.0:1789130339.813706:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:41753:x1876037605091584:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130339.814012:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+65:41753:x1876037605091584:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 307us (481us total) trans 30064771631 rc 0/0 00000100:00100000:0.0:1789130339.814020:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:0.0:1789130340.615832:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626865792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130340.615932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130340.617764:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865792 00000100:00100000:3.0:1789130340.617777:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865792 00000100:00100000:3.0:1789130340.617857:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130340.617869:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626865792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130340.617921:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00080000:1.0:1789130340.619149:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130340.625390:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626865792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7513us (9446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130340.625404:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130340.628622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626865792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130340.806127:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130340.892519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130340.892562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130340.892591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130340.892686:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091968 00000100:00100000:3.0:1789130340.892695:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091968 00000100:00100000:3.0:1789130340.892747:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1789130340.892757:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605091968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130340.892842:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605091968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130340.892849:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00080000:3.0:1789130340.892989:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130340.893118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130340.893161:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091712 00000100:00100000:2.0:1789130340.893164:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091712 00000100:00100000:2.0:1789130340.893196:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1789130340.893203:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605091712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130340.893238:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605091712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130340.893245:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:0.0:1789130340.897980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130340.900577:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092224 00000100:00100000:1.0:1789130340.900592:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092224 00000100:00100000:1.0:1789130340.900709:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605091840 00000100:00100000:1.0:1789130340.900713:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605091840 00000100:00100000:1.0:1789130340.900748:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:1.0:1789130340.900759:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605092224:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130340.900851:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605092224:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 93us (8258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130340.900859:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:1.0:1789130340.900886:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:1.0:1789130340.900893:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+65:2367:x1876037605091840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130340.900923:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+65:2367:x1876037605091840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (7804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130340.901342:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092096 00000100:00100000:2.0:1789130340.901348:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092096 00000100:00100000:2.0:1789130340.901396:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:2.0:1789130340.901405:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605092096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130340.901436:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+11:2367:x1876037605092096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130340.901442:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00080000:0.0:1789130340.901954:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130340.901960:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130340.902216:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 248 00010000:00010000:1.0:1789130341.831137:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130341.956679:0:41679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130341.956695:0:41679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130341.956759:0:41679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:3.0:1789130341.956767:0:41679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130342.854367:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130343.296228:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771289 is committed 00000001:00080000:0.0:1789130343.828255:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771226 is committed 00000001:00080000:0.0:1789130343.828281:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771225 is committed 00000001:00080000:0.0:1789130343.844572:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771631 is committed 00000020:00080000:0.0:1789130343.844649:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487ec2d80 refcount 2 committed 0 result 0 batchid 25769803916 00000020:00080000:0.0:1789130343.844657:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381f0c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487ec2600 00000020:00080000:0.0:1789130343.844661:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b381f0c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b381191000 00000020:00080000:2.0:1789130343.844944:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803916 committed batchid 25769803915 00000020:00080000:2.0:1789130343.845188:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803915 00010000:00010000:3.0:1789130343.877769:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130344.710588:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626866304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.710690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130344.710930:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866304 00000100:00100000:3.0:1789130344.710941:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866304 00000100:00100000:3.0:1789130344.710999:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789130344.711010:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626866304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130344.711081:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626866304:12345-0@lo:400:kworker.0 Request processed in 72us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130344.711089:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789130344.711177:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626866304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711196:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789130344.711204:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711275:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130344.711300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711359:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626866048:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711405:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626866560:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711449:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789130344.711455:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626865920:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711510:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130344.711594:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866560 00000100:00100000:0.0:1789130344.711624:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866560 00000100:00100000:0.0:1789130344.711656:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866432 00000100:00100000:0.0:1789130344.711658:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866432 00000100:00100000:0.0:1789130344.711674:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789130344.711678:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626866560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711708:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626866560:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130344.711716:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789130344.711727:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789130344.711730:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626866432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711746:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626866432:12345-0@lo:400:kworker.0 Request processed in 16us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130344.711751:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:0.0:1789130344.711768:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130344.711792:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789130344.711817:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626866560:0@lo:400:kworker.0 00000100:00100000:3.0:1789130344.711894:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866176 00000100:00100000:3.0:1789130344.711898:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866176 00000100:00100000:3.0:1789130344.711930:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866048 00000100:00100000:3.0:1789130344.711932:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866048 00000100:00100000:3.0:1789130344.711946:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789130344.711951:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130344.711984:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866176:12345-0@lo:400:kworker.0 Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130344.711988:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789130344.711996:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789130344.712000:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626866048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130344.712019:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626866048:12345-0@lo:400:kworker.0 Request processed in 19us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130344.712023:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789130344.712053:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771289 gen 2 00000004:00080000:3.0:1789130344.712060:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b382e40780, transno 30064771289 00000100:00100000:3.0:1789130344.712073:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626866048:0@lo:400:kworker.0 00000100:00100000:3.0:1789130344.712505:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771226 gen 2 00000004:00080000:3.0:1789130344.712513:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771226 committed transno 30064771226 00000100:00100000:3.0:1789130344.712534:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866176:0@lo:400:kworker.0 00000100:00080000:0.0:1789130344.712743:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130344.712748:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130344.712967:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866688 00000100:00100000:2.0:1789130344.712974:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866688 00000100:00100000:2.0:1789130344.713016:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789130344.713023:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130344.713060:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1789130344.713141:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130344.713149:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130344.713175:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130344.713178:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626865920 00000100:00100000:2.0:1789130344.713182:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626865920 00000100:00100000:2.0:1789130344.713211:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789130344.713218:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626865920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130344.713262:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626865920:12345-0@lo:400:kworker.0 Request processed in 44us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130344.713269:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789130344.713408:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626865920:0@lo:400:kworker.0 00010000:00010000:3.0:1789130344.903198:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130345.734969:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130345.735081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130345.735283:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866816 00000100:00100000:2.0:1789130345.735294:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866816 00000100:00100000:2.0:1789130345.735538:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789130345.735551:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130345.735642:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130345.735714:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626866816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130345.735724:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789130345.735838:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626866816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130345.926037:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130346.010166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130346.010217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130346.010335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130346.010369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130346.010439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130346.010498:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092352 00000100:00100000:3.0:1789130346.010510:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092352 00000100:00100000:3.0:1789130346.010591:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:3.0:1789130346.010641:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605092352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130346.010755:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2368:x1876037605092352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 153us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130346.010765:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:3.0:1789130346.010990:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092864 00000100:00100000:3.0:1789130346.010996:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092864 00000100:00100000:3.0:1789130346.011045:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092480 00000100:00100000:3.0:1789130346.011048:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092480 00000100:00100000:3.0:1789130346.011074:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:3.0:1789130346.011081:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605092864:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130346.011123:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2368:x1876037605092864:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130346.011130:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:3.0:1789130346.011143:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:3.0:1789130346.011149:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:2368:x1876037605092480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130346.011177:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+53:2368:x1876037605092480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130346.011183:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00080000:3.0:1789130346.011228:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130346.016229:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092608 00000100:00100000:0.0:1789130346.016255:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092608 00000100:00100000:0.0:1789130346.016469:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092736 00000100:00100000:0.0:1789130346.016474:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092736 00000100:00100000:0.0:1789130346.016516:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:0.0:1789130346.016785:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037605092608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130346.016898:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2368:x1876037605092608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 128us (6680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130346.017030:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1789130346.017043:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037605092736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130346.017075:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2368:x1876037605092736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (6637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130346.017083:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00080000:1.0:1789130346.017926:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130346.017934:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130346.018918:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00010000:00010000:1.0:1789130346.952516:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130347.886398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130347.888177:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605092992 00000100:00100000:2.0:1789130347.888195:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605092992 00000100:00100000:2.0:1789130347.888291:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 626 00000100:00100000:2.0:1789130347.888302:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+53:41541:x1876037605092992:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789130347.888454:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+53:41541:x1876037605092992:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 153us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130347.888463:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 626 00000100:00100000:1.0:1789130347.896045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130347.896347:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605093248 00000100:00100000:2.0:1789130347.896361:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605093248 00000100:00100000:2.0:1789130347.896439:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:2.0:1789130347.896451:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+53:41541:x1876037605093248:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130347.897712:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+54:41541:x1876037605093248:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1256us (1677us total) trans 30064771632 rc 0/0 00000100:00100000:3.0:1789130347.897726:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000040:00080000:2.0:1789130347.974186:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130347.974201:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130347.974255:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:2.0:1789130347.974272:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789130347.974488:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789130348.858496:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803916 batchid updated 00000020:00080000:2.0:1789130348.858538:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803916 00000020:00080000:2.0:1789130348.858553:0:36627:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803916 00000001:00080000:1.0:1789130348.859400:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771632 is committed 00010000:00010000:0.0:1789130349.004061:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789130349.643956:0:41883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13b: Test auto RW-PCC create caching for file name with wildcard ========================================================== 08:39:07 (1789130347) 00000100:00100000:2.0:1789130349.830063:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626867072:0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130349.830190:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626867584:0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130349.830245:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130349.830250:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626866944:0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130349.830296:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626867456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130349.830342:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867072 00000100:00100000:2.0:1789130349.830349:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867072 00000100:00100000:2.0:1789130349.830402:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789130349.830411:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626867072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830462:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626867072:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130349.830469:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789130349.830492:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626866944 00000100:00100000:2.0:1789130349.830495:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626866944 00000100:00100000:2.0:1789130349.830516:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789130349.830521:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626866944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830549:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626866944:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130349.830554:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789130349.830595:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626866944:0@lo:400:kworker.0 00000100:00100000:2.0:1789130349.830638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789130349.830861:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867200:0@lo:400:kworker.0 00000100:00100000:1.0:1789130349.830893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130349.830921:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130349.830929:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626867328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130349.830950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130349.830974:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130349.830985:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867200 00000100:00100000:1.0:1789130349.830989:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867200 00000100:00100000:1.0:1789130349.831023:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789130349.831029:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130349.831064:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867200:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130349.831071:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1789130349.831088:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130349.831103:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130349.831157:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867584 00000100:00100000:0.0:1789130349.831162:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867584 00000100:00100000:0.0:1789130349.831203:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867456 00000100:00100000:0.0:1789130349.831207:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867456 00000100:00100000:0.0:1789130349.831224:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867328 00000100:00100000:0.0:1789130349.831226:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867328 00000100:00100000:0.0:1789130349.831239:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789130349.831245:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626867584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130349.831285:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626867584:12345-0@lo:400:kworker.0 Request processed in 40us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130349.831291:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789130349.831305:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789130349.831311:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626867456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130349.831342:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626867456:12345-0@lo:400:kworker.0 Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130349.831348:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789130349.831357:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789130349.831363:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130349.831391:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626867328:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130349.831397:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789130349.831424:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626867456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130349.831434:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626867584:0@lo:400:kworker.0 00000100:00080000:1.0:1789130349.831485:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130349.831504:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626867328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130349.833995:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130349.834064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130349.834156:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867712 00000100:00100000:0.0:1789130349.834163:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867712 00000100:00100000:0.0:1789130349.834214:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789130349.834224:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130349.834257:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130349.834303:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130349.834310:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789130349.834454:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130350.022171:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130350.113411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.113507:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605093504 00000100:00100000:0.0:1789130350.113517:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605093504 00000100:00100000:0.0:1789130350.113631:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 627 00000100:00100000:0.0:1789130350.113642:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+53:42392:x1876037605093504:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130350.113737:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.113762:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4c8 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113839:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113853:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113864:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113878:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113884:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.113891:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130350.114512:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130350.116187:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb1d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.116212:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.116223:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.116235:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130350.117323:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118138:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118146:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118152:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.118158:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118169:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118186:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:0.0:1789130350.118189:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.118193:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118200:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb1c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118216:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118223:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118229:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118233:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.118236:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118242:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118250:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b497c01900) 00010000:00010000:0.0:1789130350.118252:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.118255:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.118260:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.120252:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c8 expref: 56 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.120279:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c8 expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.120287:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789130350.120289:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.120293:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130350.120514:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+55:42392:x1876037605093504:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 6871us (7110us total) trans 30064771633 rc 0/0 00000100:00100000:0.0:1789130350.120523:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 627 00000100:00100000:1.0:1789130350.136446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.136538:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605093632 00000100:00100000:3.0:1789130350.136549:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605093632 00000100:00100000:3.0:1789130350.136659:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1789130350.136670:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605093632:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130350.136687:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130350.136724:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb1d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4c8 expref: 55 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.136743:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:3.0:1789130350.136749:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130350.136818:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2369:x1876037605093632:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.136826:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130350.140305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.140399:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605093760 00000100:00100000:3.0:1789130350.140409:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605093760 00000100:00100000:3.0:1789130350.140473:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 628 00000100:00100000:3.0:1789130350.140484:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:42392:x1876037605093760:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130350.140999:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:42392:x1876037605093760:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 514us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.141010:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 628 00000100:00100000:2.0:1789130350.336767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.336884:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605093888 00000100:00100000:3.0:1789130350.336894:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605093888 00000100:00100000:3.0:1789130350.336962:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 629 00000100:00100000:3.0:1789130350.336973:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2367:x1876037605093888:12345-192.168.201.39@tcp:41:mkdir.0 00000004:00000024:3.0:1789130350.337017:0:36589:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789130350.337525:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+54:2367:x1876037605093888:12345-192.168.201.39@tcp:41:mkdir.0 Request processed in 552us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.337533:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 629 00000100:00100000:2.0:1789130350.337629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.339497:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605094144 00000100:00100000:0.0:1789130350.339510:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605094144 00000100:00100000:0.0:1789130350.339570:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 630 00000100:00100000:0.0:1789130350.339580:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+54:42414:x1876037605094144:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789130350.339768:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130350.339882:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3dc00/0x5c74554e47ceaf8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac42e expref: 54 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.339901:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b491c57b00) 00010000:00010000:0.0:1789130350.339913:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130350.340197:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.340211:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.340220:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.340231:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.340238:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.340244:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.342202:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:0.0:1789130350.342220:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342229:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342237:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342244:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.342249:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342257:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342272:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.342275:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.342280:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.342286:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb1e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130350.342304:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cbd8a837 reply state 000000001e79d44d transno 30064771634 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130350.342313:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130350.342536:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+55:42414:x1876037605094144:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 2955us (4932us total) trans 30064771634 rc 0/0 00000100:00100000:0.0:1789130350.342549:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 630 00010000:00010000:2.0:1789130350.347224:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347241:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347249:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347255:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130350.347260:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347269:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347285:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9fe006db (ffff90b497c01a00) 00010000:00010000:2.0:1789130350.347288:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130350.347293:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.347299:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb1e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130350.363336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.363554:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605094272 00000100:00100000:3.0:1789130350.363564:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605094272 00000100:00100000:3.0:1789130350.363665:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 631 00000100:00100000:3.0:1789130350.363676:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+54:42415:x1876037605094272:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:3.0:1789130350.363710:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130350.363736:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4cf expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363816:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363831:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363843:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130350.363908:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130350.363912:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130350.363937:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363963:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4cf expref: 56 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363980:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4cf expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.363989:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130350.363991:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130350.363995:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00100000:3.0:1789130350.364050:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:42415:x1876037605094272:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 377us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.364057:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 631 00000100:00100000:1.0:1789130350.371009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.371097:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605094400 00000100:00100000:3.0:1789130350.371107:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605094400 00000100:00100000:3.0:1789130350.371162:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 632 00000100:00100000:3.0:1789130350.371173:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:42415:x1876037605094400:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:3.0:1789130350.371192:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130350.371213:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4d6 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371277:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371296:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371307:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371322:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371340:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371347:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371445:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371453:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371459:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130350.371497:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000004:00200000:3.0:1789130350.371500:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130350.371522:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371534:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371544:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371551:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371557:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130350.371561:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371569:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371580:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130350.371583:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130350.371588:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371594:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371647:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371828:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371834:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371840:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130350.371844:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371851:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371859:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9fe006db (ffff90b496419200) 00010000:00010000:3.0:1789130350.371861:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130350.371864:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371869:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb20c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371903:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb1fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4d6 expref: 57 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371915:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4d6 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.371921:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b496419600) 00010000:00010000:3.0:1789130350.371923:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130350.371926:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:3.0:1789130350.372041:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+56:42415:x1876037605094400:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 869us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.372049:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 632 00000100:00100000:1.0:1789130350.376059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.376167:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605094656 00000100:00100000:0.0:1789130350.376177:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605094656 00000100:00100000:0.0:1789130350.376264:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 633 00000100:00100000:0.0:1789130350.376275:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+56:42415:x1876037605094656:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:0.0:1789130350.376336:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130350.376363:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb213 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4d6 expref: 56 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.376382:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b496419600) 00010000:00010000:0.0:1789130350.376393:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130350.376420:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.376435:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.376445:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130350.376732:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009893a24f reply state 000000004e647b8f transno 30064771635 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130350.376741:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789130350.376754:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000100:00100000:0.0:1789130350.377087:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+57:42415:x1876037605094656:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 812us (1035us total) trans 30064771635 rc 0/0 00000100:00100000:0.0:1789130350.377094:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 633 00010000:00010000:1.0:1789130350.386901:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386919:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386927:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386933:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130350.386938:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386947:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386968:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130350.386971:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130350.386976:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.386982:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb21a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130350.437864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.438036:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605094784 00000100:00100000:0.0:1789130350.438046:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605094784 00000100:00100000:0.0:1789130350.438118:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 634 00000100:00100000:0.0:1789130350.438129:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+56:42421:x1876037605094784:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130350.438154:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.438177:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4dd expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438250:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438265:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438277:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438292:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438299:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438305:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438436:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438445:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438457:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.438489:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1789130350.438493:0:38734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130350.438516:0:38734:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438529:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438536:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438543:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438548:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.438552:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438560:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438572:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130350.438575:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.438580:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438586:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438641:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438649:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438654:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438659:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.438663:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438668:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438675:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9fe006db (ffff90b497c01c00) 00010000:00010000:0.0:1789130350.438677:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.438680:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438684:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb22f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9fe006db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438726:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4dd expref: 58 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438740:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4dd expref: 57 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.438752:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.438755:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130350.438757:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130350.438829:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+57:42421:x1876037605094784:12345-192.168.201.39@tcp:101:dd.0 Request processed in 701us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130350.438837:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 634 00000100:00100000:2.0:1789130350.447680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.447913:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605095040 00000100:00100000:3.0:1789130350.447924:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605095040 00000100:00100000:3.0:1789130350.447985:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 635 00000100:00100000:3.0:1789130350.447995:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+57:42421:x1876037605095040:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130350.448017:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130350.448039:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb23d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4e4 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448176:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448192:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448204:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448219:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448227:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.448234:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449081:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb252 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449093:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb252 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449102:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb252 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130350.449112:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3f:0x0]: returning size 0 00010000:00010000:3.0:1789130350.449139:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449146:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449153:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449160:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130350.449164:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449171:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449184:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130350.449186:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130350.449191:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449197:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb244 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130350.449209:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000018aa720e reply state 00000000152434a4 transno 30064771636 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130350.449216:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130350.449244:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb23d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4e4 expref: 60 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449257:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb252 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4e4 expref: 59 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.449264:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b496419c00) 00010000:00010000:3.0:1789130350.449266:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789130350.449268:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:3.0:1789130350.449344:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+60:42421:x1876037605095040:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1350us (1675us total) trans 30064771636 rc 0/0 00000100:00100000:3.0:1789130350.449352:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 635 00010000:00010000:2.0:1789130350.454033:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454074:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454083:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454090:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130350.454095:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454104:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454120:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x1ebc27ee (ffff90b496419200) 00010000:00010000:2.0:1789130350.454123:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130350.454128:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.454135:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb24b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130350.455756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.456105:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605095296 00000100:00100000:0.0:1789130350.456116:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605095296 00000100:00100000:0.0:1789130350.456173:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:0.0:1789130350.456184:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+59:42421:x1876037605095296:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130350.456533:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+60:42421:x1876037605095296:12345-192.168.201.39@tcp:35:dd.0 Request processed in 350us (784us total) trans 30064771637 rc 0/0 00000100:00100000:0.0:1789130350.456541:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:1.0:1789130350.560007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.560289:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605095552 00000100:00100000:0.0:1789130350.560299:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605095552 00000100:00100000:0.0:1789130350.560371:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 636 00000100:00100000:0.0:1789130350.560383:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+60:42431:x1876037605095552:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130350.560406:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.560429:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4eb expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.560572:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:0.0:1789130350.560756:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb260 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4eb expref: 62 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.560777:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130350.560780:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130350.560786:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4eb expref: 62 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.560812:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3a00, rc 0) 00000100:00100000:0.0:1789130350.560881:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+61:42431:x1876037605095552:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 501us (884us total) trans 30064771638 rc 301/301 00000100:00100000:0.0:1789130350.560889:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 636 00000100:00100000:1.0:1789130350.564840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.564923:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605095808 00000100:00100000:0.0:1789130350.564934:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605095808 00000100:00100000:0.0:1789130350.564999:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:0.0:1789130350.565008:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+61:42431:x1876037605095808:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130350.565271:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:42431:x1876037605095808:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 263us (443us total) trans 30064771639 rc 0/0 00000100:00100000:0.0:1789130350.565280:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1789130350.646856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.647113:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605095936 00000100:00100000:0.0:1789130350.647123:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605095936 00000100:00100000:0.0:1789130350.647182:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 637 00000100:00100000:0.0:1789130350.647193:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:42437:x1876037605095936:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130350.647217:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.647240:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb26e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4f2 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647311:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647389:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647401:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.647463:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1789130350.647467:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130350.647490:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647517:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb26e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f2 expref: 64 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647535:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f2 expref: 63 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.647543:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.647546:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130350.647549:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2a00, rc 0) 00000100:00100000:0.0:1789130350.647657:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+63:42437:x1876037605095936:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 466us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130350.647665:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 637 00000100:00100000:1.0:1789130350.654083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.654179:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605096064 00000100:00100000:0.0:1789130350.654189:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605096064 00000100:00100000:0.0:1789130350.654247:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 638 00000100:00100000:0.0:1789130350.654257:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:42437:x1876037605096064:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130350.654278:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.654299:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb27c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac4f9 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654377:0:36587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654390:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654402:0:36587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.654441:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3f:0x0]: returning size 0 00000004:00200000:0.0:1789130350.654445:0:36587:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130350.654463:0:36587:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654475:0:36587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36587 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654497:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb27c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f9 expref: 65 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654515:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f9 expref: 64 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.654538:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b496419c00) 00010000:00010000:0.0:1789130350.654541:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130350.654545:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130350.654692:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:42437:x1876037605096064:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 436us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130350.654712:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 638 00000100:00100000:1.0:1789130350.661687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130350.661828:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605096320 00000100:00100000:2.0:1789130350.661839:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605096320 00000100:00100000:2.0:1789130350.661905:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 639 00000100:00100000:2.0:1789130350.661916:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+64:42437:x1876037605096320:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130350.661939:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130350.661966:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb28a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac500 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.662073:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb291 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.662090:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb291 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.662101:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb291 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130350.662113:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3f:0x0]: returning size 0 00010000:00010000:2.0:1789130350.662251:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb28a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac500 expref: 67 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.662274:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb291 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac500 expref: 66 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130350.662283:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b496419c00) 00010000:00010000:2.0:1789130350.662286:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130350.662290:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130350.662355:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+66:42437:x1876037605096320:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 441us (677us total) trans 30064771640 rc 0/0 00000100:00100000:2.0:1789130350.662362:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 639 00000100:00100000:3.0:1789130350.673365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.673500:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605096576 00000100:00100000:0.0:1789130350.673515:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605096576 00000100:00100000:0.0:1789130350.673655:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:0.0:1789130350.673666:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+66:42437:x1876037605096576:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130350.673954:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+67:42437:x1876037605096576:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 289us (603us total) trans 30064771641 rc 0/0 00000100:00100000:0.0:1789130350.673962:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:1.0:1789130350.675310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.675401:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605096704 00000100:00100000:3.0:1789130350.675413:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605096704 00000100:00100000:3.0:1789130350.675477:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130350.675487:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+67:2370:x1876037605096704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130350.675503:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130350.675542:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb291 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac500 expref: 67 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.675562:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b496419c00) 00010000:00010000:3.0:1789130350.675567:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130350.675666:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3839a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+66:2370:x1876037605096704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130350.675674:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130350.814125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.814272:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605096960 00000100:00100000:3.0:1789130350.814283:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605096960 00000100:00100000:3.0:1789130350.814347:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 640 00000100:00100000:3.0:1789130350.814357:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+66:42447:x1876037605096960:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130350.814381:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130350.814404:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb29f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac507 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130350.814545:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:3.0:1789130350.814936:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb29f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac507 expref: 68 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.814950:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:3.0:1789130350.814954:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130350.814959:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb29f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac507 expref: 68 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130350.814974:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35600, rc 0) 00000100:00100000:3.0:1789130350.815089:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+67:42447:x1876037605096960:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 734us (975us total) trans 30064771642 rc 301/301 00000100:00100000:3.0:1789130350.815097:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 640 00000100:00100000:0.0:1789130350.822337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130350.822780:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605097216 00000100:00100000:2.0:1789130350.822794:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605097216 00000100:00100000:2.0:1789130350.822856:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:2.0:1789130350.822868:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+67:42447:x1876037605097216:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130350.823173:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+68:42447:x1876037605097216:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 305us (844us total) trans 30064771643 rc 0/0 00000100:00100000:2.0:1789130350.823180:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789130350.854960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.855309:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130350.855334:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130350.855427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130350.855806:0:37278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867840 00000100:00100000:2.0:1789130350.855816:0:37278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867840 00000100:00100000:2.0:1789130350.855875:0:37278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789130350.855886:0:37278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130350.855922:0:37278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130350.855981:0:37278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626867840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130350.855990:0:37278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130350.856180:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605097472 00000100:00100000:0.0:1789130350.856185:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605097472 00000100:00100000:0.0:1789130350.856227:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 641 00000100:00100000:0.0:1789130350.856236:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+68:42448:x1876037605097472:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789130350.856284:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789130350.856313:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb283 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f9 expref: 68 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856335:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb252 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4e4 expref: 67 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856346:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b496419c00) 00010000:00010000:0.0:1789130350.856360:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb275 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4f2 expref: 66 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856380:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.856385:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130350.856407:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856420:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856429:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856443:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856450:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856456:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856933:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856945:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.856953:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130350.857535:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626867840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130350.857865:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857876:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857888:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857895:0:38723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857902:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857909:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857931:0:38723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130350.857952:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857960:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857967:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857974:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.857979:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.857989:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.857992:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130350.858002:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:1.0:1789130350.858008:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858009:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130350.858015:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858026:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2bb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858039:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130350.858048:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858057:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858060:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858084:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858093:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858097:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3f:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130350.858100:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130350.858105:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130350.858108:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858114:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858120:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858128:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb2c2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858140:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.858145:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.858150:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.858155:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2ad lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858161:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130350.858166:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789130350.858169:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000546741dc reply state 0000000085d884ce transno 30064771644 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130350.858170:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130350.858185:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130350.858273:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+67:42448:x1876037605097472:12345-192.168.201.39@tcp:36:rm.0 Request processed in 2035us (3326us total) trans 30064771644 rc 0/0 00000100:00100000:0.0:1789130350.858282:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 641 00010000:00010000:0.0:1789130350.864429:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864450:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864459:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864466:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.864472:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864481:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864502:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x1ebc27ee (ffff90b497c01c00) 00010000:00010000:0.0:1789130350.864506:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.864512:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.864533:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2b4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x1ebc27ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130350.925177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130350.925302:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605097728 00000100:00100000:0.0:1789130350.925318:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605097728 00000100:00100000:0.0:1789130350.925837:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 642 00000100:00100000:0.0:1789130350.925852:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+66:42454:x1876037605097728:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130350.925888:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130350.925920:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2c9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac50e expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926131:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926150:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926167:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926185:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926192:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.926200:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927346:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb2de lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927363:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb2de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927373:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb2de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130350.927387:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x40:0x0]: returning size 0 00010000:00010000:0.0:1789130350.927420:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927428:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927436:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927443:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.927448:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927458:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927473:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130350.927476:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.927483:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927489:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb2d0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130350.927506:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004364e5bd reply state 00000000f0aa274f transno 30064771645 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130350.927516:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130350.927559:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2c9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac50e expref: 69 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927580:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb2de lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac50e expref: 68 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.927588:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130350.927591:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789130350.927593:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2a00, rc 0) 00000100:00100000:0.0:1789130350.928333:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+69:42454:x1876037605097728:12345-192.168.201.39@tcp:101:dd.500 Request processed in 2469us (3158us total) trans 30064771645 rc 0/0 00000100:00100000:0.0:1789130350.928345:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 642 00000100:00100000:2.0:1789130350.932474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130350.932576:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605097984 00000100:00100000:3.0:1789130350.932591:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605097984 00000100:00100000:3.0:1789130350.932708:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:3.0:1789130350.932721:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:42454:x1876037605097984:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:3.0:1789130350.933241:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:42454:x1876037605097984:12345-192.168.201.39@tcp:35:dd.500 Request processed in 522us (782us total) trans 30064771646 rc 0/0 00000100:00100000:3.0:1789130350.933252:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00010000:00010000:0.0:1789130350.933615:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933630:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933648:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933656:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130350.933663:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933672:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933704:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0xec105b57 (ffff90b497c01c00) 00010000:00010000:0.0:1789130350.933707:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130350.933714:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130350.933722:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2d7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.051511:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130351.051820:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789130351.051828:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130351.051872:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:2.0:1789130351.051884:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789130351.074225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.074335:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605098240 00000100:00100000:0.0:1789130351.074349:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605098240 00000100:00100000:0.0:1789130351.074434:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 643 00000100:00100000:0.0:1789130351.074448:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+69:42464:x1876037605098240:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.074484:0:36587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.074514:0:36587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac515 expref: -99 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.074738:0:36587:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:0.0:1789130351.074898:0:36587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac515 expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.074915:0:36587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130351.074919:0:36587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130351.074924:0:36587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3c00/0x5c74554e47ceb2ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac515 expref: 71 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.074941:0:36587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3c00, rc 0) 00000100:00100000:0.0:1789130351.075023:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:42464:x1876037605098240:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 578us (814us total) trans 30064771647 rc 301/301 00000100:00100000:0.0:1789130351.075031:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 643 00000100:00100000:2.0:1789130351.088682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.088841:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605098496 00000100:00100000:3.0:1789130351.088856:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605098496 00000100:00100000:3.0:1789130351.088927:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130351.088939:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+70:42464:x1876037605098496:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130351.089309:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+71:42464:x1876037605098496:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 371us (641us total) trans 30064771648 rc 0/0 00000100:00100000:3.0:1789130351.089319:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:2.0:1789130351.139284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.139327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.139368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.139404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.139440:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605098752 00000100:00100000:2.0:1789130351.139452:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605098752 00000100:00100000:2.0:1789130351.139517:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605098880 00000100:00100000:2.0:1789130351.139519:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605098880 00000100:00100000:2.0:1789130351.139541:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:2.0:1789130351.139554:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605098752:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130351.139697:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605098752:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130351.139705:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:2.0:1789130351.139723:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:2.0:1789130351.139730:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605098880:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130351.139754:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:587d445f-41ce-47d3-97fe-edc16e866648+10:2367:x1876037605098880:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130351.139760:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:0.0:1789130351.140054:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099008 00000100:00100000:0.0:1789130351.140061:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099008 00000100:00100000:0.0:1789130351.140112:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:0.0:1789130351.140121:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605099008:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130351.140168:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec5d7172-884c-4596-96b1-f5256d22e019+5:2367:x1876037605099008:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130351.140175:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:1.0:1789130351.140428:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605098624 00000100:00100000:1.0:1789130351.140434:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605098624 00000100:00100000:1.0:1789130351.140471:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:1.0:1789130351.140478:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605098624:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130351.140517:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605098624:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130351.140523:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00080000:1.0:1789130351.140553:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130351.140558:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130351.140560:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130351.220210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.220312:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099136 00000100:00100000:0.0:1789130351.220325:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099136 00000100:00100000:0.0:1789130351.220403:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 644 00000100:00100000:0.0:1789130351.220413:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+71:42470:x1876037605099136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.220444:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.220468:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac51c expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220541:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220554:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220565:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.220768:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1789130351.220772:0:36588:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130351.220800:0:36588:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220832:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb2fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac51c expref: 73 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220859:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac51c expref: 72 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.220869:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130351.220871:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130351.220874:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3a00, rc 0) 00000100:00100000:0.0:1789130351.220940:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+72:42470:x1876037605099136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 530us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130351.220946:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 644 00000100:00100000:3.0:1789130351.224219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130351.224393:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099264 00000100:00100000:1.0:1789130351.224404:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099264 00000100:00100000:1.0:1789130351.224465:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 645 00000100:00100000:1.0:1789130351.224473:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+72:42470:x1876037605099264:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130351.224497:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130351.224521:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb308 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac523 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224588:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224800:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224817:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130351.224868:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x40:0x0]: returning size 0 00000004:00200000:1.0:1789130351.224874:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130351.224897:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224910:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224936:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb308 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac523 expref: 74 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224957:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac523 expref: 73 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.224966:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130351.224970:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130351.224974:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c800, rc 0) 00000100:00100000:1.0:1789130351.225380:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+73:42470:x1876037605099264:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 904us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130351.225390:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 645 00000100:00100000:2.0:1789130351.232769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.232892:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099520 00000100:00100000:3.0:1789130351.232906:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099520 00000100:00100000:3.0:1789130351.233041:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 646 00000100:00100000:3.0:1789130351.233054:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+73:42470:x1876037605099520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130351.233082:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130351.233111:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb316 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac52a expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.233245:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb31d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.233264:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb31d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.233279:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb31d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130351.233293:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x40:0x0]: returning size 0 00010000:00010000:3.0:1789130351.233475:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb316 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac52a expref: 76 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.233499:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb31d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac52a expref: 75 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.233511:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130351.233514:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130351.233518:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35a00, rc 0) 00000100:00100000:3.0:1789130351.233669:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:42470:x1876037605099520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 618us (1030us total) trans 30064771649 rc 0/0 00000100:00100000:3.0:1789130351.233676:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 646 00000100:00100000:2.0:1789130351.240291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.240362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.240569:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099776 00000100:00100000:3.0:1789130351.240582:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099776 00000100:00100000:3.0:1789130351.240676:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:3.0:1789130351.240698:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+75:42470:x1876037605099776:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130351.241397:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+76:42470:x1876037605099776:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 706us (1125us total) trans 30064771650 rc 0/0 00000100:00100000:3.0:1789130351.241407:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:0.0:1789130351.242170:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605099904 00000100:00100000:0.0:1789130351.242182:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605099904 00000100:00100000:1.0:1789130351.242425:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789130351.242439:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+76:2370:x1876037605099904:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130351.242463:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130351.242498:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb31d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac52a expref: 76 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.242523:0:36574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130351.242529:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130351.242585:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:2370:x1876037605099904:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 149us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130351.242592:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1789130351.345544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.345664:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605100160 00000100:00100000:0.0:1789130351.345674:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605100160 00000100:00100000:0.0:1789130351.345751:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 647 00000100:00100000:0.0:1789130351.345762:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+75:42480:x1876037605100160:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.345789:0:36588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.345814:0:36588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac531 expref: -99 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.345942:0:36588:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:0.0:1789130351.346066:0:36588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb32b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac531 expref: 77 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.346082:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130351.346084:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130351.346090:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac531 expref: 77 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.346106:0:36588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130351.346172:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+76:42480:x1876037605100160:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 412us (639us total) trans 30064771651 rc 301/301 00000100:00100000:0.0:1789130351.346180:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 647 00000100:00100000:2.0:1789130351.355047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.355167:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605100416 00000100:00100000:3.0:1789130351.355177:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605100416 00000100:00100000:3.0:1789130351.355231:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130351.355241:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+76:42480:x1876037605100416:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130351.355502:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+77:42480:x1876037605100416:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 262us (464us total) trans 30064771652 rc 0/0 00000100:00100000:3.0:1789130351.355513:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130351.394055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130351.394232:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605100672 00000100:00100000:1.0:1789130351.394242:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605100672 00000100:00100000:1.0:1789130351.394304:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 648 00000100:00100000:1.0:1789130351.394316:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+77:42481:x1876037605100672:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:1.0:1789130351.394375:0:38723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789130351.394404:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c800/0x5c74554e47ceb30f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac523 expref: 77 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394428:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2a00/0x5c74554e47ceb2de lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x40:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac50e expref: 76 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394441:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130351.394457:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3a00/0x5c74554e47ceb301 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac51c expref: 75 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394465:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130351.394469:0:38723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130351.394491:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394505:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394514:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394529:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394536:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394543:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394783:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394792:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.394799:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395467:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395477:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395485:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395492:0:38723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395498:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395504:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395530:0:38723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130351.395551:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395557:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395564:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395570:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ca00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130351.395574:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395581:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.395591:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b491c57c00) 00010000:00010000:1.0:1789130351.395594:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130351.395598:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395798:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130351.395805:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395812:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130351.395815:0:36575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395822:0:36575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395836:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x40:0x0].0x0 (ffff90b491c57c00) 00010000:00010000:2.0:1789130351.395838:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130351.395842:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395848:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c600/0x5c74554e47ceb34e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130351.395861:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130351.395863:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130351.395865:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130351.396016:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb347 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396037:0:38723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396043:0:38723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396050:0:38723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396055:0:38723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3ce00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130351.396058:0:38723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396064:0:38723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396073:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130351.396075:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130351.396078:0:38723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.396084:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb339 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130351.396094:0:38723:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000beea30a2 reply state 00000000fc51d520 transno 30064771653 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130351.396102:0:38723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130351.396232:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+76:42481:x1876037605100672:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1915us (2185us total) trans 30064771653 rc 0/0 00000100:00100000:1.0:1789130351.396241:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 648 00010000:00010000:0.0:1789130351.400279:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400299:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400307:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400324:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130351.400329:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400337:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400353:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0xec105b57 (ffff90b491c57400) 00010000:00010000:0.0:1789130351.400356:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130351.400361:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.400367:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c200/0x5c74554e47ceb340 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0xec105b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130351.500019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.500303:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605100928 00000100:00100000:0.0:1789130351.500314:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605100928 00000100:00100000:0.0:1789130351.500380:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 649 00000100:00100000:0.0:1789130351.500390:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+75:42487:x1876037605100928:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130351.500420:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.500443:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb355 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac538 expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500648:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500664:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500676:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500704:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500712:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.500720:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501716:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb36a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501729:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb36a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501738:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb36a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.501748:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x41:0x0]: returning size 0 00010000:00010000:0.0:1789130351.501776:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501783:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501790:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501796:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130351.501800:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501808:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501820:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130351.501823:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130351.501828:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501834:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb35c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130351.501847:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063c05d3c reply state 000000000fd774c6 transno 30064771654 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130351.501855:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130351.501883:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb355 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac538 expref: 78 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501914:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb36a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac538 expref: 77 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.501922:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130351.501925:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789130351.501927:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130351.503414:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+78:42487:x1876037605100928:12345-192.168.201.39@tcp:101:dd.500 Request processed in 3014us (3395us total) trans 30064771654 rc 0/0 00000100:00100000:0.0:1789130351.503426:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 649 00010000:00010000:0.0:1789130351.507083:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507109:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507118:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507126:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130351.507324:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507337:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507360:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x3e922615 (ffff90b497c01c00) 00010000:00010000:0.0:1789130351.507364:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130351.507369:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.507378:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb363 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130351.511028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.517898:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605101184 00000100:00100000:0.0:1789130351.517920:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605101184 00000100:00100000:1.0:1789130351.521182:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:1.0:1789130351.521200:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483912c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+77:42487:x1876037605101184:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:1.0:1789130351.522468:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483912c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+78:42487:x1876037605101184:12345-192.168.201.39@tcp:35:dd.500 Request processed in 1262us (11520us total) trans 30064771655 rc 0/0 00000100:00100000:1.0:1789130351.522483:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:2.0:1789130351.660417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.662070:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605101440 00000100:00100000:0.0:1789130351.662091:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605101440 00000100:00100000:0.0:1789130351.662505:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 650 00000100:00100000:0.0:1789130351.662518:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+78:42497:x1876037605101440:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.662553:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.662585:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac53f expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.669644:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb37f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.669686:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb37f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.669703:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb37f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.669719:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00010000:00010000:0.0:1789130351.670229:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac53f expref: 81 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.670255:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb37f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac53f expref: 80 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.670272:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130351.670275:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789130351.670280:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130351.670389:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+80:42497:x1876037605101440:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 7873us (9992us total) trans 30064771656 rc 0/0 00000100:00100000:0.0:1789130351.670400:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 650 00000100:00100000:2.0:1789130351.755849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130351.756079:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605101568 00000100:00100000:1.0:1789130351.756093:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605101568 00000100:00100000:1.0:1789130351.756184:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 651 00000100:00100000:1.0:1789130351.756197:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+80:42503:x1876037605101568:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130351.756233:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130351.756262:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb38d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac546 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756353:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756371:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756385:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130351.756467:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3e:0x0]: returning size 512 00000004:00200000:1.0:1789130351.756472:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130351.756504:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756536:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ce00/0x5c74554e47ceb38d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac546 expref: 82 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756561:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac546 expref: 81 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.756571:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130351.756574:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130351.756579:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ca00, rc 0) 00000100:00100000:1.0:1789130351.756757:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:587d445f-41ce-47d3-97fe-edc16e866648+81:42503:x1876037605101568:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 561us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130351.756766:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 651 00000100:00100000:3.0:1789130351.767259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.771327:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605101696 00000100:00100000:0.0:1789130351.771348:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605101696 00000100:00100000:0.0:1789130351.771451:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 652 00000100:00100000:0.0:1789130351.771464:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+81:42503:x1876037605101696:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.771490:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.771520:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb39b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac54d expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.771644:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.771662:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.771685:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.771753:0:36589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x41:0x0]: returning size 0 00000004:00200000:0.0:1789130351.771759:0:36589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130351.771782:0:36589:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.772033:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.772064:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb39b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac54d expref: 83 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.772087:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac54d expref: 82 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.772097:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130351.772100:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130351.772104:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130351.772339:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+82:42503:x1876037605101696:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 876us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130351.772348:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 652 00000100:00100000:2.0:1789130351.776372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130351.776489:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605101952 00000100:00100000:0.0:1789130351.776502:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605101952 00000100:00100000:0.0:1789130351.776582:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 653 00000100:00100000:0.0:1789130351.776595:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+82:42503:x1876037605101952:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130351.776654:0:38734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130351.776702:0:38734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb3a9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac554 expref: -99 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.776983:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb3b0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.777002:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb3b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.777018:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb3b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130351.777034:0:38734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x41:0x0]: returning size 0 00010000:00010000:0.0:1789130351.777420:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3000/0x5c74554e47ceb3a9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac554 expref: 85 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.777446:0:38734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb3b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac554 expref: 84 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.777456:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130351.777459:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130351.777464:0:38734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2400, rc 0) 00000100:00100000:0.0:1789130351.777550:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+84:42503:x1876037605101952:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 957us (1193us total) trans 30064771657 rc 0/0 00000100:00100000:0.0:1789130351.777559:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 653 00000100:00100000:2.0:1789130351.790440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130351.790514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.790670:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605102336 00000100:00100000:3.0:1789130351.790946:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605102336 00000100:00100000:3.0:1789130351.791046:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789130351.791057:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+84:2370:x1876037605102336:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130351.791081:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130351.791116:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb3b0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac554 expref: 84 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.791142:0:36573:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b497c01700) 00010000:00010000:3.0:1789130351.791148:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130351.791225:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:587d445f-41ce-47d3-97fe-edc16e866648+83:2370:x1876037605102336:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 170us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130351.791233:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130351.791644:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605102208 00000100:00100000:1.0:1789130351.791651:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605102208 00000100:00100000:1.0:1789130351.791808:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:1.0:1789130351.791819:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+83:42503:x1876037605102208:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130351.793261:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+84:42503:x1876037605102208:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1431us (3329us total) trans 30064771658 rc 0/0 00000100:00100000:1.0:1789130351.793277:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130351.947158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130351.947243:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605102592 00000100:00100000:3.0:1789130351.947253:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605102592 00000100:00100000:3.0:1789130351.947317:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 654 00000100:00100000:3.0:1789130351.947328:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+84:42514:x1876037605102592:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130351.947387:0:36588:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789130351.947415:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb3a2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac54d expref: 84 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947438:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb36a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x41:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac538 expref: 83 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947463:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b497c01700) 00010000:00010000:3.0:1789130351.947490:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3ca00/0x5c74554e47ceb394 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac546 expref: 82 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947501:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130351.947505:0:36588:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130351.947526:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947540:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947562:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947578:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947586:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947593:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947770:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947780:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.947792:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948286:0:36588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948297:0:36588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948305:0:36588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948313:0:36588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948319:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948325:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948346:0:36588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130351.948365:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948372:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948379:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948386:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130351.948392:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948400:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948407:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130351.948410:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b496419000) 00010000:00010000:3.0:1789130351.948421:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130351.948430:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948432:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948459:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3cc lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948462:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130351.948470:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948485:0:36588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948491:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948498:0:36588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948510:0:36588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948516:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x41:0x0].0x0 (ffff90b496419000) 00010000:00010000:3.0:1789130351.948517:0:36588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130351.948524:0:36588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.948525:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130351.948533:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948538:0:36588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948549:0:36588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130351.948552:0:36588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130351.948555:0:36588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130351.948560:0:36588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3be lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130351.948569:0:36588:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000042ef8b4 reply state 000000009b710763 transno 30064771659 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130351.948578:0:36588:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130351.948706:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:587d445f-41ce-47d3-97fe-edc16e866648+83:42514:x1876037605102592:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1378us (1557us total) trans 30064771659 rc 0/0 00000100:00100000:3.0:1789130351.948714:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 654 00010000:00010000:1.0:1789130351.949042:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceb3d3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130351.949070:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130351.949072:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130351.949074:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130351.954331:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954347:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954354:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954360:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130351.954365:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954376:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954392:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x3e922615 (ffff90b496419700) 00010000:00010000:0.0:1789130351.954395:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130351.954399:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130351.954405:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceb3c5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x3e922615 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130352.026058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130352.026695:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605102848 00000100:00100000:3.0:1789130352.026712:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605102848 00000100:00080000:1.0:1789130352.026800:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130352.026834:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 655 00000100:00100000:3.0:1789130352.026847:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+82:42520:x1876037605102848:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:3.0:1789130352.026880:0:36589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130352.026913:0:36589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3da lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac55b expref: -99 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028481:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028509:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028523:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028544:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028552:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.028558:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130352.032275:0:36589:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd0:0x0], index 0: 0 00010000:00010000:3.0:1789130352.033198:0:36589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceb3ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033220:0:36589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceb3ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033233:0:36589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceb3ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033290:0:36589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033718:0:36589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033789:0:36589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033798:0:36589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130352.033803:0:36589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033812:0:36589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033832:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:3.0:1789130352.033836:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130352.033842:0:36589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.033850:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35200/0x5c74554e47ceb3e1 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130352.033871:0:36589:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ae1e2e32 reply state 000000000da8863d transno 30064771660 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130352.033881:0:36589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130352.034200:0:36589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35400/0x5c74554e47ceb3da lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac55b expref: 85 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.034220:0:36589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceb3ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac55b expref: 84 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.034228:0:36589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x42:0x0].0x0 (ffff90b496419000) 00010000:00010000:3.0:1789130352.034230:0:36589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130352.034232:0:36589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34200, rc 0) 00000100:00100000:3.0:1789130352.035553:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+85:42520:x1876037605102848:12345-192.168.201.39@tcp:101:dd.500 Request processed in 8699us (9496us total) trans 30064771660 rc 0/0 00000100:00100000:3.0:1789130352.035566:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 655 00010000:00010000:3.0:1789130352.037895:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.037917:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.037927:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.038001:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130352.038009:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.038019:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.038040:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x665358b0 (ffff90b496419700) 00010000:00010000:3.0:1789130352.038044:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130352.038050:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130352.038056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35000/0x5c74554e47ceb3e8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130352.044161:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130352.044332:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605102976 00000100:00100000:0.0:1789130352.044362:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605102976 00000100:00100000:0.0:1789130352.044444:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:0.0:1789130352.044456:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:42520:x1876037605102976:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130352.044484:0:37276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130352.044517:0:37276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac562 expref: -99 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130352.044554:0:37276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130352.044590:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd0:0x0].0x0 since=1515s v=(0 0) 00010000:00010000:0.0:1789130352.044595:0:37276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130352.044629:0:37276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.044652:0:37276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.044684:0:37276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3000, rc 0) 00000100:00100000:0.0:1789130352.044778:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+14:42520:x1876037605102976:12345-192.168.201.39@tcp:101:dd.500 Request processed in 324us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130352.044787:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:2.0:1789130352.048133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130352.048231:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605103232 00000100:00100000:3.0:1789130352.048245:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605103232 00000100:00100000:3.0:1789130352.048320:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:3.0:1789130352.048330:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+84:42520:x1876037605103232:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:3.0:1789130352.048869:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+85:42520:x1876037605103232:12345-192.168.201.39@tcp:35:dd.500 Request processed in 535us (748us total) trans 30064771661 rc 0/0 00000100:00100000:3.0:1789130352.048879:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00010000:00010000:2.0:1789130352.070261:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130352.148752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130352.149037:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605103488 00000100:00100000:0.0:1789130352.149052:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605103488 00000100:00100000:0.0:1789130352.149134:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 656 00000100:00100000:0.0:1789130352.149147:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+85:42531:x1876037605103488:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789130352.149229:0:38734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130352.149267:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceb3ef lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac55b expref: 85 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149292:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x42:0x0].0x0 (ffff90b496419000) 00010000:00010000:0.0:1789130352.149306:0:38734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130352.149338:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149355:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149367:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149385:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149393:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149401:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149563:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149572:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.149579:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130352.153345:0:38734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].21, 64 off9848 00000004:00080000:0.0:1789130352.153367:0:38734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1515250763687ns, next at 1516250758075ns, rc = 0 00010000:00010000:0.0:1789130352.153488:0:38734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153510:0:38734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153524:0:38734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153533:0:38734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153540:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153546:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153584:0:38734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130352.153634:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153642:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153648:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153654:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130352.153659:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153679:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153695:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x42:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130352.153698:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130352.153705:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153713:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2600/0x5c74554e47ceb412 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153739:0:38734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153746:0:38734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153756:0:38734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153760:0:38734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130352.153763:0:38734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153768:0:38734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153776:0:38734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:0.0:1789130352.153778:0:38734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130352.153781:0:38734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.153788:0:38734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb404 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130352.153810:0:38734:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000095135354 reply state 00000000279ee0dc transno 30064771662 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130352.153821:0:38734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130352.153953:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:587d445f-41ce-47d3-97fe-edc16e866648+86:42531:x1876037605103488:12345-192.168.201.39@tcp:36:rm.0 Request processed in 4802us (5209us total) trans 30064771662 rc 0/0 00000100:00100000:0.0:1789130352.153963:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 656 00010000:00010000:1.0:1789130352.154227:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130352.154237:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130352.154244:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130352.154248:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130352.154255:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130352.154266:0:36576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x42:0x0].0x0 (ffff90b497c01700) 00010000:00010000:1.0:1789130352.154268:0:36576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130352.154272:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130352.154282:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb419 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130352.154359:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130352.154361:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130352.154363:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130352.157582:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157653:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157677:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157686:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130352.157691:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157700:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157721:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x665358b0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130352.157725:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130352.157732:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130352.157740:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb40b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3e:0x0].0x665358b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130353.098277:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130354.016968:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771662 is committed 00000004:00080000:0.0:1789130354.016990:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000100:00100000:0.0:1789130354.017369:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130354.017530:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626867968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789130354.017664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130354.017757:0:37275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626867968 00000100:00100000:0.0:1789130354.017766:0:37275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626867968 00000100:00100000:0.0:1789130354.017837:0:37275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789130354.017848:0:37275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626867968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789130354.017885:0:37275:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:208 count 1 00010000:00010000:0.0:1789130354.017920:0:37275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.017949:0:37275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.017959:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xd0:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789130354.017964:0:37275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130354.017969:0:37275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.018004:0:37275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 13 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.018022:0:37275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 13 pid: 37276 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130354.018035:0:37275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626868096:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130354.018112:0:37275:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b384a3a240 going to sleep for 11 seconds 00000100:00080000:0.0:1789130354.018126:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130354.030075:0:37275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:37275:1876037626868096:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130354.030125:0:37275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130354.031295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130354.031960:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605103616 00000100:00100000:0.0:1789130354.031977:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605103616 00010000:00010000:0.0:1789130354.032118:0:36572:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130354.032191:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:0.0:1789130354.032202:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+14:2367:x1876037605103616:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130354.032223:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130354.032230:0:36572:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.032246:0:36572:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.032284:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092c3d842/0x5c74554e47ceb3fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac562 expref: 14 pid: 37276 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.032307:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130354.032312:0:36572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130354.032319:0:36572:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.032330:0:36572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.032373:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130354.033892:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2367:x1876037605103616:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1679us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130354.033909:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00010000:00010000:2.0:1789130354.034537:0:37275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130354.034559:0:37275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130354.034576:0:37275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130354.034585:0:37275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130354.034647:0:37275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130354.035899:0:37275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626867968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18045us (18228us total) trans 30064771290 rc 0/0 00000100:00100000:2.0:1789130354.035914:0:37275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000004:00080000:3.0:1789130354.036054:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3828e92c0/2, rc 0, transno 30064771290 00000100:00100000:3.0:1789130354.036064:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626867968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789130354.036094:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130354.036106:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.036118:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130354.036123:0:36576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.036145:0:36576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.036170:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.036180:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb420 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130354.036206:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130354.036208:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130354.036209:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130354.036917:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130354.118153:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130354.954486:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626868224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130354.954560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130354.954665:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868224 00000100:00100000:3.0:1789130354.954674:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868224 00000100:00100000:3.0:1789130354.954734:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130354.954745:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626868224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130354.954787:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130354.954838:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626868224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130354.954845:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789130354.954866:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130354.955338:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626868224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130354.956176:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626868608:0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.956233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130354.956272:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130354.956278:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626868736:0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.956302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130354.956330:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868608 00000100:00100000:3.0:1789130354.956336:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868608 00000100:00100000:3.0:1789130354.956373:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868736 00000100:00100000:3.0:1789130354.956376:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868736 00000100:00100000:3.0:1789130354.956403:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789130354.956412:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626868608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.956460:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626868608:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130354.956467:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789130354.956483:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789130354.956489:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626868736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.956518:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382f8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626868736:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130354.956523:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:3.0:1789130354.956545:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130354.956585:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626868736:0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.956597:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626868608:0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.956934:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626868352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.956971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130354.956998:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626868864:0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.957022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130354.957039:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130354.957044:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626868480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.957068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130354.957092:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868864 00000100:00100000:2.0:1789130354.957096:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868864 00000100:00100000:2.0:1789130354.957129:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789130354.957136:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626868864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.957171:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626868864:12345-0@lo:400:kworker.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130354.957178:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789130354.957198:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868480 00000100:00100000:2.0:1789130354.957201:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868480 00000100:00100000:2.0:1789130354.957222:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789130354.957228:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.957440:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626868480:12345-0@lo:400:kworker.0 Request processed in 210us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130354.957447:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789130354.957478:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626868480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130354.957488:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626868864:0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.957838:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868352 00000100:00100000:3.0:1789130354.957843:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868352 00000100:00100000:3.0:1789130354.957879:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789130354.957887:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626868352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130354.958072:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3308:x1876037626868352:12345-0@lo:400:kworker.0 Request processed in 185us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130354.958079:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1789130354.958107:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130354.958172:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626868352:0@lo:400:kworker.0 00010000:00010000:1.0:1789130355.142950:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130355.976071:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130355.976101:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626868992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130355.976196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130355.976342:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626868992 00000100:00100000:1.0:1789130355.976354:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626868992 00000100:00100000:1.0:1789130355.976413:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789130355.976422:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626868992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130355.976457:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130355.976509:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626868992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130355.976517:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789130355.976757:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626868992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130356.176701:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130356.258999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130356.259085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130356.259120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130356.259139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130356.259175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130356.259205:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104256 00000100:00100000:0.0:1789130356.259214:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104256 00000100:00100000:0.0:1789130356.259277:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605103872 00000100:00100000:0.0:1789130356.259280:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605103872 00000100:00100000:0.0:1789130356.259302:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:0.0:1789130356.259311:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605104256:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130356.259399:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec5d7172-884c-4596-96b1-f5256d22e019+5:2369:x1876037605104256:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130356.259417:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:0.0:1789130356.259437:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:0.0:1789130356.259444:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605103872:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130356.259475:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2369:x1876037605103872:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130356.259482:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:0.0:1789130356.259508:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104000 00000100:00100000:0.0:1789130356.259511:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104000 00000100:00100000:0.0:1789130356.259741:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104128 00000100:00100000:0.0:1789130356.259745:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104128 00000100:00100000:0.0:1789130356.259775:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:0.0:1789130356.259782:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605104000:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130356.259812:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+13:2369:x1876037605104000:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130356.259818:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:0.0:1789130356.259831:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:0.0:1789130356.259837:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605104128:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130356.259862:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2369:x1876037605104128:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130356.259871:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00080000:0.0:1789130356.259888:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130356.259892:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130356.259894:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130356.261036:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605103744 00000100:00100000:2.0:1789130356.261105:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605103744 00000100:00100000:2.0:1789130356.261249:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789130356.261259:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605103744:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130356.261325:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2369:x1876037605103744:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 68us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130356.261339:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789130356.902716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130356.902780:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104384 00000100:00100000:3.0:1789130356.902791:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104384 00000100:00100000:3.0:1789130356.902853:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 657 00000100:00100000:3.0:1789130356.902863:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:42392:x1876037605104384:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789130356.903038:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:42392:x1876037605104384:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 175us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130356.903047:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 657 00000100:00100000:3.0:1789130356.905938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130356.906131:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104640 00000100:00100000:1.0:1789130356.906141:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104640 00000100:00100000:1.0:1789130356.906202:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:1.0:1789130356.906213:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+55:42392:x1876037605104640:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130356.906936:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:42392:x1876037605104640:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 721us (1003us total) trans 30064771663 rc 0/0 00000100:00100000:1.0:1789130356.906946:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000040:00080000:3.0:1789130357.189973:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789130357.189984:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130357.190034:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 7 00000040:00080000:3.0:1789130357.190042:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130357.190404:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130358.218132:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130358.464334:0:42078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13c: Check auto RW-PCC create caching for UID/GID/ProjID/fname rule ========================================================== 08:39:16 (1789130356) 00000001:00080000:3.0:1789130358.631007:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771290 is committed 00000001:00080000:0.0:1789130359.114878:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771663 is committed 00010000:00010000:2.0:1789130359.239141:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130360.071027:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626869120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130360.071113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130360.071301:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869120 00000100:00100000:0.0:1789130360.071308:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869120 00000100:00100000:0.0:1789130360.071370:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789130360.071380:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626869120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130360.071416:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 212926464 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130360.071464:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626869120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130360.071473:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789130360.071546:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626869120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130360.071884:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626869376:0@lo:400:kworker.0 00000100:00100000:2.0:1789130360.071919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130360.071941:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130360.071947:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626869504:0@lo:400:kworker.0 00000100:00100000:2.0:1789130360.071971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130360.072320:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869376 00000100:00100000:0.0:1789130360.072325:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869376 00000100:00100000:0.0:1789130360.072372:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789130360.072381:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626869376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130360.072431:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626869376:12345-0@lo:400:kworker.0 Request processed in 51us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130360.072439:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789130360.072460:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869504 00000100:00100000:0.0:1789130360.072463:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869504 00000100:00100000:0.0:1789130360.072954:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789130360.072965:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626869504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130360.073022:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626869504:12345-0@lo:400:kworker.0 Request processed in 61us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130360.073030:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789130360.073072:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626869504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130360.073083:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771290 gen 2 00000004:00080000:0.0:1789130360.073100:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3828e92c0, transno 30064771290 00000100:00100000:0.0:1789130360.073113:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626869376:0@lo:400:kworker.0 00000100:00080000:3.0:1789130360.073375:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130360.073382:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130360.073591:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626869248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.073652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130360.073693:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626869760:0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.073716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130360.073740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130360.073746:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626869632:0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.073766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130360.073945:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869760 00000100:00100000:1.0:1789130360.073950:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869760 00000100:00100000:1.0:1789130360.074001:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869632 00000100:00100000:1.0:1789130360.074005:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869632 00000100:00100000:1.0:1789130360.074025:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789130360.074032:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626869760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.074074:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626869760:12345-0@lo:400:kworker.0 Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130360.074080:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789130360.074568:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789130360.074578:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.074639:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b492794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626869632:12345-0@lo:400:kworker.0 Request processed in 62us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130360.074645:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789130360.074684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626869632:0@lo:400:kworker.0 00000100:00100000:1.0:1789130360.074695:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626869760:0@lo:400:kworker.0 00000100:00100000:3.0:1789130360.074935:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869248 00000100:00100000:3.0:1789130360.074941:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869248 00000100:00100000:3.0:1789130360.074979:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789130360.074985:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626869248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130360.075029:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626869248:12345-0@lo:400:kworker.0 Request processed in 44us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130360.075035:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1789130360.075063:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130360.075078:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626869248:0@lo:400:kworker.0 00010000:00010000:2.0:1789130360.266252:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130360.941952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130360.942052:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104768 00000100:00100000:0.0:1789130360.942064:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104768 00000100:00100000:0.0:1789130360.942156:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 658 00000100:00100000:0.0:1789130360.942167:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+5:43163:x1876037605104768:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130360.942188:0:38723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130360.942209:0:38723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac569 expref: -99 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942286:0:38723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942303:0:38723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942317:0:38723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130360.942534:0:38723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130360.942538:0:38723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130360.942667:0:38723:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942700:0:38723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac569 expref: 7 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942716:0:38723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac569 expref: 6 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130360.942725:0:38723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:0.0:1789130360.942728:0:38723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130360.942733:0:38723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130360.942798:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec5d7172-884c-4596-96b1-f5256d22e019+6:43163:x1876037605104768:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 633us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130360.942805:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 658 00000100:00080000:3.0:1789130360.942881:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130361.093894:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130361.093918:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626869888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130361.093990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130361.094124:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626869888 00000100:00100000:1.0:1789130361.094131:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626869888 00000100:00100000:1.0:1789130361.094184:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789130361.094194:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626869888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130361.094229:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130361.094279:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626869888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130361.094286:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130361.094522:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626869888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130361.289317:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130361.387086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130361.387145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130361.387187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130361.387225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130361.387256:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605105152 00000100:00100000:0.0:1789130361.387265:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605105152 00000100:00100000:0.0:1789130361.387317:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605105280 00000100:00100000:0.0:1789130361.387320:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605105280 00000100:00100000:0.0:1789130361.387343:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789130361.387353:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605105152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130361.387423:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+13:2370:x1876037605105152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130361.387445:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789130361.387472:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:0.0:1789130361.387480:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605105280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130361.387517:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:587d445f-41ce-47d3-97fe-edc16e866648+10:2370:x1876037605105280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130361.387523:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:2.0:1789130361.387857:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605104896 00000100:00100000:2.0:1789130361.387862:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605104896 00000100:00100000:2.0:1789130361.387902:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:2.0:1789130361.387910:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605104896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130361.387954:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b4a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2370:x1876037605104896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130361.387961:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:3.0:1789130361.388342:0:36589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605105024 00000100:00100000:3.0:1789130361.388348:0:36589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605105024 00000100:00100000:3.0:1789130361.388425:0:36589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:3.0:1789130361.388444:0:36589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2370:x1876037605105024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130361.388515:0:36589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:587d445f-41ce-47d3-97fe-edc16e866648+55:2370:x1876037605105024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 63us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130361.388523:0:36589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00080000:1.0:1789130361.388690:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130361.388695:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130361.388698:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130362.319045:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130363.338675:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130363.500721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130363.501007:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605105536 00000100:00100000:2.0:1789130363.501028:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605105536 00000100:00100000:2.0:1789130363.501106:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:2.0:1789130363.501117:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+55:43164:x1876037605105536:12345-192.168.201.39@tcp:35:umount.0 00000100:00080000:1.0:1789130363.501164:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130363.501449:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+56:43164:x1876037605105536:12345-192.168.201.39@tcp:35:umount.0 Request processed in 333us (737us total) trans 30064771664 rc 0/0 00000100:00100000:2.0:1789130363.501457:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:2.0:1789130363.712995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130363.713175:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605105792 00000100:00100000:3.0:1789130363.713187:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605105792 00000100:00100000:3.0:1789130363.713250:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:3.0:1789130363.713262:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+56:43164:x1876037605105792:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789130363.713960:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+57:43164:x1876037605105792:12345-192.168.201.39@tcp:35:umount.0 Request processed in 697us (972us total) trans 30064771665 rc 0/0 00000100:00100000:3.0:1789130363.713970:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:1.0:1789130364.015697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130364.015787:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605106048 00000100:00100000:2.0:1789130364.015808:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605106048 00000100:00100000:2.0:1789130364.015868:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:2.0:1789130364.015878:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483911850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+57:43164:x1876037605106048:12345-192.168.201.39@tcp:35:umount.0 00000001:00080000:2.0:1789130364.016173:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771666 00000100:00100000:2.0:1789130364.016277:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483911850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:43164:x1876037605106048:12345-192.168.201.39@tcp:35:umount.0 Request processed in 400us (589us total) trans 30064771667 rc 0/0 00000100:00100000:2.0:1789130364.016286:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000020:00080000:2.0:1789130364.016291:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789130364.020061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130364.020528:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605106304 00000100:00100000:2.0:1789130364.020538:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605106304 00000100:00100000:2.0:1789130364.020595:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789130364.020647:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+59:43164:x1876037605106304:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1789130364.020903:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:43164:x1876037605106304:12345-192.168.201.39@tcp:35:umount.0 Request processed in 298us (852us total) trans 30064771668 rc 0/0 00000100:00100000:2.0:1789130364.020911:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:0.0:1789130364.047889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130364.047990:0:36591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605106560 00000100:00100000:2.0:1789130364.048000:0:36591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605106560 00000100:00100000:2.0:1789130364.048067:0:36591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:2.0:1789130364.048078:0:36591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+60:43164:x1876037605106560:12345-192.168.201.39@tcp:35:umount.0 00000001:00080000:2.0:1789130364.048744:0:36591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771669 00000100:00100000:2.0:1789130364.048858:0:36591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:587d445f-41ce-47d3-97fe-edc16e866648+62:43164:x1876037605106560:12345-192.168.201.39@tcp:35:umount.0 Request processed in 781us (978us total) trans 30064771670 rc 0/0 00000100:00100000:2.0:1789130364.048867:0:36591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000020:00080000:2.0:1789130364.048872:0:36591:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130364.055655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130364.055730:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605106816 00000100:00100000:3.0:1789130364.055740:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605106816 00000100:00100000:3.0:1789130364.055799:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789130364.055808:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+62:43164:x1876037605106816:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789130364.056069:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:43164:x1876037605106816:12345-192.168.201.39@tcp:35:umount.0 Request processed in 262us (423us total) trans 30064771671 rc 0/0 00000100:00100000:3.0:1789130364.056078:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:0.0:1789130364.060556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130364.060868:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605107072 00000100:00100000:3.0:1789130364.060879:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605107072 00000100:00100000:3.0:1789130364.060941:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:3.0:1789130364.060963:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+63:43164:x1876037605107072:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789130364.061414:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:43164:x1876037605107072:12345-192.168.201.39@tcp:35:umount.0 Request processed in 455us (860us total) trans 30064771672 rc 0/0 00000100:00100000:3.0:1789130364.061423:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130364.076494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130364.076580:0:36590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605107328 00000100:00100000:3.0:1789130364.076591:0:36590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605107328 00000100:00100000:3.0:1789130364.076673:0:36590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:3.0:1789130364.076683:0:36590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:43164:x1876037605107328:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:3.0:1789130364.077312:0:36590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:587d445f-41ce-47d3-97fe-edc16e866648+65:43164:x1876037605107328:12345-192.168.201.39@tcp:35:umount.0 Request processed in 627us (825us total) trans 30064771673 rc 0/0 00000100:00100000:3.0:1789130364.077322:0:36590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:1.0:1789130364.084519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130364.084562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130364.084704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130364.084875:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130364.084902:0:37273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605108096 00000100:00100000:1.0:1789130364.084913:0:37273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605108096 00000100:00100000:1.0:1789130364.084992:0:37273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:1.0:1789130364.085003:0:37273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+10:2366:x1876037605108096:12345-192.168.201.39@tcp:9:umount.0 00000020:00000080:1.0:1789130364.085033:0:37273:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce9a50 00000020:00010000:1.0:1789130364.085050:0:37273:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b381df0000: total 0 00000100:00080000:1.0:1789130364.085055:0:37273:0:(import.c:65:import_set_state_nolock()) ffff90b381df2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130364.085106:0:37273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771226 00000100:00100000:1.0:1789130364.085395:0:37273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:587d445f-41ce-47d3-97fe-edc16e866648+8:2366:x1876037605108096:12345-192.168.201.39@tcp:9:umount.0 Request processed in 393us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130364.085402:0:37273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000020:00010000:1.0:1789130364.085421:0:36575:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b381df0000: total 0 00010000:00010000:1.0:1789130364.085425:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.085442:0:36575:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b381df0000, canceled 0 locks, left on hash table 5. 00002000:00010000:1.0:1789130364.085483:0:36575:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:1.0:1789130364.085487:0:36575:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 1789130255 00002000:00010000:1.0:1789130364.085489:0:36575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 10247 00010000:00010000:1.0:1789130364.085515:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbe1a567/0x5c74554e47cea3e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0df expref: 7 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.085550:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cea038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfb2 expref: 6 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130364.085573:0:36575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00010000:00010000:1.0:1789130364.085580:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c5e734/0x5c74554e47cea23e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac053 expref: 5 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130364.085595:0:36575:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 20971520 -> 31457280 00002000:00010000:1.0:1789130364.085598:0:36575:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 1789130196 -> 1789130198 00002000:00010000:1.0:1789130364.085635:0:36575:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 1789130196 -> 1789130198 00002000:00010000:1.0:1789130364.085638:0:36575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 40967 -> 61447 00010000:00010000:1.0:1789130364.085648:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e92982/0x5c74554e47ce9c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abea1 expref: 4 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130364.085667:0:36575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 30727 00010000:00010000:1.0:1789130364.085675:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ce9d75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abee0 expref: 3 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.085688:0:36575:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b381df0000, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1789130364.085699:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.085702:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.085703:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130364.085712:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130364.086810:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605108224 00000100:00100000:3.0:1789130364.086823:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605108224 00000100:00100000:3.0:1789130364.086884:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605108480 00000100:00100000:3.0:1789130364.086888:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605108480 00000100:00100000:3.0:1789130364.086904:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605108352 00000100:00100000:3.0:1789130364.086907:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605108352 00000100:00100000:3.0:1789130364.086926:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130364.086934:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+15:2367:x1876037605108224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130364.086948:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130364.086979:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdcc00/0x5c74554e47ce88c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab896 expref: 15 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.086994:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130364.087045:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+14:2367:x1876037605108224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 112us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130364.087053:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130364.087071:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:3.0:1789130364.087077:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+13:2367:x1876037605108480:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130364.087100:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130364.087110:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdca00/0x5c74554e47ce8955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab961 expref: 13 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.087120:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130364.087141:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:2367:x1876037605108480:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 65us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130364.087148:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:3.0:1789130364.087161:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1789130364.087167:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:2367:x1876037605108352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130364.087176:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130364.087185:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdd200/0x5c74554e47ce88d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8c0 expref: 11 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.087193:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130364.087211:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:2367:x1876037605108352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 44us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130364.087217:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789130364.101357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130364.101470:0:37276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605109632 00000100:00100000:0.0:1789130364.101483:0:37276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605109632 00000100:00100000:0.0:1789130364.101573:0:37276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:0.0:1789130364.101584:0:37276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+13:2366:x1876037605109632:12345-192.168.201.39@tcp:9:umount.0 00000020:00000080:0.0:1789130364.101649:0:37276:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce88e5 00000020:00010000:0.0:1789130364.101656:0:37276:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4ba7f7000: total 0 00000100:00080000:0.0:1789130364.101660:0:37276:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130364.101699:0:37276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771290 00000100:00100000:0.0:1789130364.101918:0:37276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:587d445f-41ce-47d3-97fe-edc16e866648+11:2366:x1876037605109632:12345-192.168.201.39@tcp:9:umount.0 Request processed in 335us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130364.101926:0:37276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00080000:1.0:1789130364.102292:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1789130364.102325:0:36576:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4ba7f7000: total 0 00010000:00010000:3.0:1789130364.102355:0:36576:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4ba7f7000, canceled 0 locks, left on hash table 8. 00002000:00010000:3.0:1789130364.102380:0:36576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb size from disk: 42811392 -> 62914560 00002000:00010000:3.0:1789130364.102382:0:36576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb mtime from disk: 1789130171 -> 1789130176 00002000:00010000:3.0:1789130364.102384:0:36576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb ctime from disk: 1789130171 -> 1789130176 00002000:00010000:3.0:1789130364.102385:0:36576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc6:0x0] updating lvb blocks from disk: 83975 -> 122887 00010000:00010000:3.0:1789130364.102409:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abccc73/0x5c74554e47ce997e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdb3 expref: 10 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.102432:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856aa987/0x5c74554e47cea268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac061 expref: 9 pid: 37658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.102451:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cea062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc0 expref: 8 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130364.102478:0:36576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1789130364.102481:0:36576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789130269 -> 1789130270 00002000:00010000:3.0:1789130364.102483:0:36576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 1789130269 00002000:00010000:3.0:1789130364.102485:0:36576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789130269 -> 1789130270 00002000:00010000:3.0:1789130364.102487:0:36576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 10247 00010000:00010000:3.0:1789130364.102497:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c153aaa4/0x5c74554e47cea5ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac16b expref: 7 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130364.102517:0:36576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 12 00002000:00010000:3.0:1789130364.102519:0:36576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 1789130155 -> 1789130156 00002000:00010000:3.0:1789130364.102521:0:36576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 1789130154 -> 1789130156 00002000:00010000:3.0:1789130364.102523:0:36576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 1789130155 -> 1789130156 00002000:00010000:3.0:1789130364.102525:0:36576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789130364.102532:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b424d23/0x5c74554e47ce9739 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd0b expref: 6 pid: 37275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130364.102549:0:36576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 20971520 -> 31457280 00002000:00010000:3.0:1789130364.102552:0:36576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 1789130213 -> 1789130216 00002000:00010000:3.0:1789130364.102554:0:36576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1789130213 -> 1789130216 00002000:00010000:3.0:1789130364.102556:0:36576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 40967 -> 61447 00010000:00010000:3.0:1789130364.102563:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961c8938/0x5c74554e47ce9f89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf88 expref: 5 pid: 37273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.102585:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089cf7a6c/0x5c74554e47ce952c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc6a expref: 4 pid: 37658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.102740:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47ce9a81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdf9 expref: 3 pid: 37276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130364.102757:0:36576:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4ba7f7000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1789130364.102770:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130364.102772:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130364.102774:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130364.131010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130364.132946:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605112960 00000100:00100000:3.0:1789130364.133138:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605112960 00000100:00100000:3.0:1789130364.133218:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 659 00000100:00100000:3.0:1789130364.133229:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+65:2366:x1876037605112960:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:3.0:1789130364.133270:0:36587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce88de 00000020:00010000:3.0:1789130364.133290:0:36587:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4921db800: total 0 00000100:00080000:3.0:1789130364.133295:0:36587:0:(import.c:65:import_set_state_nolock()) ffff90b4c1690000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130364.133380:0:36587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771673 00000100:00100000:3.0:1789130364.133992:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:587d445f-41ce-47d3-97fe-edc16e866648+64:2366:x1876037605112960:12345-192.168.201.39@tcp:39:umount.0 Request processed in 761us (2987us total) trans 30064771674 rc 0/0 00000100:00100000:3.0:1789130364.134002:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 659 00000020:00010000:1.0:1789130364.134475:0:36575:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4921db800: total 0 00010000:00010000:1.0:1789130364.134482:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.134524:0:36575:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4921db800, canceled 0 locks, left on hash table 50. 00010000:00010000:1.0:1789130364.134558:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:1.0:1789130364.134562:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130364.134571:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47cea0a8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfe3 expref: 63 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.134591:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130364.134594:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130364.134598:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cea59b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac14f expref: 62 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.134830:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130364.134833:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.134838:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9400/0x5c74554e47cea196 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac022 expref: 61 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.134852:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130364.134855:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.134859:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdd000/0x5c74554e47ce9660 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abcc5 expref: 60 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135136:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:1.0:1789130364.135140:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.135146:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1400/0x5c74554e47ceb19c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4ba expref: 59 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135164:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789130364.135166:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130364.135170:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bfbdc600/0x5c74554e47ce932d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd7 expref: 58 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135188:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130364.135191:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.135194:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86200/0x5c74554e47ce9d21 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abec4 expref: 57 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135207:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130364.135209:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130364.135213:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ce9e8d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf42 expref: 56 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135236:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130364.135239:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.135243:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ce9ab9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe15 expref: 55 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135257:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130364.135259:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.135263:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb236 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4dd expref: 54 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135280:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130364.135282:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135286:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cea532 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac13a expref: 53 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135298:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:1.0:1789130364.135301:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135304:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3c000/0x5c74554e47cea134 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac00d expref: 52 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135315:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:1.0:1789130364.135317:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130364.135320:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce953a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc71 expref: 51 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135331:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130364.135333:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.135337:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce99bd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abdc1 expref: 50 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135348:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130364.135350:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130364.135354:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cea7a1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1db expref: 49 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135368:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130364.135371:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135374:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47cea33a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ae expref: 48 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135386:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130364.135388:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.135391:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a400/0x5c74554e47ce9b3e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe3f expref: 47 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135403:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130364.135406:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.135409:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362200/0x5c74554e47cea405 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0ed expref: 46 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135419:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff90b4a2a08f00) 00010000:00010000:1.0:1789130364.135421:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.135425:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce9525 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abc63 expref: 45 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135440:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff90b4a2a08900) 00010000:00010000:1.0:1789130364.135442:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.135446:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87200/0x5c74554e47ce9ecc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf50 expref: 44 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135472:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130364.135474:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.135478:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b200/0x5c74554e47ce9aab lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe0e expref: 43 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135500:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130364.135502:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135506:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cea0ee lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abff8 expref: 42 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135516:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130364.135518:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.135521:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34c00/0x5c74554e47cea60b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac179 expref: 41 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135531:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff90b488939c00) 00010000:00010000:1.0:1789130364.135533:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.135536:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce9a26 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abddd expref: 40 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135549:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:1.0:1789130364.135552:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130364.135556:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d200/0x5c74554e47ceb07d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac466 expref: 39 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135565:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff90b4a2a08400) 00010000:00010000:1.0:1789130364.135567:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.135570:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce98a5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd6d expref: 38 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135582:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff90b496419900) 00010000:00010000:1.0:1789130364.135584:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.135588:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceafb2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac435 expref: 37 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135624:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130364.135627:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135631:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38759ae00/0x5c74554e47cea738 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1c6 expref: 36 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135643:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130364.135645:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789130364.135648:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b381fb9800/0x5c74554e47cea2f4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac099 expref: 35 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135658:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4a2a08e00) 00010000:00010000:1.0:1789130364.135661:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130364.135664:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce9311 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abbd0 expref: 34 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135675:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789130364.135677:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130364.135680:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b382ed6800/0x5c74554e47cea5b0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac156 expref: 33 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135699:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130364.135702:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.135706:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce9dad lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abefc expref: 32 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.135723:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130364.135725:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.135728:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86600/0x5c74554e47cea276 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac068 expref: 31 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136180:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff90b491c57900) 00010000:00010000:1.0:1789130364.136183:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.136188:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c3d600/0x5c74554e47ceb0c3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac482 expref: 30 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136205:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff90b488939500) 00010000:00010000:1.0:1789130364.136207:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.136211:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47cea00e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfa4 expref: 29 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136226:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3e:0x0].0x0 (ffff90b497c01900) 00010000:00010000:1.0:1789130364.136229:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130364.136232:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb37f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x3e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac53f expref: 28 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136245:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130364.136247:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.136250:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce9d9f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abef5 expref: 27 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136262:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130364.136264:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.136267:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34000/0x5c74554e47cea292 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac076 expref: 26 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136280:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff90b497c01e00) 00010000:00010000:1.0:1789130364.136283:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130364.136286:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cea7b6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac1e2 expref: 25 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136301:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:1.0:1789130364.136303:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.136307:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceaccc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac363 expref: 24 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136321:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:1.0:1789130364.136323:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130364.136327:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34a00/0x5c74554e47ceb1f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac4cf expref: 23 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136337:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130364.136339:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.136343:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce9778 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abd19 expref: 22 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136357:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130364.136360:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.136363:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cea070 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfc7 expref: 21 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136382:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130364.136384:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130364.136388:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cea214 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac045 expref: 20 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136399:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130364.136401:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130364.136404:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657000/0x5c74554e47cea2ae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac084 expref: 19 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136418:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789130364.136420:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.136424:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47cea39c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac0c3 expref: 18 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136437:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:1.0:1789130364.136439:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.136442:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ce96d7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abce8 expref: 17 pid: 38734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136465:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff90b4a2a08c00) 00010000:00010000:1.0:1789130364.136468:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130364.136471:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b600/0x5c74554e47ce9bd8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abe69 expref: 16 pid: 36588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136484:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff90b4976b8500) 00010000:00010000:1.0:1789130364.136487:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130364.136490:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87600/0x5c74554e47cea08c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abfd5 expref: 15 pid: 36589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136502:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff90b4a2a08600) 00010000:00010000:1.0:1789130364.136504:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130364.136507:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce9e32 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592abf26 expref: 14 pid: 36587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130364.136520:0:36575:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4921db800, canceled 50 locks, left on hash table 0. 00010000:00010000:1.0:1789130364.136549:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.136552:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130364.136554:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130364.229986:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771670 is committed 00000001:00100000:1.0:1789130364.230009:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000001:00080000:1.0:1789130364.230014:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771674 is committed 00000020:00000080:1.0:1789130364.230024:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b4921db800/587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:0.0:1789130364.230216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921db800/587d445f-41ce-47d3-97fe-edc16e866648 for lustre-MDT0000 00000020:00000080:0.0:1789130364.230298:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1690000 for lustre-MDT0000 00000001:00100000:2.0:1789130364.230493:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:2.0:1789130364.230498:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b381df0000/587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:1.0:1789130364.230628:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b381df0000/587d445f-41ce-47d3-97fe-edc16e866648 for lustre-OST0001 00000020:00000080:1.0:1789130364.230660:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b381df2000 for lustre-OST0001 00010000:00010000:3.0:1789130364.357798:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130365.190144:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130365.190170:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626870016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130365.190258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130365.190469:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870016 00000100:00100000:0.0:1789130365.190476:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870016 00000100:00100000:0.0:1789130365.190539:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789130365.190550:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626870016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130365.190624:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130365.190685:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626870016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130365.190694:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789130365.190759:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3879f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626870016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789130365.192933:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130365.193292:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626870400:0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.193362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130365.193405:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130365.193412:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626870528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.193446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130365.193484:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870400 00000100:00100000:3.0:1789130365.193491:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870400 00000100:00100000:3.0:1789130365.193535:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870528 00000100:00100000:3.0:1789130365.193538:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870528 00000100:00100000:3.0:1789130365.193567:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789130365.193588:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626870400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.193665:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626870400:12345-0@lo:400:kworker.0 Request processed in 90us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130365.193674:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789130365.193690:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789130365.193696:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626870528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.193971:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626870528:12345-0@lo:400:kworker.0 Request processed in 274us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130365.193979:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1789130365.194001:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130365.194035:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626870528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.194045:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626870400:0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.194147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626870144:0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.194185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130365.194220:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626870656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.194242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130365.194261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130365.194266:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626870272:0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.194290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130365.194319:0:38727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870272 00000100:00100000:1.0:1789130365.194323:0:38727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870272 00000100:00100000:1.0:1789130365.194357:0:38727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789130365.194364:0:38727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626870272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.194399:0:38727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626870272:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130365.194405:0:38727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789130365.194433:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626870272:0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.194673:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870144 00000100:00100000:3.0:1789130365.194678:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870144 00000100:00100000:3.0:1789130365.194925:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789130365.194937:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626870144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130365.194990:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3306:x1876037626870144:12345-0@lo:400:kworker.0 Request processed in 55us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130365.194997:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1789130365.195024:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130365.195228:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870656 00000100:00100000:0.0:1789130365.195233:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870656 00000100:00100000:0.0:1789130365.195276:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789130365.195283:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626870656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130365.195322:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626870656:12345-0@lo:400:kworker.0 Request processed in 40us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130365.195327:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1789130365.195671:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130365.196229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626870144:0@lo:400:kworker.0 00000100:00100000:1.0:1789130365.196244:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626870656:0@lo:400:kworker.0 00010000:00010000:1.0:1789130365.382140:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130366.213989:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130366.215307:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626870784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130366.215397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130366.215596:0:37277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870784 00000100:00100000:0.0:1789130366.215625:0:37277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870784 00000100:00100000:0.0:1789130366.215686:0:37277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789130366.215707:0:37277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626870784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130366.215744:0:37277:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130366.215802:0:37277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626870784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130366.215810:0:37277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789130366.215990:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626870784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130366.405758:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130366.493141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130366.493184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130366.493311:0:36579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113088 00000100:00100000:3.0:1789130366.493320:0:36579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113088 00000100:00100000:3.0:1789130366.493380:0:36579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:3.0:1789130366.493390:0:36579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:2368:x1876037605113088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130366.493487:0:36579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:2368:x1876037605113088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130366.493495:0:36579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:1.0:1789130366.494091:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113216 00000100:00100000:1.0:1789130366.494098:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113216 00000100:00100000:1.0:1789130366.494160:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:1.0:1789130366.494169:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605113216:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130366.494215:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3879f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec5d7172-884c-4596-96b1-f5256d22e019+6:2368:x1876037605113216:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130366.494221:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00080000:3.0:1789130366.494346:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130367.165204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130367.165248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130367.165283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130367.165374:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113344 00000100:00100000:1.0:1789130367.165384:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113344 00000100:00100000:1.0:1789130367.165453:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113600 00000100:00100000:1.0:1789130367.165457:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113600 00000100:00100000:1.0:1789130367.165468:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113472 00000100:00100000:1.0:1789130367.165471:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113472 00000100:00100000:1.0:1789130367.165486:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:1.0:1789130367.165496:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+12:2368:x1876037605113344:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130367.165512:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130367.165532:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdce00/0x5c74554e47ce8901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab8f8 expref: 12 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130367.165555:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130367.165657:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+11:2368:x1876037605113344:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130367.165665:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:1.0:1789130367.165683:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:1.0:1789130367.165690:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+10:2368:x1876037605113600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130367.165698:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130367.165708:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce8940 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab95a expref: 10 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130367.165716:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130367.165735:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+9:2368:x1876037605113600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 46us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130367.165740:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:1.0:1789130367.165779:0:36573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1789130367.165785:0:36573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+8:2368:x1876037605113472:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130367.165793:0:36573:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130367.165801:0:36573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce8908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab922 expref: 8 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130367.165809:0:36573:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130367.165824:0:36573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cde14bcb-cae6-4486-a3dc-1826046b76c4+7:2368:x1876037605113472:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 40us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130367.165831:0:36573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789130367.183570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130367.183692:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605113856 00000100:00100000:3.0:1789130367.183703:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605113856 00000100:00100000:3.0:1789130367.183758:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 660 00000100:00100000:3.0:1789130367.183766:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+6:2366:x1876037605113856:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:3.0:1789130367.183806:0:36587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8916 00000020:00010000:3.0:1789130367.183818:0:36587:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4c1690800: total 0 00000100:00080000:3.0:1789130367.183824:0:36587:0:(import.c:65:import_set_state_nolock()) ffff90b4c1695000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130367.183852:0:36587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771674 00000100:00100000:3.0:1789130367.184370:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec5d7172-884c-4596-96b1-f5256d22e019+5:2366:x1876037605113856:12345-192.168.201.39@tcp:39:umount.0 Request processed in 602us (810us total) trans 30064771675 rc 0/0 00000100:00100000:3.0:1789130367.184380:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 660 00000020:00010000:1.0:1789130367.184502:0:36575:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4c1690800: total 0 00010000:00010000:1.0:1789130367.184540:0:36575:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4c1690800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789130367.184569:0:36575:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b496419500) 00010000:00010000:1.0:1789130367.184572:0:36575:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130367.184579:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb42e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac569 expref: 4 pid: 38723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130367.184595:0:36575:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4c1690800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789130367.184640:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130367.184642:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130367.184644:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130367.199760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130367.202552:0:36580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114112 00000100:00100000:2.0:1789130367.202567:0:36580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114112 00000100:00100000:2.0:1789130367.202682:0:36580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:2.0:1789130367.202693:0:36580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+7:2366:x1876037605114112:12345-192.168.201.39@tcp:251:umount.0 00000020:00000080:2.0:1789130367.202745:0:36580:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce88bb 00000020:00010000:2.0:1789130367.202753:0:36580:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4ba7f1800: total 0 00000100:00080000:2.0:1789130367.202759:0:36580:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f6800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789130367.202870:0:36576:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4ba7f1800: total 0 00010000:00010000:1.0:1789130367.202875:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130367.202915:0:36576:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4ba7f1800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789130367.202950:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce88c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ab88f expref: 3 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130367.202967:0:36576:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4ba7f1800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789130367.202976:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130367.202978:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130367.202980:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130367.203206:0:36580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cde14bcb-cae6-4486-a3dc-1826046b76c4+1:2366:x1876037605114112:12345-192.168.201.39@tcp:251:umount.0 Request processed in 514us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130367.203216:0:36580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000020:00000080:2.0:1789130367.203226:0:36580:0:(genops.c:885:class_export_put()) final put ffff90b4ba7f1800/cde14bcb-cae6-4486-a3dc-1826046b76c4 00000020:00000080:1.0:1789130367.203791:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4ba7f1800/cde14bcb-cae6-4486-a3dc-1826046b76c4 for MGS 00000020:00000080:1.0:1789130367.203840:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4ba7f6800 for MGS 00010000:00010000:0.0:1789130367.429770:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130367.429924:0:36624:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789130367.429929:0:36624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130367.430324:0:36624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 5 00000040:00080000:0.0:1789130367.430331:0:36624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789130368.457725:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789130368.849853:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:3.0:1789130368.849862:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4ba7f7000/587d445f-41ce-47d3-97fe-edc16e866648 00000020:00000080:1.0:1789130368.850074:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4ba7f7000/587d445f-41ce-47d3-97fe-edc16e866648 for lustre-OST0000 00000020:00000080:1.0:1789130368.850134:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4ba7f5800 for lustre-OST0000 00000020:01000004:2.0:1789130369.036310:0:42277:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789130369.047845:0:42277:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789130369.047904:0:42277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.047921:0:42277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.047929:0:42277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.047936:0:42277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.047970:0:42277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789130369.047976:0:42277:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789130369.048010:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130369.048015:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789130369.048021:0:42277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789130369.048061:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b4bb011000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789130369.048225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626870912:0@lo:39:umount.0 00010000:00010000:1.0:1789130369.048290:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130369.048297:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130369.048301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130369.048305:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130369.048309:0:36575:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.048327:0:36575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130369.048333:0:36575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130369.048339:0:36575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130369.048341:0:36575:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789130369.048344:0:36575:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789130369.048376:0:36575:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.048383:0:36575:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130369.048411:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.048423:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3200/0x5c74554e47ce85ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce85d5 expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.048434:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130369.048436:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130369.048438:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130369.048445:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130369.048456:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130369.048490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130369.048527:0:36573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871040 00000100:00100000:1.0:1789130369.048534:0:36573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871040 00000100:00100000:3.0:1789130369.048667:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130369.048680:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3309:x1876037626871040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130369.048693:0:36574:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130369.048708:0:36574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdde00/0x5c74554e47ce85d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce85ce expref: 19 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130369.048720:0:36574:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130369.048768:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:3309:x1876037626871040:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130369.048777:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130369.048818:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626871040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130369.048934:0:38734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626870912 00000100:00100000:2.0:1789130369.048939:0:38734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626870912 00000100:00100000:2.0:1789130369.048977:0:38734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1789130369.048985:0:38734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876037626870912:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789130369.049019:0:38734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce85ff 00000100:00080000:2.0:1789130369.049028:0:38734:0:(import.c:65:import_set_state_nolock()) ffff90b487426800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789130369.049092:0:38734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876037626870912:12345-0@lo:39:umount.0 Request processed in 108us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130369.049098:0:38734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000020:00000080:2.0:1789130369.049105:0:38734:0:(genops.c:885:class_export_put()) final put ffff90b3812f8000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789130369.049132:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130369.049153:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4bb011000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789130369.049166:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626870912:0@lo:39:umount.0 00000100:00080000:2.0:1789130369.049270:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130369.049273:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789130369.049277:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130369.049720:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812f8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789130369.049773:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b487426800 for lustre-MDT0000 00010000:00010000:2.0:1789130369.054625:0:42277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054660:0:42277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054673:0:42277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054681:0:42277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054702:0:42277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130369.054708:0:42277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054715:0:42277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054725:0:42277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054731:0:42277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054743:0:42277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789130369.054748:0:42277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054754:0:42277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054760:0:42277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054767:0:42277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054773:0:42277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789130369.054778:0:42277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054784:0:42277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054789:0:42277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054801:0:42277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.054808:0:42277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789130369.054811:0:42277:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789130369.054840:0:42277:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789130369.054844:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789130369.054848:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130369.054853:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789130369.054861:0:42277:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90b4ba7f3000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130369.054867:0:42277:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90b4a7a4d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130369.054874:0:42277:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90b4c1690800 ec5d7172-884c-4596-96b1-f5256d22e019 192.168.201.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 30064771174 stale:0 00000020:00080000:2.0:1789130369.054880:0:42277:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90b4bb024ed8) has exports, disconnecting them 00000020:00080000:2.0:1789130369.054885:0:42277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90b4ba7f3000), last request at 1789130365 00000020:00000080:2.0:1789130369.054892:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce87c6 00000100:00080000:2.0:1789130369.054907:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f2800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789130369.054948:0:42277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4ba7f3000): rc 0 00000020:00000080:2.0:1789130369.054951:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4ba7f3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789130369.054961:0:42277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90b4a7a4d800), last request at 1789130365 00000020:00000080:2.0:1789130369.054965:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8684 00000100:00080000:2.0:1789130369.054970:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789130369.054976:0:42277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4a7a4d800): rc 0 00000020:00000080:2.0:1789130369.054978:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4a7a4d800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789130369.054984:0:42277:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb11205863ae0 00000100:00080000:2.0:1789130369.055003:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789130369.055006:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771290 gen 3 00000004:00080000:2.0:1789130369.055020:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789130369.055098:0:42277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789130369.055122:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b3812fd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789130369.055138:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789130369.055140:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771226 gen 3 00000004:00080000:2.0:1789130369.055148:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789130369.055208:0:42277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789130369.055217:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789130369.055247:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90b4bb024ed8) has no exports 00000020:00000080:2.0:1789130369.055495:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4ba7f3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789130369.055544:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a4d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789130369.055574:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4ba7f2800 for lustre-MDT0000 00000020:00000080:2.0:1789130369.055579:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7a4e800 for lustre-MDT0000 00010000:00010000:2.0:1789130369.055592:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789130369.055633:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055643:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130369.055647:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055657:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130369.055664:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130369.055671:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130369.055673:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789130369.055676:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789130369.055706:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055713:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130369.055731:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055738:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf2a00/0x5c74554e47ce8534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce853b expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055751:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789130369.055755:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055761:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4c00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130369.055765:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055772:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130369.055779:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130369.055785:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130369.055787:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789130369.055789:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789130369.055800:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055806:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130369.055821:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055829:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4afaa4c00/0x5c74554e47ce87d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce87db expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055841:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130369.055845:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055851:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdd600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130369.055854:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055860:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130369.055867:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130369.055872:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789130369.055874:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789130369.055875:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789130369.055886:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055891:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130369.055896:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055901:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdd600/0x5c74554e47ce896a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8971 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055917:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130369.055919:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055924:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130369.055927:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055933:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130369.055939:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130369.055943:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130369.055945:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789130369.055946:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789130369.055956:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055960:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130369.055964:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055969:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3000/0x5c74554e47ce8526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce852d expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.055978:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130369.055979:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130369.055982:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130369.056004:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130369.056018:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626871680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130369.058266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130369.058288:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626871552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130369.058339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130369.058384:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871680 00000100:00100000:1.0:1789130369.058391:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871680 00000100:00100000:1.0:1789130369.058438:0:36572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871552 00000100:00100000:1.0:1789130369.058442:0:36572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871552 00000100:00100000:1.0:1789130369.058464:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130369.058471:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+19:3307:x1876037626871680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130369.058485:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130369.058502:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf2800/0x5c74554e47ce8971 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce896a expref: 19 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.058515:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130369.058551:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+18:3307:x1876037626871680:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130369.058559:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130369.058575:0:36572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130369.058581:0:36572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:3306:x1876037626871552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130369.058588:0:36572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130369.058597:0:36572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdc000/0x5c74554e47ce87db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce87d4 expref: 17 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130369.058623:0:36572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130369.058843:0:36572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3306:x1876037626871552:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130369.058851:0:36572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130369.058885:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626871552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130369.059324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130369.059362:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130369.059382:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130369.059406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130369.059435:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626871168:0@lo:9:umount.0 00000100:00100000:2.0:1789130369.059461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130369.059478:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626871296:0@lo:9:umount.0 00000100:00100000:2.0:1789130369.059497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130369.059543:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871808 00000100:00100000:2.0:1789130369.059549:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871808 00000100:00100000:2.0:1789130369.059579:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871424 00000100:00100000:2.0:1789130369.059582:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871424 00000100:00100000:2.0:1789130369.059596:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130369.059625:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7d5f341-5d27-45e7-8794-684d66c1a62a+17:3308:x1876037626871808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130369.059646:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130369.059661:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eba00/0x5c74554e47ce852d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8526 expref: 17 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.059674:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130369.059704:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7d5f341-5d27-45e7-8794-684d66c1a62a+16:3308:x1876037626871808:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130369.059711:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130369.059727:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130369.059732:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7d5f341-5d27-45e7-8794-684d66c1a62a+15:3308:x1876037626871424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130369.059740:0:38711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130369.059749:0:38711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eb200/0x5c74554e47ce853b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8534 expref: 15 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130369.059757:0:38711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130369.059777:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:3308:x1876037626871424:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130369.059783:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130369.059816:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130369.059824:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130369.059857:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7d5f341-5d27-45e7-8794-684d66c1a62a:3307:1876037626871680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130369.060059:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871168 00000100:00100000:1.0:1789130369.060064:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871168 00000100:00100000:1.0:1789130369.060109:0:37658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871296 00000100:00100000:1.0:1789130369.060112:0:37658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871296 00000100:00100000:1.0:1789130369.060131:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789130369.060137:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876037626871168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789130369.060170:0:37658:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce86a0 00000100:00080000:1.0:1789130369.060178:0:37658:0:(import.c:65:import_set_state_nolock()) ffff90b4c1692800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130369.060215:0:37658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771290 00000100:00100000:1.0:1789130369.060572:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876037626871168:12345-0@lo:9:umount.0 Request processed in 434us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130369.060580:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789130369.060594:0:37658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789130369.060623:0:37658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876037626871296:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789130369.060884:0:37658:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce87e2 00000100:00080000:1.0:1789130369.060892:0:37658:0:(import.c:65:import_set_state_nolock()) ffff90b4921de000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130369.060908:0:37658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771226 00000100:00100000:1.0:1789130369.061285:0:37658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876037626871296:12345-0@lo:9:umount.0 Request processed in 683us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130369.061292:0:37658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1789130369.061348:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b3812fd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789130369.061363:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789130369.061375:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130369.061379:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626871168:0@lo:9:umount.0 00000100:00080000:1.0:1789130369.061392:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b492736000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789130369.061402:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789130369.061403:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130369.061406:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626871296:0@lo:9:umount.0 00010000:00010000:1.0:1789130369.061441:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130369.061512:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130369.061517:0:36583:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130369.061650:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130369.072032:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90b4bb024ed8) has no exports 00000020:00000080:2.0:1789130369.139272:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8581 00000020:00000080:2.0:1789130369.139288:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4bfbeb800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789130369.139316:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789130369.139349:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bfbeb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789130369.139431:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130369.139444:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789130369.139448:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90b487c71a48) has no exports 00000020:00000080:3.0:1789130369.140237:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce857a 00000020:00000080:3.0:1789130369.140245:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4bfbef800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789130369.140302:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bfbef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130369.140359:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130369.140376:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789130369.140379:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4bfbea000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789130369.140382:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bfbea000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789130369.140390:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1789130369.364346:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec5d7172-884c-4596-96b1-f5256d22e019 00000001:00080000:1.0:1789130369.364370:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771675 is committed 00000020:00000080:1.0:1789130369.364376:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b4c1690800/ec5d7172-884c-4596-96b1-f5256d22e019 00000020:00000080:2.0:1789130369.364449:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c1690800/ec5d7172-884c-4596-96b1-f5256d22e019 for lustre-MDT0000 00000020:00000080:2.0:1789130369.364514:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1695000 for lustre-MDT0000 00000001:00100000:2.0:1789130369.389560:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789130369.389572:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4921dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789130369.389632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789130369.396435:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4921de000 for lustre-OST0001 00010000:00010000:1.0:1789130369.477890:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130370.310202:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626872064:0@lo:400:kworker.0 00000100:00100000:0.0:1789130370.311544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130370.311683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130370.311696:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626872192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130370.311764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130370.311927:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130370.311940:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130370.311980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130370.312031:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872064 00000100:00100000:3.0:1789130370.312039:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872064 00000100:00100000:3.0:1789130370.312080:0:36587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872192 00000100:00100000:3.0:1789130370.312083:0:36587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872192 00000100:00100000:3.0:1789130370.312104:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1789130370.312112:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1876037626872064:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789130370.312121:0:36587:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789130370.312181:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1876037626872064:12345-0@lo:400:kworker.0 Request processed in 67us (1897us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789130370.312189:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1789130370.312205:0:36587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1789130370.312209:0:36587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1876037626872192:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789130370.312214:0:36587:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789130370.312234:0:36587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1876037626872192:12345-0@lo:400:kworker.0 Request processed in 22us (469us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789130370.312239:0:36587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00080000:3.0:1789130370.312281:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789130370.312286:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789130370.312290:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789130370.316647:0:36581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626871936 00000100:00100000:0.0:1789130370.316663:0:36581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626871936 00000100:00100000:0.0:1789130370.316741:0:36581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789130370.316750:0:36581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:3308:x1876037626871936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130370.316837:0:36581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7d5f341-5d27-45e7-8794-684d66c1a62a+14:3308:x1876037626871936:12345-0@lo:400:kworker.0 Request processed in 90us (4857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130370.316842:0:36581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789130370.316962:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626871936:0@lo:400:kworker.0 00000100:00080000:3.0:1789130370.323968:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130370.323985:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1241 00000100:00080000:3.0:1789130370.323997:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4ba7f4800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130370.324049:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e143c0 x1876037626872320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130370.324154:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626872320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789130370.324238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130370.324367:0:36588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872320 00000100:00100000:2.0:1789130370.324376:0:36588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872320 00000100:00100000:2.0:1789130370.324429:0:36588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1789130370.324438:0:36588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626872320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789130370.324457:0:36588:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789130370.328885:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626872192:0@lo:400:kworker.0 00000100:00080000:3.0:1789130370.328936:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789130370.328942:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789130370.328946:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789130370.328951:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130370.328955:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1223 00000100:00080000:3.0:1789130370.328964:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b4a7a4a000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130370.329021:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e17840 x1876037626872448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130370.329119:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626872448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789130370.329191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130370.329259:0:38723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872448 00000100:00100000:1.0:1789130370.329267:0:38723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872448 00000100:00100000:1.0:1789130370.329312:0:38723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1789130370.329339:0:38723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876037626872448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789130370.329366:0:38723:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789130370.329435:0:38723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876037626872448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 113us (242us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130370.329443:0:38723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:1.0:1789130370.329480:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130370.329484:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130370.329487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626872448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789130370.336167:0:36588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626872320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 11714us (11914us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130370.336186:0:36588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00080000:1.0:1789130370.340209:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130370.340225:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130370.340230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626872320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789130370.340623:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626872064:0@lo:400:kworker.0 00010000:00010000:2.0:1789130370.502265:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789130371.141825:0:42277:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b497f24780 - data ffff90b492bf1bd0/ffff90b4bbdaf000 00000020:01000000:3.0:1789130371.142136:0:42277:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4bfc941e0 - data ffff90b3817031b0/ffff90b4a69b8c00 00000001:00000004:3.0:1789130371.153885:0:42277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771675 00000100:00080000:3.0:1789130371.268780:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789130371.268789:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771290 gen 4 00000004:00080000:3.0:1789130371.268809:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789130371.268812:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789130371.270006:0:36609:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789130371.270023:0:36609:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x28:0x0] index 21 count 1 00000040:00080000:0.0:1789130371.270035:0:36609:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 7 count 2 00000100:00080000:3.0:1789130371.271230:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789130371.271238:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771226 gen 4 00000004:00080000:3.0:1789130371.271260:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789130371.271263:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789130371.272568:0:36611:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789130371.272574:0:36611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2a:0x0] index 21 count 1 00000040:00080000:0.0:1789130371.272586:0:36611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 7 count 2 00000020:00000080:1.0:1789130371.367302:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8549 00000020:00000080:1.0:1789130371.367317:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b487c98000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130371.367371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487c98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789130371.368727:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce855e 00000020:00000080:1.0:1789130371.368740:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b3812fe000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130371.368757:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789130371.368766:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.368775:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789130371.368779:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90b4bb023490) has no exports 00000020:00000080:3.0:1789130371.368924:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789130371.368944:0:42277:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789130371.368952:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce85ab 00000020:00000080:1.0:1789130371.368957:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b3812fd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130371.368969:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789130371.368972:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.368976:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130371.368979:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90b4ba400000) has no exports 00000020:00000080:1.0:1789130371.368985:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce85a4 00000020:00000080:1.0:1789130371.368988:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b492730800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130371.369104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789130371.369111:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b492730800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789130371.370592:0:42277:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789130371.370618:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789130371.370623:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771226 gen 5 00000004:00080000:1.0:1789130371.370630:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130371.370633:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130371.370681:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.370690:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130371.370698:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8596 00000020:00000080:1.0:1789130371.370707:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b48a376000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130371.370713:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789130371.370718:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.370722:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130371.370726:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff90b4bb021a48) has no exports 00000020:00000080:1.0:1789130371.370731:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce858f 00000020:00000080:1.0:1789130371.370735:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b3812ff000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130371.370785:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b492736000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789130371.370793:0:36:0:(genops.c:885:class_export_put()) final put ffff90b3812fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130371.370796:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789130371.370802:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130371.370885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48a376000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789130371.370891:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789130371.371403:0:42277:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789130371.371407:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789130371.371410:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771290 gen 5 00000004:00080000:1.0:1789130371.371415:0:42277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130371.371417:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130371.371455:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.371461:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130371.371469:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b3812fd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789130371.371476:0:36:0:(genops.c:885:class_export_put()) final put ffff90b3812fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130371.371478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789130371.371482:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130371.371484:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.371487:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130371.371556:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b487c9e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789130371.371559:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487c9e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789130371.371564:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130371.371699:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8565 00000020:00000080:1.0:1789130371.371704:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b3812fa800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789130371.371719:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789130371.371723:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.371726:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789130371.371729:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90b4bb020000) has no exports 00000020:00000080:1.0:1789130371.371746:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.371749:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789130371.371753:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce856c 00000020:00000080:1.0:1789130371.371757:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b3812f9000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789130371.371766:0:42277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b485290000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789130371.371769:0:42277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b485290000 3 00000020:01000004:1.0:1789130371.371772:0:42277:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b485290000 from lustre-MDT0000 00000020:00000080:1.0:1789130371.371790:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.371792:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789130371.371794:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b487c99000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789130371.371796:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487c99000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789130371.371804:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789130371.371826:0:42277:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789130371.371829:0:42277:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789130371.371832:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789130371.371834:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.371837:0:42277:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789130371.371843:0:42277:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90b4870b9800 c7d5f341-5d27-45e7-8794-684d66c1a62a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789130371.371849:0:42277:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90b3830b8000) has exports, disconnecting them 00000020:00080000:1.0:1789130371.371853:0:42277:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90b4870b9800), last request at 1789130043 00000020:00000080:1.0:1789130371.371866:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8511 00000020:00010000:1.0:1789130371.371870:0:42277:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4870b9800: total 2 00000100:00080000:1.0:1789130371.371874:0:42277:0:(import.c:65:import_set_state_nolock()) ffff90b4870be000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789130371.371894:0:42277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4870b9800): rc 0 00000020:00080000:1.0:1789130371.371899:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90b3830b8000) has no exports 00000020:00010000:0.0:1789130371.371919:0:36576:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4870b9800: total 2 00010000:00010000:0.0:1789130371.371946:0:36576:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4870b9800, canceled 0 locks, left on hash table 8. 00000100:00100000:1.0:1789130371.371950:0:36581:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90b485d53a00:36581] 2 exiting: rc = 0 00010000:00010000:0.0:1789130371.371972:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa5a00/0x5c74554e47ce866f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8668 expref: 9 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.371991:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4afaa5600/0x5c74554e47ce851f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8518 expref: 8 pid: 36580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372002:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926ebc00/0x5c74554e47ce8637 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8630 expref: 7 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372032:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eae00/0x5c74554e47ce8963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce895c expref: 6 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372042:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eb000/0x5c74554e47ce8787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8780 expref: 5 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372051:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdc800/0x5c74554e47ce8645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce863e expref: 4 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372061:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bfbdc400/0x5c74554e47ce894e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce8947 expref: 3 pid: 36579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372072:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926ea200/0x5c74554e47ce87b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce87aa expref: 2 pid: 36581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130371.372081:0:36576:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4870b9800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789130371.372092:0:36576:0:(genops.c:885:class_export_put()) final put ffff90b4870b9800/c7d5f341-5d27-45e7-8794-684d66c1a62a 00010000:00010000:0.0:1789130371.372097:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130371.372100:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130371.372102:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789130371.372350:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fa800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789130371.372356:0:36:0:(genops.c:885:class_export_put()) final put ffff90b487c9d800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789130371.372359:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487c9d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789130371.372364:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789130371.372585:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130371.372590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4870b9800/c7d5f341-5d27-45e7-8794-684d66c1a62a for MGS 00000020:00000080:3.0:1789130371.372648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4870be000 for MGS 00000100:00100000:3.0:1789130371.376056:0:36580:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90b4b5a88e00:36580] 1 exiting: rc = 0 00000100:00100000:3.0:1789130371.378242:0:36579:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90b485d22400:36579] 0 exiting: rc = 1 00000100:00100000:1.0:1789130371.378404:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378413:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378420:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378426:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378431:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378437:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378442:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378450:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378456:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378462:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378467:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378473:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378478:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378484:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378499:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378505:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378511:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378515:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378521:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378527:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378533:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378538:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378543:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378549:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378555:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378560:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378566:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378572:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378577:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378583:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378588:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378598:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378623:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378629:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378635:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378642:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378648:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378654:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378660:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378665:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378671:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378677:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378683:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378689:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378696:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378702:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378708:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378713:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378719:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378725:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378730:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378736:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378743:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378749:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378754:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378759:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378765:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378771:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378776:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378782:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378788:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378793:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378799:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.378804:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789130371.379248:0:42277:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789130371.379253:0:42277:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789130371.383484:0:42277:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b488ace420 - data ffff90b4bfe786c0/ffff90b486f1ac00 00000020:01000000:1.0:1789130371.383726:0:42277:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4bfc94d20 - data ffff90b4bff2dbd0/ffff90b49fd05000 00000020:00000080:1.0:1789130371.384292:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce84f5 00000020:00000080:1.0:1789130371.384300:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4876ac800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789130371.384322:0:42277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b485290000 from MGS, refs=2 00000020:01000004:1.0:1789130371.384337:0:42277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b485290000 2 00000020:01000004:1.0:1789130371.384340:0:42277:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b485290000 from MGS 00000020:00000080:0.0:1789130371.384366:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4876ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789130371.384945:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130371.384956:0:42277:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789130371.384960:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4876ae000/MGS 00000020:00000080:1.0:1789130371.384964:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4876ae000/MGS for MGS 00000020:01000000:1.0:1789130371.384974:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789130371.386157:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789130371.386167:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130371.386175:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789130371.386183:0:42277:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90b4c0948000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789130371.386190:0:42277:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff90b4ba401a48) has exports, disconnecting them 00000020:00080000:1.0:1789130371.386195:0:42277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90b4c0948000), last request at 1789130044 00000020:00000080:1.0:1789130371.386199:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce85e3 00000020:00080000:1.0:1789130371.386214:0:42277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4c0948000): rc 0 00000020:00000080:1.0:1789130371.386218:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4c0948000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789130371.386376:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c0948000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789130371.387664:0:42277:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789130371.387672:0:42277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130371.387676:0:42277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789130371.387683:0:42277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789130371.387849:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130371.387856:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789130371.387863:0:42277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b485290000 1 00000020:00000080:0.0:1789130371.387868:0:42277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce84e7 00000020:00000080:0.0:1789130371.387875:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b4876aa000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789130371.387880:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789130371.387884:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130371.387887:0:42277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789130371.387890:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90b487c73490) has no exports 00000020:00000080:3.0:1789130371.388322:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4bb011000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789130371.388340:0:31907:0:(genops.c:885:class_export_put()) final put ffff90b485d0d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789130371.388343:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485d0d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789130371.388356:0:31907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789130371.388421:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4876aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130371.450034:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130371.450060:0:42277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789130371.450066:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b485290800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130371.450070:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485290800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789130371.450078:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789130371.450244:0:42277:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b485296000 00000020:01000000:3.0:1789130371.450269:0:42277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789130371.450274:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130371.450279:0:42277:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789130371.450284:0:42277:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90b487cb1a48) has no exports 00000100:00100000:0.0:1789130371.452677:0:36587:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90b487ca3600:36587] 0 exiting: rc = 1 00000100:00100000:1.0:1789130371.453171:0:36589:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90b488812400:36589] 2 exiting: rc = 0 00000100:00100000:1.0:1789130371.453240:0:38723:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90b381989400:38723] 3 exiting: rc = 0 00000100:00100000:1.0:1789130371.453298:0:38734:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90b48617a200:38734] 4 exiting: rc = 0 00000100:00100000:2.0:1789130371.456298:0:36588:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90b485d53c00:36588] 1 exiting: rc = 0 00000100:00100000:3.0:1789130371.457035:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457045:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457063:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457069:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457075:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457081:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457087:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457093:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457098:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457112:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457120:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457127:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457132:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457137:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457142:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457148:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457153:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457158:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457164:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457170:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457175:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457179:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457184:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457189:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457195:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457200:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457205:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457210:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457215:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457222:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457227:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457232:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457238:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457245:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457250:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457255:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457261:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457266:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457272:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457280:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457286:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457291:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457296:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457301:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457307:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457312:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457320:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457339:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.457346:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458461:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458478:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458484:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458558:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458565:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458570:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458576:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458581:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458586:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458591:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458597:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458629:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458636:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458641:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.458649:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.468762:0:36591:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90b488812a00:36591] 1 exiting: rc = 0 00000100:00100000:2.0:1789130371.470551:0:36590:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90b489945000:36590] 0 exiting: rc = 1 00000100:00100000:3.0:1789130371.470961:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.470969:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.470977:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.470984:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.470990:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.470996:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471003:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471009:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471016:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471022:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471029:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471036:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471042:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471060:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471067:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471073:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471078:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471084:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471090:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471097:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471103:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471109:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471114:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471120:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471126:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471132:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471138:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471144:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471149:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471156:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471167:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471172:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471178:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471184:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471190:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471195:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471200:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471206:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471211:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471216:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471221:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471226:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471231:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471235:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471240:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471244:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471248:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471253:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471258:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471264:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471270:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471275:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471280:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471285:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471290:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471294:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471299:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471304:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471310:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471315:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471321:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471338:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471343:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.471349:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.473311:0:36593:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90b489954c00:36593] 1 exiting: rc = 0 00000100:00100000:0.0:1789130371.473459:0:40999:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff90b390c84800:40999] 2 exiting: rc = 0 00000100:00100000:3.0:1789130371.474721:0:36592:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90b4c1955400:36592] 0 exiting: rc = 1 00000100:00100000:3.0:1789130371.474812:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474822:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474830:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474837:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474843:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474849:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474855:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474862:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474871:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474876:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474883:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474906:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474913:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474920:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474927:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474935:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474941:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474947:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474955:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474961:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474968:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474974:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.474981:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475006:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475015:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475022:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475029:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475035:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475041:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475059:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475066:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475072:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475077:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475082:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475088:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475108:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475115:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475121:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475126:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475133:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475138:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475144:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475149:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475154:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475160:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475166:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475172:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475191:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475197:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475203:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475209:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475214:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475220:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475226:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475232:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475238:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475244:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475249:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475255:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475275:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475284:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475289:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475295:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.475300:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.498346:0:36594:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90b489954a00:36594] 0 exiting: rc = 1 00000100:00100000:0.0:1789130371.498678:0:36595:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90b484c7da00:36595] 1 exiting: rc = 0 00000100:00100000:3.0:1789130371.498789:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498797:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498803:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498808:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498813:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498818:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498823:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498829:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498835:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498841:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498848:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498854:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498860:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498866:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498871:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498875:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498880:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498885:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498890:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498895:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498899:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498904:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498909:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498914:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498919:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498925:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498930:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498934:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498940:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498945:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498950:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498954:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498959:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498965:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498971:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498976:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498981:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498986:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498992:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.498996:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499001:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499006:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499012:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499017:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499022:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499028:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499033:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499039:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499044:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499413:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499423:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499429:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499434:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499439:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499445:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499450:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499455:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499460:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499466:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499470:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499475:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499480:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499485:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.499559:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.500841:0:36597:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90b498978400:36597] 1 exiting: rc = 0 00000100:00100000:0.0:1789130371.500954:0:36596:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90b484c7cc00:36596] 0 exiting: rc = 1 00000100:00100000:3.0:1789130371.504214:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504224:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504229:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504235:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504241:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504246:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504251:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504256:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504260:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504265:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504270:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504276:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504281:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504286:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504291:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504295:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504301:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504306:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504311:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504316:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504333:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504340:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504345:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504350:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504366:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504371:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504377:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504382:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504387:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504393:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504398:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504403:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504408:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504413:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504418:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504424:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504429:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504435:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504440:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504445:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504449:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504454:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504460:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504465:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504470:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504475:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504480:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504485:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504501:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504506:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504511:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504517:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504522:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504527:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504532:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504536:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504541:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504545:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504551:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504555:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504559:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504564:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504568:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504574:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130371.504988:0:36599:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90b381ced200:36599] 1 exiting: rc = 0 00000100:00100000:3.0:1789130371.506268:0:36598:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90b484c7c000:36598] 0 exiting: rc = 1 00000100:00100000:0.0:1789130371.506457:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506463:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506469:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506473:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506478:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506483:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506487:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506503:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506508:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506513:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506518:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506523:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506527:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506533:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506539:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506543:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506548:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506553:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506557:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506562:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506566:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506571:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506577:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506582:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506587:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506591:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506596:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506616:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506623:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506628:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506633:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506638:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506644:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506649:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506654:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506658:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506663:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506668:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506673:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506678:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506684:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506690:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506695:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506700:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506704:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506709:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506714:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506719:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506724:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506728:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506733:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506739:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506745:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506750:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506755:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506760:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506765:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506770:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506786:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506792:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506796:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506801:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506807:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.506812:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130371.507929:0:36600:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90b381cec600:36600] 0 exiting: rc = 1 00000100:00100000:2.0:1789130371.512648:0:36601:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90b488ab1000:36601] 1 exiting: rc = 0 00000100:00100000:2.0:1789130371.513024:0:36602:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90b49104ec00:36602] 2 exiting: rc = 0 00010000:00010000:3.0:1789130371.532173:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130371.550583:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550593:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550598:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550615:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550621:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550627:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550632:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550638:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550644:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550649:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550655:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550660:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550666:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550672:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550677:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550687:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550693:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550699:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550704:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550711:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550717:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550724:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550732:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550757:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550765:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550771:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550778:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550784:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550791:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550798:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550804:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550810:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550816:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550822:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550827:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550833:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550839:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550848:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550855:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550860:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550866:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550872:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550878:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550883:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550889:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550895:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550903:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550908:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550914:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550920:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550926:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550932:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550937:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550942:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550949:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550954:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550962:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550969:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550974:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550978:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550985:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550990:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.550996:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130371.551003:0:42277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789130371.559711:0:42277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130371.559727:0:42277:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789130371.559733:0:42277:0:(genops.c:885:class_export_put()) final put ffff90b487420000/MDS_uuid 00000020:00000080:0.0:1789130371.559737:0:42277:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487420000/MDS_uuid for MDS 00000020:01000000:0.0:1789130371.559748:0:42277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789130371.559909:0:42277:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789130372.552834:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130373.574107:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789130373.972804:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130373.972813:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4c1692000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789130373.973163:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c1692000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789130373.982850:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c1692800 for lustre-OST0000 00010000:00010000:1.0:1789130374.601374:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789130375.009403:0:42431:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789130375.035485:0:42431:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789130375.035531:0:42431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.035546:0:42431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.035554:0:42431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.035561:0:42431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.035587:0:42431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789130375.035594:0:42431:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789130375.035638:0:42431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130375.035643:0:42431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789130375.035648:0:42431:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789130375.035654:0:42431:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a4a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789130375.035659:0:42431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130375.035661:0:42431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789130375.035663:0:42431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789130375.035770:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130375.035778:0:36575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130375.035786:0:36575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130375.035790:0:36575:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130375.035800:0:36575:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130375.035808:0:36575:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130375.035814:0:36575:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130375.035816:0:36575:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789130375.035819:0:36575:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789130375.035855:0:36575:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130375.035861:0:36575:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130375.035899:0:36575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130375.035907:0:36575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3c00/0x5c74554e47ce8668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce866f expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130375.035920:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130375.035922:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130375.035923:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130375.036171:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626872576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130375.036312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130375.036437:0:38711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872576 00000100:00100000:1.0:1789130375.036444:0:38711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872576 00010000:00010000:3.0:1789130375.036482:0:42431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.036492:0:42431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.036498:0:42431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.036504:0:42431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130375.036516:0:38711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00010000:00010000:3.0:1789130375.036518:0:42431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130375.036523:0:42431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130375.036524:0:38711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1876037626872576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130375.036530:0:42431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1789130375.036530:0:38711:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789130375 with bad export cookie 6662043543488333073 00010000:00010000:3.0:1789130375.036536:0:42431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.036546:0:42431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130375.036555:0:42431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789130375.036558:0:42431:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789130375.036577:0:42431:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789130375.036581:0:42431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789130375.036586:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130375.036592:0:42431:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789130375.036596:0:42431:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90b4ba403490) has no exports 00000020:00080000:3.0:1789130375.036804:0:42431:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90b4ba403490) has no exports 00000020:01000000:3.0:1789130375.038995:0:42431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b488acec00 - data ffff90b49d16b0d8/ffff90b4c197d800 00000020:01000000:3.0:1789130375.039141:0:42431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4c095fc00 - data ffff90b4b9c03438/ffff90b3834e5c00 00010000:00010000:2.0:1789130375.039559:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130375.039568:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039579:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130375.039583:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039594:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130375.039621:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130375.039628:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130375.039630:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789130375.039633:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789130375.039675:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039682:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130375.039705:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039717:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce863e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8645 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039728:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130375.039732:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039737:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bfbdda00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130375.039740:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039748:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130375.039754:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130375.039759:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789130375.039761:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789130375.039763:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789130375.039775:0:36576:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039781:0:36576:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130375.039795:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039802:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4bfbdda00/0x5c74554e47ce895c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce8963 expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130375.039816:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130375.039817:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130375.039820:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130375.039836:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626872704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130375.039900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130375.046739:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626872832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130375.046807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130375.046943:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872704 00000100:00100000:0.0:1789130375.046953:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872704 00000100:00100000:0.0:1789130375.046996:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130375.047005:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876037626872704:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130375.050980:0:36572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789130375.051001:0:36572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789130375.051148:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:0.0:1789130375.051677:0:36574:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789130375 with bad export cookie 6662043543488333073 00000100:00100000:0.0:1789130375.051775:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876037626872704:12345-0@lo:103:ldlm_bl.0 Request processed in 4767us (11872us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130375.051787:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130375.051816:0:36574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626872832 00000100:00100000:0.0:1789130375.051823:0:36574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626872832 00000100:00100000:0.0:1789130375.051847:0:36574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130375.051854:0:36574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1876037626872832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789130375.051859:0:36574:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789130375 with bad export cookie 6662043543488333073 00000100:00100000:0.0:1789130375.051889:0:36574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1876037626872832:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (5083us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130375.051895:0:36574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789130375.054757:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789130375.054765:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b4870be800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789130375.054770:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789130375.057077:0:38711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1876037626872576:12345-0@lo:103:ldlm_bl.0 Request processed in 20547us (20759us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789130375.057095:0:38711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789130375.057353:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789130375.067953:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789130375.083450:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.139@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789130375.083457:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789130375.083468:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b3868a3c00 x1876037626872576/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130391 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130375.083483:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bae783c0 x1876037626872704/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130391 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130375.083492:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bae792c0 x1876037626872832/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130391 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789130375.083501:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789130375.083505:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789130375.083506:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789130375.087395:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90b4870be800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789130375.087429:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7d5f341-5d27-45e7-8794-684d66c1a62a:3308:1876037626872576:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789130375.087806:0:3306:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90b4870be800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789130375.087819:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7d5f341-5d27-45e7-8794-684d66c1a62a:3306:1876037626872832:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789130375.088311:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b4870be800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130375.088318:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 1206 00000100:00080000:2.0:1789130375.088326:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b4870be800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789130375.088355:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae7b480 x1876037626872960/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789130375.088388:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7d5f341-5d27-45e7-8794-684d66c1a62a:3309:1876037626872704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130375.088662:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7d5f341-5d27-45e7-8794-684d66c1a62a:3305:1876037626872960:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1789130375.088724:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876037626872960 offset 0 length 520: 4 00100000:10000000:3.0:1789130375.099585:0:42431:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789130375.153002:0:42431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8653 00000020:00000080:2.0:1789130375.153013:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b489cb4000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789130375.153032:0:42431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4b77e8800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789130375.153036:0:42431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4b77e8800 2 00000020:01000004:2.0:1789130375.153039:0:42431:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b4b77e8800 from lustre-OST0000 00000020:00000080:2.0:1789130375.153063:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130375.153073:0:42431:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789130375.153076:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b4bb012000/lustre-OST0000_UUID 00000020:00000080:2.0:1789130375.153079:0:42431:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb012000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789130375.153088:0:42431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789130375.153123:0:42431:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789130375.153127:0:42431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789130375.153130:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130375.153134:0:42431:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789130375.153140:0:42431:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90b4a7a48800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130375.153146:0:42431:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90b4ba404ed8) has exports, disconnecting them 00000020:00080000:2.0:1789130375.153150:0:42431:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90b4a7a48800), last request at 1789130060 00000020:00000080:2.0:1789130375.153154:0:42431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce867d 00000020:00080000:2.0:1789130375.153161:0:42431:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4a7a48800): rc 0 00000020:00000080:2.0:1789130375.153165:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b4a7a48800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789130375.153833:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789130375.153846:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a48800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789130375.164167:0:42431:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789130375.164175:0:42431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130375.164180:0:42431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789130375.164186:0:42431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130375.164313:0:31907:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7a4a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789130375.164391:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130375.164400:0:42431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789130375.164406:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b489cb5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789130375.164411:0:42431:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789130375.164421:0:42431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789130375.164484:0:42431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4b77e8800 1 00000020:00000080:0.0:1789130375.164490:0:42431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8622 00000020:00000080:0.0:1789130375.164496:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b488b5a800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789130375.164513:0:42431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789130375.164518:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130375.164522:0:42431:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789130375.164526:0:42431:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90b487c70000) has no exports 00000020:00000080:1.0:1789130375.164634:0:31907:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488b5a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789130375.188766:0:42431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130375.188785:0:42431:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789130375.188791:0:42431:0:(genops.c:885:class_export_put()) final put ffff90b4b77ea800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789130375.188796:0:42431:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4b77ea800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789130375.188807:0:42431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789130375.188929:0:42431:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b4b77e8000 00000020:02000400:0.0:1789130375.188981:0:42431:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789130375.432750:0:31907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130375.432760:0:31907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789130375.432764:0:31907:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130375.432773:0:31907:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1533 00000100:00080000:3.0:1789130375.432779:0:31907:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789130375.432785:0:31907:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4ba7f4800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130375.432823:0:31907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e14f00 x1876037626873088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130375.432993:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626873088:0@lo:38:kworker.0 00000400:00000100:3.0:1789130375.433589:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876037626873088 offset 0 length 520: 4 00010000:00010000:2.0:1789130375.625454:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130376.646757:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130377.670809:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789130378.105563:0:42581:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789130378.118342:0:42581:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789130378.118453:0:42581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.118473:0:42581:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.118481:0:42581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.118489:0:42581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.118524:0:42581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789130378.118530:0:42581:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789130378.118561:0:42581:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130378.118579:0:42581:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b388e14f00 x1876037626873088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130378.118633:0:42581:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789130378.118641:0:42581:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789130378.118648:0:42581:0:(import.c:65:import_set_state_nolock()) ffff90b4ba7f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789130378.118654:0:42581:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130378.118659:0:42581:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b388e14f00 x1876037626873088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130390 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130378.118667:0:42581:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789130378.118670:0:42581:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1789130378.119142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626873088:0@lo:38:kworker.0 00010000:00010000:0.0:1789130378.121422:0:42581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121446:0:42581:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121455:0:42581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121463:0:42581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121946:0:42581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789130378.121958:0:42581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121966:0:42581:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121972:0:42581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130378.121979:0:42581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123357:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789130378.123375:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123389:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130378.123394:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123406:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130378.123414:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130378.123420:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130378.123423:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789130378.123427:0:36576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789130378.123450:0:36576:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4870be800 00010000:00010000:3.0:1789130378.123454:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123462:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce87aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce87b1 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123478:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130378.123482:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123504:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130378.123508:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123514:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130378.123521:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130378.123526:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130378.123528:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1789130378.123532:0:36576:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4870be800 00010000:00010000:3.0:1789130378.123535:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123541:0:36576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf2400/0x5c74554e47ce8780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce8787 expref: -99 pid: 37992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123551:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130378.123556:0:36576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123562:0:36576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eac00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130378.123565:0:36576:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123571:0:36576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130378.123578:0:36576:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130378.123705:0:36576:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789130378.123708:0:36576:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789130378.123715:0:36576:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4870be800 00010000:00010000:3.0:1789130378.123718:0:36576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.123727:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130378.123728:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130378.123730:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130378.123973:0:36575:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130378.125888:0:42581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789130378.125909:0:42581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce8947 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce894e expref: -99 pid: 36584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130378.125937:0:42581:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789130378.125944:0:42581:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789130378.125948:0:42581:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789130378.125991:0:42581:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789130378.125997:0:42581:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789130378.126012:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130378.126020:0:42581:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789130378.126026:0:42581:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90b383108000) has no exports 00000020:00080000:0.0:1789130378.126754:0:42581:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90b383108000) has no exports 00010000:00010000:3.0:1789130378.128874:0:36576:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789130378.130237:0:42581:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b488aceea0 - data ffff90b4a26e5360/ffff90b4c197e800 00000020:01000000:2.0:1789130378.130450:0:42581:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4c1a29d80 - data ffff90b4b9c95870/ffff90b49fdfa000 00100000:10000000:0.0:1789130378.145527:0:42581:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789130378.220807:0:42581:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8795 00000020:00000080:3.0:1789130378.220820:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b48303c800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789130378.220839:0:42581:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4856bb000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789130378.220844:0:42581:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4856bb000 2 00000020:01000004:3.0:1789130378.220848:0:42581:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b4856bb000 from lustre-OST0001 00000020:00000080:3.0:1789130378.220880:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130378.220894:0:42581:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789130378.220897:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b4a7a4c000/lustre-OST0001_UUID 00000020:00000080:3.0:1789130378.220901:0:42581:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a4c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789130378.220911:0:42581:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789130378.221058:0:42581:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c7d5f341-5d27-45e7-8794-684d66c1a62a->MGS 00010000:00010000:3.0:1789130378.221078:0:42581:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130378.221092:0:42581:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130378.221105:0:42581:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789130378.221108:0:42581:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789130378.221113:0:42581:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789130378.221132:0:42581:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4870be800 00010000:00010000:3.0:1789130378.221137:0:42581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf2000/0x5c74554e47ce8630 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce8637 expref: -99 pid: 37272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130378.221167:0:42581:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130378.221174:0:42581:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130378.221180:0:42581:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130378.221182:0:42581:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789130378.221184:0:42581:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789130378.221195:0:42581:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b4870be800 00010000:00010000:3.0:1789130378.221198:0:42581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926ea800/0x5c74554e47ce8518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce851f expref: -99 pid: 36569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130378.221230:0:42581:0:(import.c:65:import_set_state_nolock()) ffff90b4870be800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789130378.221234:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789130378.221237:0:42581:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789130378.221239:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789130378.221244:0:42581:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789130378.221258:0:42581:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bae7b480 x1876037626872960/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789130385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789130378.221285:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789130378.221289:0:42581:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1789130378.221450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48303c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789130378.221558:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7d5f341-5d27-45e7-8794-684d66c1a62a:3305:1876037626872960:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1789130378.221888:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789130378.221900:0:42581:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8503 00000020:00000080:3.0:1789130378.221908:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b487423800/c7d5f341-5d27-45e7-8794-684d66c1a62a 00000020:01000000:3.0:1789130378.221955:0:42581:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.139@tcp (flags='') 00000020:00000080:3.0:1789130378.221963:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130378.221969:0:42581:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789130378.221974:0:42581:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90b3830bced8) has no exports 10000000:01000000:0.0:1789130378.222039:0:36584:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789130378.222139:0:42581:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.139@tcp: client import never connected 00000100:00080000:3.0:1789130378.222142:0:42581:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789130378.222144:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789130378.222147:0:42581:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789130378.222159:0:42581:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789130378.222378:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b487423800/c7d5f341-5d27-45e7-8794-684d66c1a62a for MGC192.168.201.139@tcp 00000020:00000080:3.0:1789130378.222461:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130378.222468:0:42581:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.139@tcp (uuid c7d5f341-5d27-45e7-8794-684d66c1a62a) 00000020:01000000:3.0:1789130378.222475:0:42581:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789130378.222478:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130378.222482:0:42581:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789130378.222488:0:42581:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90b4ba7f0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789130378.222503:0:42581:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff90b487cb3490) has exports, disconnecting them 00000020:00080000:3.0:1789130378.222508:0:42581:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90b4ba7f0800), last request at 1789130078 00000020:00000080:3.0:1789130378.222513:0:42581:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce87bf 00000020:00080000:3.0:1789130378.222526:0:42581:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4ba7f0800): rc 0 00000020:00000080:3.0:1789130378.222530:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b4ba7f0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789130378.226644:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4870be800 for MGC192.168.201.139@tcp 00000020:00000080:1.0:1789130378.226672:0:36:0:(genops.c:885:class_export_put()) final put ffff90b4870bb800/c7d5f341-5d27-45e7-8794-684d66c1a62a 00000020:00000080:1.0:1789130378.226677:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4870bb800/c7d5f341-5d27-45e7-8794-684d66c1a62a for MGC192.168.201.139@tcp 00000020:01000000:1.0:1789130378.226688:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.139@tcp (c7d5f341-5d27-45e7-8794-684d66c1a62a) 00000020:00000080:1.0:1789130378.228428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4ba7f0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789130378.228712:0:42581:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789130378.228718:0:42581:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130378.228724:0:42581:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789130378.228731:0:42581:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789130378.228855:0:36575:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1789130378.229003:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4ba7f4800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789130378.229076:0:36576:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789130378.229303:0:36571:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90b381247200:36571] 1 exiting: rc = 0 00000100:00100000:1.0:1789130378.229420:0:36570:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90b486006200:36570] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.229715:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.230297:0:36574:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90b4bab01400:36574] 2 exiting: rc = 0 00000100:00100000:1.0:1789130378.230388:0:38711:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90b484f0e800:38711] 3 exiting: rc = 0 00000100:00100000:1.0:1789130378.230459:0:36572:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90b488a48600:36572] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.230882:0:36573:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90b488a49400:36573] 1 exiting: rc = 0 00000100:00100000:0.0:1789130378.230957:0:42432:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90b489944c00:42432] 4 exiting: rc = 0 00000100:00100000:1.0:1789130378.231067:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231076:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231090:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231098:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231104:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231112:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231120:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231127:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231136:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231143:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231163:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231174:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231181:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231188:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231195:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231212:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231219:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231226:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231233:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231239:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231247:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231254:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231261:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231268:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231275:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231282:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231289:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231295:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231301:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231307:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231313:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231320:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231326:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231332:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231339:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231345:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231352:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231358:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231364:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231370:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231376:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231382:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231388:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231394:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231402:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231408:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231414:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231420:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231426:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231431:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231437:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231444:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231450:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231455:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231462:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231468:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231475:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231480:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231486:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231780:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231791:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231797:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231803:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.231809:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789130378.233095:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130378.233110:0:42581:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789130378.233119:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b4a7a4c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789130378.233125:0:42581:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a4c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789130378.233135:0:42581:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789130378.233218:0:42581:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4856bb000 1 00000020:00000080:0.0:1789130378.233226:0:42581:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce8779 00000020:00000080:0.0:1789130378.233234:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b488101800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789130378.233255:0:42581:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789130378.233262:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130378.233269:0:42581:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789130378.233274:0:42581:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90b487c74ed8) has no exports 00000020:00000080:1.0:1789130378.233487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488101800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789130378.249095:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130378.249116:0:42581:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789130378.249126:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b4856ba800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789130378.249132:0:42581:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4856ba800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789130378.249146:0:42581:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789130378.249680:0:42581:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b4856b8800 00000020:01000000:1.0:1789130378.249712:0:42581:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789130378.249717:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130378.249722:0:42581:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789130378.249727:0:42581:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90b487cb4ed8) has no exports 00000020:00000080:1.0:1789130378.249757:0:42581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130378.249765:0:42581:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789130378.249770:0:42581:0:(genops.c:885:class_export_put()) final put ffff90b488b5e800/OSS_uuid 00000020:00000080:1.0:1789130378.249773:0:42581:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488b5e800/OSS_uuid for OSS 00000020:01000000:1.0:1789130378.249783:0:42581:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789130378.249821:0:36583:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789130378.250012:0:37658:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90b383782400:37658] 3 exiting: rc = 0 00000100:00100000:1.0:1789130378.250067:0:37275:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90b489bc2a00:37275] 1 exiting: rc = 0 00000100:00100000:1.0:1789130378.250120:0:38727:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff90b3819e2400:38727] 4 exiting: rc = 0 00000100:00100000:1.0:1789130378.250256:0:37273:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90b489bc2800:37273] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.253321:0:37276:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90b4c1945800:37276] 2 exiting: rc = 0 00000100:00100000:1.0:1789130378.253702:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253713:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253721:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253729:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253736:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253743:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253760:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253768:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253775:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253781:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253787:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253793:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253799:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253805:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253811:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253816:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253823:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253829:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253835:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253842:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253848:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253857:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253863:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253868:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253874:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253881:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253889:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253895:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253902:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253908:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253914:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253920:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253926:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253931:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253937:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253943:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253948:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253954:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253962:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253968:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253973:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253979:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253984:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253990:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.253996:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254001:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254007:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254013:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254019:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254025:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254030:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254035:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254040:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254046:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254053:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254059:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254064:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254070:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254074:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254079:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254085:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254091:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254096:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.254102:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.256320:0:37278:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90b4c1945200:37278] 1 exiting: rc = 0 00000100:00100000:0.0:1789130378.256753:0:37277:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90b4a77da400:37277] 0 exiting: rc = 1 00000100:00100000:1.0:1789130378.257237:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257248:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257255:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257261:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257267:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257273:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257281:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257292:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257298:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257304:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257311:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257318:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257324:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257331:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257339:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257346:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257352:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257358:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257364:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257370:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257376:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257382:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257389:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257396:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257401:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257408:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257414:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257419:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257425:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257432:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257438:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257444:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257451:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257457:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257464:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257471:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257477:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257770:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257783:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257788:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257794:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257799:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257805:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257810:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257816:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257822:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257828:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257834:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257842:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257847:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257853:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257858:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257871:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257881:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257889:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257895:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257900:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257905:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257911:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257917:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257924:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257931:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257937:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.257943:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.260104:0:39572:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff90b4a78a6a00:39572] 5 exiting: rc = 0 00000100:00100000:1.0:1789130378.260485:0:37279:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90b381159200:37279] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.261179:0:39570:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff90b4865c6a00:39570] 3 exiting: rc = 0 00000100:00100000:0.0:1789130378.261820:0:37281:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90b4857a6c00:37281] 2 exiting: rc = 0 00000100:00100000:0.0:1789130378.266119:0:40395:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_008: service thread [ffff90b38292d400:40395] 8 exiting: rc = 0 00000100:00100000:0.0:1789130378.266542:0:40190:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_007: service thread [ffff90b382008000:40190] 7 exiting: rc = 0 00000100:00100000:0.0:1789130378.266885:0:40189:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_006: service thread [ffff90b381159000:40189] 6 exiting: rc = 0 00000100:00100000:0.0:1789130378.269016:0:37280:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90b4857a7600:37280] 1 exiting: rc = 0 00000100:00100000:0.0:1789130378.269474:0:39571:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff90b488b74e00:39571] 4 exiting: rc = 0 00000100:00100000:1.0:1789130378.270104:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270116:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270124:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270130:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270136:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270156:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270164:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270170:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270175:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270181:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270187:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270193:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270200:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270217:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270223:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270229:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270239:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270246:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270252:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270259:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270264:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270271:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270278:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270284:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270290:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270297:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270304:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270310:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270319:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270344:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270350:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270356:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270361:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270367:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270373:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270379:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270385:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270392:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270398:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270406:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270412:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270418:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270424:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270431:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270438:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270445:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270452:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270459:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270465:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270472:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270478:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270485:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270503:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270520:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270528:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270535:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270542:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270549:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270562:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270570:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270577:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270594:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270623:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130378.270641:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.278874:0:37283:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90b4a2a27200:37283] 1 exiting: rc = 0 00000100:00100000:1.0:1789130378.279193:0:37282:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90b4857a7e00:37282] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.279474:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279483:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279501:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279508:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279515:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279521:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279528:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279534:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279540:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279547:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279553:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279558:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279564:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279569:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279575:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279592:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279597:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279630:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279635:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279641:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279647:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279659:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279667:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279673:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279678:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279684:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279690:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279696:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279701:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279713:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279724:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279733:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279740:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279748:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279754:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279760:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279765:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279772:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279779:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279784:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279790:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279794:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279799:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279804:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279808:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279813:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279818:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279824:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279829:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279836:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279841:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279846:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279851:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279857:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279863:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279867:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279873:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279878:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279885:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279891:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279896:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279902:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279908:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.279914:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.280806:0:37285:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90b4a2a26c00:37285] 1 exiting: rc = 0 00000100:00100000:1.0:1789130378.280976:0:37284:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90b4c0950600:37284] 0 exiting: rc = 1 00000100:00100000:0.0:1789130378.281251:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281287:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281294:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281301:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281308:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281314:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281321:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281327:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281334:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281342:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281349:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281358:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281366:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281390:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281399:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281406:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281414:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281422:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281428:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281434:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281441:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281448:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281455:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281463:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281469:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281551:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281561:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281568:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281576:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281715:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281722:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281729:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281735:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281743:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281749:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281755:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281762:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281782:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281794:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281801:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281809:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281816:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281823:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281829:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281836:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281843:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281855:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281862:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281868:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281892:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281900:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281906:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281913:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281920:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281927:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281933:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281941:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281948:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281954:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281961:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281968:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281990:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.281998:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130378.282005:0:42581:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789130378.300082:0:42581:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789130397.631234:0:43200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789130407.495947:0:43661:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789130407.495954:0:43661:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789130407.496067:0:43661:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b4be78c000 00000020:01000004:0.0:1789130407.496083:0:43661:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789130407.496090:0:43661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789130407.496105:0:43661:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90b3830bced8) 00000020:00000080:0.0:1789130407.496117:0:43661:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789130407.526800:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789130407.531016:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3b:0x0] (8/32) 00100000:10000000:3.0:1789130407.532016:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 475: rc = 0 00100000:10000000:3.0:1789130407.532213:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789130407.532577:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 475: rc = 0 00100000:10000000:3.0:1789130407.532871:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 475: rc = 0 00100000:10000000:3.0:1789130407.532967:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 475: rc = 0 00100000:10000000:3.0:1789130407.533058:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 475: rc = 0 00100000:10000000:3.0:1789130407.533153:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 475: rc = 0 00100000:10000000:3.0:1789130407.533946:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 477: rc = 0 00100000:10000000:3.0:1789130407.535489:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 564: rc = 0 00100000:10000000:3.0:1789130407.535786:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 564: rc = 0 00100000:10000000:3.0:1789130407.536196:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 178: rc = 0 00100000:10000000:3.0:1789130407.537394:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.537915:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.538170:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 178: rc = 0 00100000:10000000:3.0:1789130407.538781:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 178: rc = 0 00100000:10000000:3.0:1789130407.539758:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.540044:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 178: rc = 0 00100000:10000000:3.0:1789130407.540786:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.541051:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 178: rc = 0 00100000:10000000:3.0:1789130407.541556:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 178: rc = 0 00100000:10000000:3.0:1789130407.541999:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.542597:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 178: rc = 0 00100000:10000000:3.0:1789130407.543076:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 752: rc = 0 00100000:10000000:3.0:1789130407.543525:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 752: rc = 0 00100000:10000000:3.0:1789130407.543978:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 752: rc = 0 00100000:10000000:3.0:1789130407.544224:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 752: rc = 0 00100000:10000000:3.0:1789130407.544887:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 752: rc = 0 00100000:10000000:3.0:1789130407.545154:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 752: rc = 0 00100000:10000000:3.0:1789130407.545771:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 752: rc = 0 00100000:10000000:3.0:1789130407.546037:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 752: rc = 0 00100000:10000000:3.0:1789130407.546736:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 752: rc = 0 00100000:10000000:3.0:1789130407.547037:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 752: rc = 0 00100000:10000000:3.0:1789130407.547536:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 752: rc = 0 00100000:10000000:3.0:1789130407.547948:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 752: rc = 0 00100000:10000000:3.0:1789130407.548191:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 752: rc = 0 00100000:10000000:3.0:1789130407.548829:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 752: rc = 0 00100000:10000000:3.0:1789130407.549099:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 752: rc = 0 00100000:10000000:3.0:1789130407.549778:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 752: rc = 0 00100000:10000000:3.0:1789130407.550100:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 752: rc = 0 00100000:10000000:3.0:1789130407.550765:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 752: rc = 0 00100000:10000000:3.0:1789130407.551009:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 752: rc = 0 00100000:10000000:3.0:1789130407.551249:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 752: rc = 0 00100000:10000000:3.0:1789130407.551752:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 752: rc = 0 00100000:10000000:3.0:1789130407.552031:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 752: rc = 0 00100000:10000000:3.0:1789130407.552290:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 752: rc = 0 00100000:10000000:3.0:1789130407.553202:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 752: rc = 0 00100000:10000000:3.0:1789130407.553743:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 752: rc = 0 00100000:10000000:3.0:1789130407.554457:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 752: rc = 0 00100000:10000000:3.0:1789130407.554754:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 752: rc = 0 00100000:10000000:3.0:1789130407.555031:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 752: rc = 0 00100000:10000000:3.0:1789130407.555876:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 752: rc = 0 00100000:10000000:3.0:1789130407.556144:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 752: rc = 0 00100000:10000000:3.0:1789130407.556592:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 752: rc = 0 00100000:10000000:3.0:1789130407.557138:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 752: rc = 0 00100000:10000000:3.0:1789130407.557899:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 192: rc = 0 00100000:10000000:3.0:1789130407.558842:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789130407.559067:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 565: rc = 0 00100000:10000000:3.0:1789130407.559404:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789130407.559544:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 565: rc = 0 00100000:10000000:3.0:1789130407.559817:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789130407.559886:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 565: rc = 0 00100000:10000000:2.0:1789130407.561222:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789130407.561531:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 176: rc = 0 00100000:10000000:2.0:1789130407.561810:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789130407.561882:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 176: rc = 0 00100000:10000000:2.0:1789130407.562068:0:43661:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789130407.562137:0:43661:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 176: rc = 0 00000020:00000080:2.0:1789130407.562790:0:43661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789130407.562798:0:43661:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789130407.562809:0:43661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb43c 00000020:01000004:2.0:1789130407.562816:0:43661:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789130407.562821:0:43661:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789130407.562826:0:43661:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b4be78c000 from MGS 00000020:01000004:2.0:1789130407.562830:0:43661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789130407.562840:0:43661:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90b487c74ed8) 00000020:00000080:2.0:1789130407.562849:0:43661:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789130407.562901:0:43661:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4be78c000 from MGS, refs=2 00080000:01000000:2.0:1789130407.562906:0:43661:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789130407.562910:0:43661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb44a 00000100:00100000:2.0:1789130407.563005:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789130407.563135:0:43661:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789130407.563141:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789130407.563807:0:43661:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789130407.563815:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789130407.564598:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130407.564945:0:43661:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789130407.564950:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789130407.565524:0:43661:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789130407.565532:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789130407.565988:0:43661:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789130407.565993:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789130407.566757:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130407.566760:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130407.566762:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130407.567099:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130407.567102:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130407.567103:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130407.567889:0:43661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789130407.584358:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789130407.585059:0:43661:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789130407.585077:0:43661:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789130407.585081:0:43661:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789130407.587423:0:43670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789130407.587846:0:43661:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789130407.587948:0:43661:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789130407.589410:0:43661:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789130407.589849:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130407.590010:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789130407.590017:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789130407.606451:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789130407.606473:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789130407.607857:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789130407.607869:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789130407.608827:0:43661:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789130407.608853:0:43661:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.139@tcp' 00000020:01000004:1.0:1789130407.608856:0:43661:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789130407.608891:0:43661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.139@tcp (typ=mgc) 00000020:00000080:1.0:1789130407.608905:0:43661:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.139@tcp (ffff90b487cb0000) 00000020:00000080:1.0:1789130407.608926:0:43661:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789130407.609012:0:43661:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b485c14800@MGC192.168.201.139@tcp: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789130407.609200:0:43661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.139@tcp-0 is initialized 00000040:01000000:1.0:1789130407.609207:0:43661:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789130407.613227:0:43675:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789130407.615830:0:43677:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789130407.615940:0:43661:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.139@tcp (uuid f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2) 00000020:00000080:1.0:1789130407.615966:0:43661:0:(genops.c:1385:class_connect()) connect: client f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2, cookie 0x5c74554e47ceb458 00000100:00080000:1.0:1789130407.615979:0:43661:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130407.615987:0:43661:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b485c14800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130407.616027:0:43661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b3868a21c0 x1876037626873216/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130407.616060:0:43661:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2->MGS 00000020:01000004:1.0:1789130407.616093:0:43661:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789130407.616099:0:43661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789130407.616116:0:43661:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90b487cb4ed8) 00000020:00000080:1.0:1789130407.616130:0:43661:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789130407.616404:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3305:1876037626873216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789130407.616486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130407.618811:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873216 00000100:00100000:2.0:1789130407.618827:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873216 00000100:00100000:2.0:1789130407.618880:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130407.618889:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876037626873216:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789130407.618919:0:43671:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2@0@lo t0 exp 0000000000000000 cur 1570 last 0 00000020:00000080:2.0:1789130407.618950:0:43671:0:(genops.c:1385:class_connect()) connect: client f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2, cookie 0x5c74554e47ceb466 00000100:00080000:2.0:1789130407.619099:0:43671:0:(import.c:65:import_set_state_nolock()) ffff90b3812fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130407.619189:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+5:3305:x1876037626873216:12345-0@lo:250:mount.lustre.0 Request processed in 299us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130407.619197:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130407.619249:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789130407.619258:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.139@tcp: connect to target with instance 0 00000100:00080000:2.0:1789130407.619265:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789130407.619270:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789130407.619273:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485c14800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789130407.619276:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789130407.619283:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789130407.619288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3305:1876037626873216:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789130407.643153:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130407.644391:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130407.644399:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789130407.651160:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789130407.651171:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789130407.652207:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789130407.652217:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789130407.653871:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130407.654089:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789130407.654094:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789130407.655360:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789130407.655370:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789130407.722133:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130407.722786:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789130407.722794:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789130407.725506:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789130407.725530:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789130407.726918:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130407.727127:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789130407.727134:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789130407.740147:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789130407.740167:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789130407.741166:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130407.741366:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789130407.741373:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789130407.742382:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789130407.742392:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789130407.745927:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130407.746134:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789130407.746140:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789130407.747171:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789130407.747180:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789130407.777805:0:43661:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130407.778051:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789130407.778058:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789130407.781821:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789130407.781837:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789130407.783171:0:43661:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789130407.783181:0:43661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789130407.790238:0:43661:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789130407.793349:0:43661:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789130407.793364:0:43661:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789130407.793554:0:43661:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789130407.793627:0:43661:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789130407.793632:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789130407.793634:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130407.793635:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130407.793646:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130407.793647:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130407.793649:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130407.793650:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130407.793651:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130407.793653:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130407.793655:0:43661:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130407.793657:0:43661:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789130407.793659:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130407.793661:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130407.793662:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130407.793663:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130407.793664:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130407.793665:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130407.793666:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130407.793667:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130407.793669:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130407.793670:0:43661:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130407.793715:0:43661:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789130407.793738:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130407.793817:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.793867:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.794456:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873344 00000100:00100000:1.0:1789130407.794466:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873344 00000100:00100000:1.0:1789130407.794509:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130407.794530:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+5:43661:x1876037626873344:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789130407.794581:0:43674:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789130407.794584:0:43674:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789130407.794587:0:43674:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789130407.796137:0:43695:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789130407.796963:0:43674:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 23 20000000:01000000:0.0:1789130407.798403:0:43696:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789130407.798413:0:43696:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789130407.798416:0:43696:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789130407.798451:0:43696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789130407.798800:0:43674:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789130407.798809:0:43674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789130407.804211:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+5:43661:x1876037626873344:12345-0@lo:253:mount.lustre.0 Request processed in 9683us (10382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130407.804241:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130407.804351:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130407.804367:0:43661:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789130407.804371:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130407.804372:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130407.804374:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130407.804375:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130407.804376:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130407.804378:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130407.804379:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130407.804380:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130407.804382:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130407.804384:0:43661:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789130407.804404:0:43661:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b4be78c000 from lustre-MDT0000 10000000:01000000:3.0:1789130407.804727:0:43661:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789130407.804730:0:43661:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789130407.804735:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90b487cb0000 10000000:01000000:3.0:1789130407.804745:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130407.804754:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b487cb0000 from 1 10000000:01000000:3.0:1789130407.804758:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789130407.804799:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.804959:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.804971:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130407.804993:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130407.805034:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.805073:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130407.805128:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873472 00000100:00100000:0.0:1789130407.805134:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873472 00000100:00100000:0.0:1789130407.805182:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130407.805192:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+5:43661:x1876037626873472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130407.805205:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130407.805220:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b3873f3000/0x5c74554e47ceb474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb46d expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.805254:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f3000/0x5c74554e47ceb474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb46d expref: 6 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.805266:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b3873f3000/0x5c74554e47ceb474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb46d expref: 6 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.805275:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3000, rc 0) 00000100:00100000:0.0:1789130407.805314:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+6:43661:x1876037626873472:12345-0@lo:101:mount.lustre.0 Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130407.805320:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130407.805503:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130407.805517:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.805527:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130407.805571:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130407.805598:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.805836:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130407.805870:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873600 00000100:00100000:0.0:1789130407.805873:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873600 00000100:00100000:0.0:1789130407.805899:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130407.805905:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+6:43661:x1876037626873600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130407.806138:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+6:43661:x1876037626873600:12345-0@lo:501:mount.lustre.0 Request processed in 233us (539us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130407.806144:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130407.806182:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130407.806200:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789130407.806240:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.806246:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130407.806258:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b4be78c000 10000000:01000000:3.0:1789130407.806263:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130407.806268:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90b4be78c000 10000000:01000000:3.0:1789130407.806270:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789130407.806274:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90b4be78c000 from 1 10000000:01000000:3.0:1789130407.806276:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789130407.806296:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.806303:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.806311:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130407.806324:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130407.806351:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.806378:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.806542:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873728 00000100:00100000:1.0:1789130407.806547:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873728 00000100:00100000:1.0:1789130407.806584:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130407.806590:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+6:43661:x1876037626873728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130407.806596:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130407.806763:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c3ce00/0x5c74554e47ceb482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb47b expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.806783:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c3ce00/0x5c74554e47ceb482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb47b expref: 7 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.806793:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c3ce00/0x5c74554e47ceb482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb47b expref: 7 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.806803:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ce00, rc 0) 00000100:00100000:1.0:1789130407.806897:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+7:43661:x1876037626873728:12345-0@lo:101:mount.lustre.0 Request processed in 306us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.806904:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130407.807092:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130407.807106:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb482 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.807113:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb482 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130407.807123:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789130407.807155:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb482 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.807160:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35400/0x5c74554e47ceb47b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb482 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130407.807164:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789130407.807167:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130407.807170:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90b4be78c000 10000000:01000000:3.0:1789130407.807171:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789130407.807174:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789130407.807175:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130407.807187:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.807192:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.807196:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130407.807205:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130407.807225:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.807256:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.807285:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873856 00000100:00100000:1.0:1789130407.807290:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873856 00000100:00100000:1.0:1789130407.807329:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130407.807337:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+7:43661:x1876037626873856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130407.807530:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130407.807539:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c3c800/0x5c74554e47ceb490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb489 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.807551:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c3c800/0x5c74554e47ceb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb489 expref: 8 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.807556:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c3c800/0x5c74554e47ceb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb489 expref: 8 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.807561:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3c800, rc 0) 00000100:00100000:1.0:1789130407.807587:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+8:43661:x1876037626873856:12345-0@lo:101:mount.lustre.0 Request processed in 251us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.807593:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130407.807899:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130407.807911:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb490 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.807920:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb490 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130407.807965:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130407.807984:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.808031:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c2029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130407.808058:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626873984 00000100:00100000:2.0:1789130407.808061:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626873984 00000100:00100000:2.0:1789130407.808095:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130407.808103:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+8:43661:x1876037626873984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130407.809130:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43661:x1876037626873984:12345-0@lo:501:mount.lustre.0 Request processed in 1022us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.809148:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130407.809294:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626873984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130407.809360:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626874112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130407.809405:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130407.809579:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c31900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.809767:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626874112 00000100:00100000:1.0:1789130407.809775:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626874112 00000100:00100000:1.0:1789130407.809860:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130407.809871:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43661:x1876037626874112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130407.810191:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43661:x1876037626874112:12345-0@lo:503:mount.lustre.0 Request processed in 321us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.810199:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130407.810287:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626874112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130407.810747:0:43697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43697:1876037626874240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130407.810789:0:43697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.810973:0:43697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130407.811019:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626874240 00000100:00100000:2.0:1789130407.811022:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626874240 00000100:00100000:2.0:1789130407.811042:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130407.811047:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43697:x1876037626874240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130407.811220:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43697:x1876037626874240:12345-0@lo:502:llog_process_th.0 Request processed in 172us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130407.811225:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130407.811310:0:43697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43697:1876037626874240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130407.811335:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130407.811347:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.811349:0:43697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130407.811360:0:43697:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789130407.811363:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130407.811377:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90b383108000) 00000020:00000080:3.0:1789130407.811395:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789130407.811400:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789130407.811470:0:43697:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789130407.811474:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb49e 00000020:00000080:3.0:1789130407.811702:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789130407.811707:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130407.811711:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.811712:0:43697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130407.811714:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130407.811719:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.811720:0:43697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789130407.811723:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130407.811730:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90b383109a48) 00000020:00000080:3.0:1789130407.811739:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789130407.811743:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789130407.811745:0:43697:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789130407.811747:0:43697:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789130407.811753:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130407.811782:0:43697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4be78c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789130407.811791:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90b38310b490) 00000020:00000080:3.0:1789130407.811796:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789130407.811826:0:43697:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789130407.811833:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ceb4b3 00000020:00000080:3.0:1789130407.811894:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789130407.811898:0:43697:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789130407.811900:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5c74554e47ceb4ba 00080000:01000000:3.0:1789130407.811904:0:43697:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789130407.811906:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb4c1 00010000:00010000:1.0:1789130407.926254:0:43697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789130407.927143:0:43697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 30064771675 00000001:00080000:1.0:1789130407.927396:0:43697:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789130407.928124:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90b487cb3490) 00000020:00000080:1.0:1789130407.928144:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789130407.928211:0:43697:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789130407.928221:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb4cf 00000020:00000080:1.0:1789130407.933471:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789130407.940216:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5c74554e47ceb4d6 00000020:00000080:0.0:1789130407.951929:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789130407.951948:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130407.952055:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.952058:0:43697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789130407.952064:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130407.952066:0:43697:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789130407.952068:0:43697:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130407.952070:0:43697:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130407.952071:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130407.952074:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.952076:0:43697:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130407.952078:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130407.952084:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.952085:0:43697:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789130407.952091:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789130407.952144:0:43697:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789130407.952164:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130407.952167:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.952168:0:43697:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789130407.952171:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130407.952174:0:43697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789130407.952178:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.952179:0:43697:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789130407.952181:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789130407.952186:0:43697:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:0.0:1789130407.952217:0:43697:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789130407.952220:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130407.952237:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90b3830b8000) 00000020:00000080:0.0:1789130407.952253:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789130407.952258:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789130407.952946:0:43697:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789130407.952954:0:43697:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789130407.952965:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb4e4 00010000:00080000:0.0:1789130407.953003:0:43697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4be6eb000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1789130407.953252:0:43697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789130407.953939:0:43697:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789130407.953985:0:43697:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789130407.960970:0:43697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130407.961076:0:43697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].8, 64 off8704 00000040:00080000:0.0:1789130407.961170:0:43697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].1, 64 off8256 00000040:00080000:2.0:1789130407.968558:0:43701:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130407.968569:0:43701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2e:0x0] at index 8 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789130407.969402:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130407.969416:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789130407.969465:0:43697:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789130407.969485:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ceb4eb 00000100:00080000:1.0:1789130407.969496:0:43697:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130407.969502:0:43697:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b4be6eb000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130407.969545:0:43697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b3868a12c0 x1876037626874368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130407.969580:0:43697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789130407.969687:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130407.969692:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130407.969694:0:43697:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789130407.969697:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789130407.969700:0:43697:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789130407.969701:0:43697:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130407.969703:0:43697:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130407.969704:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789130407.969707:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130407.969709:0:43697:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789130407.969712:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789130407.969716:0:43697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789130407.969720:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130407.969722:0:43697:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789130407.969725:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789130407.969728:0:43697:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:1.0:1789130407.969754:0:43697:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789130407.969757:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130407.969769:0:43697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90b487cb1a48) 00000020:00000080:1.0:1789130407.969782:0:43697:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789130407.969787:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789130407.969849:0:43697:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789130407.969855:0:43697:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789130407.969860:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ceb4f9 00010000:00080000:1.0:1789130407.969896:0:43697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b497ef8800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789130407.970109:0:43697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789130407.970308:0:43697:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789130407.970329:0:43697:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789130407.970857:0:43697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130407.970926:0:43697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].8, 64 off8704 00000040:00080000:1.0:1789130407.970995:0:43697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].1, 64 off8256 00000100:00100000:3.0:1789130407.971354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130407.971369:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626874496:0@lo:400:kworker.0 00000100:00100000:3.0:1789130407.971443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.971505:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626874496 00000100:00100000:3.0:1789130407.971512:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626874496 00000100:00100000:3.0:1789130407.971554:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130407.971563:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:3306:x1876037626874496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130407.971654:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:3306:x1876037626874496:12345-0@lo:400:kworker.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.971662:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130407.971721:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626874496:0@lo:400:kworker.0 00000040:00080000:3.0:1789130407.971940:0:43703:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130407.971946:0:43703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x30:0x0] at index 8 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1789130407.972336:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626874368:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789130407.972380:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626874368 offset 0 length 520: 4 00000020:00000080:3.0:1789130407.973187:0:43697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130407.973199:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789130407.973233:0:43697:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789130407.973253:0:43697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ceb500 00000100:00080000:3.0:1789130407.973262:0:43697:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130407.973267:0:43697:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130407.973296:0:43697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e15a40 x1876037626874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130407.973332:0:43697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789130407.973379:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130407.973382:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.973384:0:43697:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789130407.973387:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130407.973391:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.973393:0:43697:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789130407.973395:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789130407.973397:0:43697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789130407.973399:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130407.973401:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.973403:0:43697:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789130407.973405:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130407.973407:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.973409:0:43697:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789130407.973412:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789130407.973440:0:43697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43697:1876037626874752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130407.973504:0:43697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130407.973527:0:43697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130407.973795:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626874624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789130407.973821:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626874624 offset 0 length 520: 4 00000100:00100000:0.0:1789130407.973850:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626874752 00000100:00100000:0.0:1789130407.973856:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626874752 00000100:00100000:0.0:1789130407.973888:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130407.973897:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43697:x1876037626874752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130407.974131:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43697:x1876037626874752:12345-0@lo:502:llog_process_th.0 Request processed in 233us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130407.974139:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130407.974374:0:43697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43697:1876037626874752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130407.974404:0:43697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130407.974410:0:43697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130407.974412:0:43697:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789130407.974417:0:43697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789130407.975180:0:43661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789130407.975202:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789130407.975221:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb490 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.975235:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35200/0x5c74554e47ceb489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb490 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130407.975243:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4be78c000 from 1 10000000:01000000:0.0:1789130407.975246:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130407.975286:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.975293:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.975313:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.975335:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626874880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130407.975378:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.975405:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130407.975528:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626874880 00000100:00100000:3.0:1789130407.975535:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626874880 00000100:00100000:3.0:1789130407.975574:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130407.975582:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+9:43661:x1876037626874880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130407.975595:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130407.978070:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb507 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.978111:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 10 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.978124:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 10 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.978134:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34600, rc 0) 00000100:00100000:3.0:1789130407.978220:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+10:43661:x1876037626874880:12345-0@lo:101:mount.lustre.0 Request processed in 2637us (2840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.978229:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130407.979187:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626874880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130407.979215:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.979227:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.979843:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875008:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789130407.979903:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.979940:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130407.980455:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875008 00000100:00100000:3.0:1789130407.980465:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875008 00000100:00100000:3.0:1789130407.980511:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130407.980520:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+10:43661:x1876037626875008:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789130407.980541:0:43673:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789130407.980547:0:43673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789130407.980680:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+10:43661:x1876037626875008:12345-0@lo:256:mount.lustre.0 Request processed in 151us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.980691:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130407.980994:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875008:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789130407.982111:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130407.982142:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.982154:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130407.982164:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4be78c000 from 1 10000000:01000000:0.0:1789130407.982167:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130407.982203:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.982215:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.982225:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.982245:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130407.982293:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.982398:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.982566:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875136 00000100:00100000:1.0:1789130407.982573:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875136 00000100:00100000:3.0:1789130407.982898:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130407.982909:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+10:43661:x1876037626875136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130407.982922:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130407.982936:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb515 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.982958:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.982968:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130407.982976:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00100000:3.0:1789130407.983014:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875136:12345-0@lo:101:mount.lustre.0 Request processed in 108us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.983020:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130407.983124:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130407.983138:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.983148:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.983196:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130407.983219:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.983246:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.983293:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875264 00000100:00100000:1.0:1789130407.983296:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875264 00000100:00100000:1.0:1789130407.983331:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130407.983337:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130407.983774:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875264:12345-0@lo:501:mount.lustre.0 Request processed in 436us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.983783:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130407.986033:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130407.986097:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130407.986176:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.986224:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.986292:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875392 00000100:00100000:1.0:1789130407.986310:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875392 00000100:00100000:1.0:1789130407.986365:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130407.986373:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130407.986584:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875392:12345-0@lo:503:mount.lustre.0 Request processed in 211us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.986592:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130407.987090:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130407.987491:0:43705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43705:1876037626875520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130407.987534:0:43705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.987568:0:43705:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130407.987870:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875520 00000100:00100000:3.0:1789130407.987876:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875520 00000100:00100000:3.0:1789130407.987917:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130407.987926:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43705:x1876037626875520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130407.988173:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43705:x1876037626875520:12345-0@lo:502:llog_process_th.0 Request processed in 247us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.988181:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130407.988333:0:43705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43705:1876037626875520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130407.988364:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130407.988375:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988377:0:43705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789130407.988388:0:43705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4be78c000 00000020:00000080:0.0:1789130407.988391:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130407.988399:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130407.988402:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988403:0:43705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789130407.988406:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130407.988408:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988410:0:43705:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789130407.988413:0:43705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4be78c000 00000020:00000080:0.0:1789130407.988415:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130407.988484:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130407.988487:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988489:0:43705:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789130407.988491:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130407.988493:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988494:0:43705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130407.988497:0:43705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4be78c000 00000020:00000080:0.0:1789130407.988499:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130407.988518:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130407.988521:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988523:0:43705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130407.988525:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130407.988528:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130407.988529:0:43705:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130407.988533:0:43705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4be78c000 00000020:00000080:0.0:1789130407.988536:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789130407.988572:0:43705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43705:1876037626875648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130407.990420:0:43705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.990484:0:43705:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130407.990592:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875648 00000100:00100000:3.0:1789130407.990859:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875648 00000100:00100000:3.0:1789130407.990912:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130407.990922:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43705:x1876037626875648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130407.991183:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43705:x1876037626875648:12345-0@lo:502:llog_process_th.0 Request processed in 261us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130407.991191:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789130407.991845:0:43705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43705:1876037626875648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130407.991886:0:43705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130407.991895:0:43705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130407.991897:0:43705:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789130407.991903:0:43705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789130407.992077:0:43661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789130407.992098:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130407.992117:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.992131:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130407.992180:0:43661:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789130407.992183:0:43661:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b4be78c000 10000000:01000000:0.0:1789130407.992185:0:43661:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b4be78c000 10000000:01000000:0.0:1789130407.992189:0:43661:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130407.992195:0:43661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4be78c000 from 1 10000000:01000000:0.0:1789130407.992198:0:43661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789130407.992233:0:43661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.992242:0:43661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.992251:0:43661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.992272:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130407.992332:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.992366:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.992544:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875776 00000100:00100000:1.0:1789130407.992550:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875776 00000100:00100000:1.0:1789130407.992594:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130407.992809:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626875776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130407.992824:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130407.992841:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c3cc00/0x5c74554e47ceb52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb523 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.992866:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c3cc00/0x5c74554e47ceb52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb523 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.992877:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c3cc00/0x5c74554e47ceb52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb523 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130407.992888:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3cc00, rc 0) 00000100:00100000:1.0:1789130407.992932:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626875776:12345-0@lo:101:mount.lustre.0 Request processed in 330us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.992940:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130407.993039:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130407.993054:0:43661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb52a expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130407.993063:0:43661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb52a expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130407.993110:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130407.993136:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.993167:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.993390:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626875904 00000100:00100000:1.0:1789130407.993395:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626875904 00000100:00100000:1.0:1789130407.993419:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130407.993426:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626875904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130407.994942:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626875904:12345-0@lo:501:mount.lustre.0 Request processed in 1508us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.994953:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130407.995067:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626875904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130407.995121:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626876032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130407.995166:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130407.995201:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130407.995810:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876032 00000100:00100000:1.0:1789130407.995817:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876032 00000100:00100000:1.0:1789130407.995868:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130407.995877:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626876032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130407.996063:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626876032:12345-0@lo:503:mount.lustre.0 Request processed in 186us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130407.996070:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130407.999272:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626876032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130408.001944:0:43707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43707:1876037626876160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130408.002052:0:43707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130408.002103:0:43707:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b3834f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130408.002163:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876160 00000100:00100000:1.0:1789130408.002173:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876160 00000100:00100000:1.0:1789130408.002221:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130408.002231:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43707:x1876037626876160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130408.002517:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43707:x1876037626876160:12345-0@lo:502:llog_process_th.0 Request processed in 287us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130408.002525:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130408.002584:0:43707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43707:1876037626876160:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789130408.006234:0:43707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789130408.006255:0:43707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90b4b5761a48) 00000020:00000080:1.0:1789130408.006281:0:43707:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789130408.006405:0:43707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4be78c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789130408.006410:0:43707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4be78c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789130408.006413:0:43707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4be78c000 4 00010000:00080000:1.0:1789130408.006445:0:43707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4921db000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789130408.014628:0:43707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789130408.014833:0:43707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789130408.014870:0:43707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789130408.014882:0:43707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5c74554e47ceb538 00000100:00080000:1.0:1789130408.014893:0:43707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130408.014897:0:43707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90b4921db000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130408.014928:0:43707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b3868a2580 x1876037626876288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130408.014973:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626876288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130408.015053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130408.015120:0:43707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789130408.015338:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876288 00000100:00100000:3.0:1789130408.015344:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876288 00000100:00100000:3.0:1789130408.015372:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130408.015378:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626876288:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789130408.015430:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626876288:12345-0@lo:38:llog_process_th.0 Request processed in 51us (376us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789130408.015437:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130408.015472:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130408.015479:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4921db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130408.015483:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789130408.015487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626876288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130408.021562:0:43707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43707:1876037626876416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130408.022390:0:43707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130408.022442:0:43707:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482a96300 going to sleep for 11 seconds 00000100:00100000:1.0:1789130408.022469:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876416 00000100:00100000:1.0:1789130408.022475:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876416 00000100:00100000:1.0:1789130408.022519:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130408.022525:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43707:x1876037626876416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130408.024017:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43707:x1876037626876416:12345-0@lo:502:llog_process_th.0 Request processed in 1486us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130408.024030:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130408.024660:0:43707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43707:1876037626876416:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789130408.024705:0:43707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789130408.025679:0:43661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789130408.025704:0:43661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789130408.025722:0:43661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb52a expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.025740:0:43661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b3873f2600/0x5c74554e47ceb523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb52a expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789130408.025786:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789130408.025788:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789130408.025790:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130408.025791:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130408.025793:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130408.025794:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130408.025795:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130408.025797:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789130408.025798:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130408.025800:0:43661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789130408.025804:0:43661:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789130408.025806:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789130408.025807:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789130408.025809:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130408.025810:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130408.025811:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130408.025812:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130408.025813:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130408.025814:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789130408.025815:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130408.025816:0:43661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789130408.025836:0:43661:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789130408.025854:0:43661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626876544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789130408.025917:0:43661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130408.025953:0:43661:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130408.025973:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876544 00000100:00100000:0.0:1789130408.025979:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876544 00000100:00100000:0.0:1789130408.026022:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130408.026032:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43661:x1876037626876544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789130408.026060:0:43671:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789130408.026072:0:43671:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789130408.143739:0:43671:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130408.143765:0:43671:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789130408.145726:0:43695:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789130408.145735:0:43695:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789130408.145763:0:43695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.145783:0:43695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.145792:0:43695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.145843:0:43695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.145857:0:43695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 12 pid: 43674 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130408.145870:0:43695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626876672:0@lo:104: 00000100:00100000:0.0:1789130408.145940:0:43695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130408.147566:0:43695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b481370900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130408.159309:0:43662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876672 00000100:00100000:0.0:1789130408.159323:0:43662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876672 00000100:00100000:0.0:1789130408.159381:0:43662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130408.159392:0:43662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626876672:12345-0@lo:104: 00010000:00010000:0.0:1789130408.159411:0:43662:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130408.159503:0:43662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130408.159510:0:43662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626876672:12345-0@lo:104: Request processed in 120us (13570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130408.159520:0:43662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130408.159564:0:43695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626876672:0@lo:104: 00010000:00010000:0.0:1789130408.159588:0:43695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.166845:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130408.166861:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.166875:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789130408.166880:0:43668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.166892:0:43668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130408.166900:0:43668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130408.166906:0:43668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130408.166961:0:43668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.166968:0:43668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130408.166994:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167001:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b3873f2e00/0x5c74554e47ceb507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb50e expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167022:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130408.167024:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130408.167026:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130408.167071:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626876800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130408.167149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130408.167237:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876800 00000100:00100000:1.0:1789130408.167244:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876800 00010000:00010000:1.0:1789130408.167272:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 13 pid: 43674 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130408.167301:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130408.167311:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+13:3308:x1876037626876800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130408.167323:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130408.167328:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 13 pid: 43674 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167340:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 13 pid: 43674 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167355:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b390c34600/0x5c74554e47ceb50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb507 expref: 13 pid: 43674 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167369:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167378:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789130408.167392:0:43664:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021658365s 00010000:00010000:1.0:1789130408.167398:0:43664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167405:0:43664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167412:0:43664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167422:0:43664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167428:0:43664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130408.167432:0:43664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167439:0:43664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167454:0:43664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167464:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130408.167500:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3308:x1876037626876800:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130408.167507:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130408.167546:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626876800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130408.167570:0:43695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167578:0:43695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130408.167584:0:43695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb53f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130408.182872:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43661:x1876037626876544:12345-0@lo:253:mount.lustre.0 Request processed in 156832us (156945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130408.182886:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130408.183002:0:43661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43661:1876037626876544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789130408.183018:0:43661:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789130408.183021:0:43661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789130408.183023:0:43661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789130408.183024:0:43661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130408.183026:0:43661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130408.183027:0:43661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130408.183029:0:43661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130408.183030:0:43661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789130408.183031:0:43661:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789130408.183033:0:43661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130408.183034:0:43661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789130408.183047:0:43661:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789130408.184420:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789130408.184578:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789130408.184873:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789130408.184998:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789130408.185207:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789130408.185357:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789130408.188935:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789130408.189106:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789130408.189370:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789130408.189547:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789130408.189849:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789130408.190005:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789130408.260077:0:43661:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 25769803916 00000040:01000000:0.0:1789130408.260655:0:43661:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789130408.264563:0:43718:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 25769803916 00000020:00080000:1.0:1789130408.264572:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803916 00000040:01000000:1.0:1789130408.265043:0:43719:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789130408.265151:0:43719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130408.267330:0:43719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789130408.267411:0:43719:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789130408.267416:0:43719:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789130408.269701:0:43661:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789130408.269811:0:43661:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789130408.270280:0:43661:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789130408.270288:0:43661:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789130408.270404:0:43661:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130408.279246:0:43661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789130408.279994:0:43661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789130408.280036:0:43661:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789130408.280536:0:43661:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 6, last_idx 7 00080000:10000000:0.0:1789130408.292153:0:43661:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3c:0x0] (8/8/4) registered 00000001:00000004:2.0:1789130408.296418:0:43661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738368 00000001:00080000:0.0:1789130408.363152:0:43661:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789130408.363190:0:43661:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1120157f988 00100000:10000000:0.0:1789130408.363198:0:43661:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789130408.364066:0:43661:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789130408.364086:0:43661:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789130408.364099:0:43661:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789130408.364130:0:43661:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789130408.581782:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130409.095225:0:43713:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130409.095236:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130409.095688:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 16 count 5 00000040:00080000:1.0:1789130409.095697:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 10000000:01000000:1.0:1789130409.544083:0:43677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789130409.544092:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4be78c000 from 24 10000000:01000000:1.0:1789130409.544098:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789130409.544160:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130409.544176:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130409.544186:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130409.544213:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626876928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130409.544305:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130409.544367:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c31840 going to sleep for 11 seconds 00000100:00100000:2.0:1789130409.544503:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626876928 00000100:00100000:2.0:1789130409.544512:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626876928 00000100:00100000:2.0:1789130409.544569:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130409.544578:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43677:x1876037626876928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130409.544594:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130409.544636:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb546 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130409.544668:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130409.544678:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130409.544686:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1400, rc 0) 00000100:00100000:2.0:1789130409.544737:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626876928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130409.544744:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130409.545089:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626876928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130409.545107:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130409.545121:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130409.545185:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626877056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789130409.545222:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130409.545243:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130409.546158:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877056 00000100:00100000:1.0:1789130409.546170:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877056 00000100:00100000:1.0:1789130409.546222:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130409.546231:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626877056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789130409.546253:0:43673:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789130409.546344:0:43673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789130409.546348:0:43673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 24 00000100:00100000:1.0:1789130409.546463:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626877056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 233us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130409.546472:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130409.546569:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626877056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789130409.546667:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789130409.546677:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130409.546686:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130409.605970:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130410.117919:0:43713:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789130410.117929:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130410.119000:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 15 count 1 00000040:00080000:1.0:1789130410.119155:0:43713:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130410.119185:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 1 00010000:00010000:0.0:1789130410.632230:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130411.657725:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130412.678315:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130413.317861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130413.317870:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130413.317873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130413.317877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130413.317879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789130413.317882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789130413.317887:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b4921db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130413.317899:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90b4921db000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130413.317926:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e15680 x1876037626877312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130413.317968:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626877312:0@lo:38:kworker.0 00000100:00100000:3.0:1789130413.318093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130413.318195:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626877184:0@lo:400:kworker.0 00000100:00100000:2.0:1789130413.318233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130413.318297:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877312 00000100:00100000:2.0:1789130413.318303:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877312 00000100:00100000:2.0:1789130413.318337:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130413.318344:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626877312:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789130413.318372:0:43681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 1576 last 0 00000020:00000080:2.0:1789130413.318422:0:43681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5c74554e47ceb554 00000004:00100000:2.0:1789130413.318440:0:43681:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130413.318629:0:43681:0:(import.c:65:import_set_state_nolock()) ffff90b4bfbec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130413.318685:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876037626877312:12345-0@lo:38:kworker.0 Request processed in 339us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130413.318693:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789130413.318773:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b388e15680 x1876037626877312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789130413.318789:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 8 00000100:00080000:2.0:1789130413.318798:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789130413.318802:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789130413.318805:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4921db000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789130413.318812:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626877312:0@lo:38:kworker.0 00000100:00100000:3.0:1789130413.324546:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877184 00000100:00100000:3.0:1789130413.324561:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877184 00000100:00100000:3.0:1789130413.324647:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130413.324657:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3309:x1876037626877184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130413.324753:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3309:x1876037626877184:12345-0@lo:400:kworker.0 Request processed in 97us (6519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130413.324761:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130413.325134:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626877184:0@lo:400:kworker.0 00000001:02000400:0.0:1789130413.342015:0:43962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789130413.710287:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130414.734709:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130415.752214:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130416.775506:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789130416.925777:0:44114:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd69512c0 20000000:00000080:0.0:1789130416.925794:0:44114:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4b52cb000 uarg=0000000000000000 20000000:01000000:0.0:1789130416.925877:0:44114:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789130416.925884:0:44114:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789130416.925887:0:44114:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789130416.926899:0:44115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789130416.926973:0:44114:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789130416.939268:0:44114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789130416.939492:0:44114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.939523:0:44114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.939531:0:44114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.939575:0:44114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.939590:0:44114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 1680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130416.939658:0:44114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44114:1876037626877440:0@lo:104: 00000100:00100000:3.0:1789130416.939730:0:44114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130416.939780:0:44114:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130416.940241:0:43663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877440 00000100:00100000:2.0:1789130416.940249:0:43663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877440 00000100:00100000:2.0:1789130416.940300:0:43663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130416.940309:0:43663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:44114:x1876037626877440:12345-0@lo:104: 00010000:00010000:2.0:1789130416.940324:0:43663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940390:0:43663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130416.940396:0:43663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:44114:x1876037626877440:12345-0@lo:104: Request processed in 90us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130416.940403:0:43663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789130416.940423:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130416.940428:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940435:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130416.940438:0:43668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940447:0:43668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130416.940453:0:43668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130416.940458:0:43668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130416.940693:0:43668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940700:0:43668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130416.940721:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940727:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b3873f2000/0x5c74554e47ceb515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb51c expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940745:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130416.940747:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130416.940748:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130416.940759:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626877568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130416.940789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130416.940835:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877568 00000100:00100000:2.0:1789130416.940839:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877568 00010000:00010000:2.0:1789130416.940857:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 12 pid: 43673 timeout: 1680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130416.940879:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130416.940885:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3306:x1876037626877568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130416.940897:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130416.940902:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 12 pid: 43673 timeout: 1680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940911:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 12 pid: 43673 timeout: 1680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940928:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940936:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940947:0:43664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940954:0:43664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940960:0:43664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940966:0:43664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940972:0:43664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130416.940976:0:43664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940982:0:43664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.940995:0:43664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130416.941003:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130416.941031:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3306:x1876037626877568:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130416.941037:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130416.941071:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626877568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130416.941233:0:44114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb51c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb515 expref: 11 pid: 43673 timeout: 1680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130416.941244:0:44114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44114:1876037626877440:0@lo:104: 00010000:00010000:3.0:1789130416.941256:0:44114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.941265:0:44114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.941271:0:44114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130416.941278:0:44114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb55b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130417.424304:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130407/real 1789130407] req@ffff90b388e15a40 x1876037626874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130417.424344:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b388e15a40 x1876037626874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130417.424357:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130407/real 1789130407] req@ffff90b3868a12c0 x1876037626874368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130417.424369:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b3868a12c0 x1876037626874368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130417.424392:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130417.424415:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130417.424420:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626874624:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789130417.424426:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4be6eb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130417.424431:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130417.424434:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626874368:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789130417.424640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130417.424646:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789130417.424649:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b4be6eb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130417.424655:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 1571 00000100:00080000:3.0:1789130417.424661:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789130417.424670:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b4be6eb000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130417.424717:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e16580 x1876037626877696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130417.424732:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130417.424734:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130417.424736:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130417.424740:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 1571 00000100:00080000:3.0:1789130417.424742:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789130417.424746:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130417.424758:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e15e00 x1876037626877824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130417.424884:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626877696:0@lo:8:kworker.0 00000400:00000100:0.0:1789130417.424948:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626877696 offset 0 length 520: 4 00000100:00100000:0.0:1789130417.425008:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626877824:0@lo:8:kworker.0 00000400:00000100:0.0:1789130417.425025:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626877824 offset 0 length 520: 4 00000100:00100000:0.0:1789130417.425695:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626877952:0@lo:400:kworker.0 00000100:00100000:0.0:1789130417.425765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130417.430369:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626877952 00000100:00100000:3.0:1789130417.430390:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626877952 00000100:00100000:3.0:1789130417.430687:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130417.430701:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626877952:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789130417.431688:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b388e16d00 x1876037626877952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130417.431710:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626877952:0@lo:400:kworker.0 00000100:00100000:3.0:1789130417.432326:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626877952:12345-0@lo:400:kworker.0 Request processed in 1622us (6554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130417.432340:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789130417.814176:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789130418.054675:0:43677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130418.054685:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4be78c000 from 13 10000000:01000000:0.0:1789130418.054691:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130418.054754:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130418.054768:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130418.054781:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130418.054818:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130418.054915:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130418.054972:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130418.055594:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878080 00000100:00100000:2.0:1789130418.055640:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878080 00000100:00100000:2.0:1789130418.055715:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130418.055726:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+11:43677:x1876037626878080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130418.055745:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130418.055766:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb562 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130418.055800:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130418.055812:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130418.055824:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130418.055891:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626878080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130418.055899:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789130418.056111:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130418.056146:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130418.056158:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130418.056249:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130418.056284:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130418.056329:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484fc6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130418.056384:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878208 00000100:00100000:2.0:1789130418.056390:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878208 00000100:00100000:2.0:1789130418.056425:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130418.056433:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626878208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130418.056859:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626878208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 425us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130418.056867:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130418.056908:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130418.056960:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130418.057008:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130418.057030:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130418.057042:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878336 00000100:00100000:2.0:1789130418.057046:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878336 00000100:00100000:2.0:1789130418.057068:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130418.057076:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626878336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130418.057257:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:43677:x1876037626878336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130418.057264:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130418.057302:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626878336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789130418.057948:0:44159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789130418.058019:0:43677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789130418.058042:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130418.058054:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130418.058065:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130418.825208:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130419.850366:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130420.362559:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789130420.870573:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130421.897349:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130422.533773:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130422.533780:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130422.533783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130422.533785:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789130422.534462:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626878464:0@lo:400:kworker.0 00000100:00100000:2.0:1789130422.534540:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.534598:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130422.534631:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626878592:0@lo:400:kworker.0 00000100:00100000:2.0:1789130422.534661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.534698:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878592 00000100:00100000:2.0:1789130422.534706:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878592 00000100:00100000:2.0:1789130422.534754:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130422.534763:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626878592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130422.534815:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626878592:12345-0@lo:400:kworker.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.534823:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789130422.534875:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b388e16940 x1876037626878592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130422.534890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626878592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130422.534963:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878464 00000100:00100000:3.0:1789130422.534968:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878464 00000100:00100000:3.0:1789130422.535006:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130422.535013:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3308:x1876037626878464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130422.535049:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:3308:x1876037626878464:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.535058:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789130422.535798:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626878464:0@lo:400:kworker.0 00000020:01000004:0.0:1789130422.548189:0:44363:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789130422.548194:0:44363:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789130422.548332:0:44363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b492731800 00000020:01000004:0.0:1789130422.548347:0:44363:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789130422.548359:0:44363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789130422.548371:0:44363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90b3830bb490) 00000020:00000080:0.0:1789130422.548385:0:44363:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789130422.566457:0:44363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789130422.566897:0:44363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789130422.569522:0:44363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789130422.569817:0:44363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789130422.570743:0:44363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789130422.571302:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789130422.571793:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789130422.571903:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789130422.572254:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 174: rc = 0 00100000:10000000:2.0:1789130422.572792:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 174: rc = 0 00100000:10000000:2.0:1789130422.573019:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 174: rc = 0 00100000:10000000:3.0:1789130422.578526:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 174: rc = 0 00100000:10000000:3.0:1789130422.578934:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 174: rc = 0 00100000:10000000:3.0:1789130422.579447:0:44363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 174: rc = 0 00000020:00000080:3.0:1789130422.580047:0:44363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789130422.580058:0:44363:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789130422.580069:0:44363:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ceb577 00000020:01000004:3.0:1789130422.580077:0:44363:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789130422.580099:0:44363:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789130422.580102:0:44363:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789130422.580108:0:44363:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789130422.580112:0:44363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789130422.580123:0:44363:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90b38310ced8) 00000020:00000080:3.0:1789130422.580132:0:44363:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789130422.584134:0:44363:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130422.585902:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130422.585911:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789130422.587386:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789130422.587397:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789130422.588104:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789130422.588112:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789130422.589903:0:44363:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130422.590088:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789130422.590094:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789130422.593695:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789130422.593709:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789130422.614587:0:44363:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130422.615051:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130422.615058:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789130422.621801:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789130422.621820:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789130422.623839:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789130422.623856:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789130422.628499:0:44363:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130422.629159:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789130422.629166:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789130422.632871:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789130422.632953:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789130422.691995:0:44363:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130422.692202:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789130422.692208:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789130422.693900:0:44363:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789130422.693914:0:44363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789130422.694310:0:44363:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789130422.694337:0:44363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789130422.694343:0:44363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789130422.703906:0:44363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789130422.703945:0:44363:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789130422.703950:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789130422.703952:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789130422.703954:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130422.703955:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130422.703956:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130422.703957:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130422.703959:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130422.703961:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130422.703962:0:44363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789130422.703966:0:44363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789130422.703968:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789130422.703970:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789130422.703971:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130422.703972:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130422.703973:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130422.703974:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130422.703975:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130422.703976:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130422.703977:0:44363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789130422.704007:0:44363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789130422.704027:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789130422.704106:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.704204:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b481254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130422.705022:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878720 00000100:00100000:0.0:1789130422.705035:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878720 00000100:00100000:2.0:1789130422.705229:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130422.705241:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:44363:x1876037626878720:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789130422.705291:0:43674:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789130422.705294:0:43674:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789130422.705298:0:43674:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789130422.728065:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:44363:x1876037626878720:12345-0@lo:253:mount.lustre.0 Request processed in 22817us (23949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.728082:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130422.728173:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789130422.728190:0:44363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789130422.728193:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789130422.728195:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789130422.728196:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130422.728197:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130422.728199:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130422.728200:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130422.728202:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130422.728204:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130422.728205:0:44363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789130422.728354:0:44363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b492731800 from lustre-OST0000 10000000:01000000:1.0:1789130422.728459:0:44363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789130422.728463:0:44363:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789130422.728471:0:44363:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b487cb0000 local copy 00010000:00010000:1.0:1789130422.728484:0:44363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130422.728958:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130422.729005:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.729091:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.729131:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878848 00000100:00100000:2.0:1789130422.729138:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878848 00000100:00100000:2.0:1789130422.729236:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130422.729247:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:44363:x1876037626878848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130422.729651:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:44363:x1876037626878848:12345-0@lo:501:mount.lustre.0 Request processed in 404us (644us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130422.729659:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789130422.729752:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878848:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789130422.729767:0:44363:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789130422.729910:0:44363:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789130422.729918:0:44363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.729928:0:44363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130422.729951:0:44363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b492731800 10000000:01000000:1.0:1789130422.729955:0:44363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789130422.729960:0:44363:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90b487cb0000 10000000:01000000:1.0:1789130422.729963:0:44363:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789130422.729966:0:44363:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90b487cb0000 from 1 10000000:01000000:1.0:1789130422.729969:0:44363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789130422.729996:0:44363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.730004:0:44363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.730013:0:44363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130422.730026:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789130422.730052:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.730498:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.730576:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626878976 00000100:00100000:3.0:1789130422.730581:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626878976 00000100:00100000:3.0:1789130422.730631:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130422.730640:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+12:44363:x1876037626878976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130422.730653:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130422.730677:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb58c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb585 expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.730717:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb58c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb585 expref: 13 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.730727:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c34000/0x5c74554e47ceb58c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb585 expref: 13 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.730736:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34000, rc 0) 00000100:00100000:3.0:1789130422.730773:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+13:44363:x1876037626878976:12345-0@lo:101:mount.lustre.0 Request processed in 135us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.730779:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789130422.730970:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626878976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130422.730986:0:44363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb58c expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.730996:0:44363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb58c expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130422.731016:0:44363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789130422.731038:0:44363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb58c expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.731044:0:44363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c3c600/0x5c74554e47ceb585 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb58c expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130422.731051:0:44363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789130422.731055:0:44363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789130422.731060:0:44363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789130422.731062:0:44363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789130422.731080:0:44363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.731087:0:44363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.731094:0:44363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130422.731107:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789130422.731133:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.731151:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.731479:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879104 00000100:00100000:3.0:1789130422.731485:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879104 00000100:00100000:3.0:1789130422.731509:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130422.731515:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+13:44363:x1876037626879104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130422.731524:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130422.731533:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb59a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb593 expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.731549:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb593 expref: 14 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.731569:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c34a00/0x5c74554e47ceb59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb593 expref: 14 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.731576:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34a00, rc 0) 00000100:00100000:3.0:1789130422.731639:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879104:12345-0@lo:101:mount.lustre.0 Request processed in 122us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.731645:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130422.732528:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130422.732549:0:44363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb59a expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130422.732560:0:44363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb59a expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130422.734181:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000040:00080000:1.0:1789130422.736193:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130422.736933:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:1.0:1789130422.736978:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 128 off8544 00000040:00080000:1.0:1789130422.737007:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 112 off8656 00000040:00080000:1.0:1789130422.737057:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8880 00000040:00080000:1.0:1789130422.737094:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9104 00000040:00080000:1.0:1789130422.737129:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 80 off9184 00000040:00080000:1.0:1789130422.737183:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 224 off9408 00000040:00080000:1.0:1789130422.737232:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9632 00000040:00080000:1.0:1789130422.737267:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 80 off9712 00000040:00080000:1.0:1789130422.737327:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 224 off9936 00000040:00080000:1.0:1789130422.738925:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10160 00000040:00080000:1.0:1789130422.739036:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 120 off10280 00000040:00080000:1.0:1789130422.739105:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 224 off10504 00000040:00080000:1.0:1789130422.739112:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 13 count 14 00000100:00100000:1.0:1789130422.739423:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130422.739498:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.739549:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b481254d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.739803:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879232 00000100:00100000:3.0:1789130422.739810:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879232 00000100:00100000:3.0:1789130422.739858:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130422.740162:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130422.740855:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879232:12345-0@lo:501:mount.lustre.0 Request processed in 694us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130422.740955:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130422.741002:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130422.741047:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.741071:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b481254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.742696:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879360 00000100:00100000:2.0:1789130422.742712:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879360 00000100:00100000:3.0:1789130422.746509:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130422.746688:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130422.746706:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130422.747249:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879360:12345-0@lo:503:mount.lustre.0 Request processed in 549us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.747262:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130422.747950:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789130422.748833:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789130422.748911:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130422.748985:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.749026:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b481254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130422.749313:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879488 00000100:00100000:0.0:1789130422.749321:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879488 00000100:00100000:0.0:1789130422.749381:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130422.749392:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130422.749669:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879488:12345-0@lo:502:mount.lustre.0 Request processed in 279us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.749679:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130422.750021:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130422.750450:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:1.0:1789130422.750507:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 128 off8544 00000040:00080000:1.0:1789130422.750541:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 112 off8656 00000040:00080000:1.0:1789130422.750587:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8880 00000040:00080000:1.0:1789130422.750658:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9104 00000040:00080000:1.0:1789130422.750693:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 80 off9184 00000040:00080000:1.0:1789130422.750739:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 224 off9408 00000040:00080000:1.0:1789130422.750777:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9632 00000040:00080000:1.0:1789130422.750811:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 80 off9712 00000040:00080000:1.0:1789130422.750859:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 224 off9936 00000040:00080000:2.0:1789130422.752109:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10160 00000040:00080000:2.0:1789130422.752176:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 120 off10280 00000100:00100000:2.0:1789130422.752243:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130422.752320:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130422.752699:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879616 00000100:00100000:0.0:1789130422.752707:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879616 00000100:00100000:0.0:1789130422.752761:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130422.752770:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130422.752983:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879616:12345-0@lo:502:mount.lustre.0 Request processed in 213us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.752992:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130422.753491:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.753517:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130422.753630:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 224 off10504 00000040:00080000:2.0:1789130422.753642:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789130422.768136:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789130422.768151:0:44377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789130422.768158:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.768161:0:44377:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789130422.768167:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130422.768183:0:44377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90b4b5764ed8) 00000020:00000080:1.0:1789130422.768209:0:44377:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789130422.768227:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789130422.768326:0:44377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b492731800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789130422.768334:0:44377:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789130422.768341:0:44377:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ceb5a8 00010000:00010000:1.0:1789130422.775999:0:44377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789130422.778526:0:44377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 30064771290 00080000:10000000:0.0:1789130422.803898:0:44377:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x12:0x0] (8/8/4) registered 00000020:00000080:0.0:1789130422.809516:0:44377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789130422.809531:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130422.809539:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809541:0:44377:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789130422.809547:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130422.809550:0:44377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789130422.809551:0:44377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130422.809553:0:44377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130422.809554:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130422.809556:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809558:0:44377:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130422.809560:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130422.809562:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809564:0:44377:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130422.809567:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130422.809569:0:44377:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130422.809572:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130422.809574:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809575:0:44377:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789130422.809577:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130422.809579:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809580:0:44377:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789130422.809583:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789130422.809692:0:44377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130422.809696:0:44377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.809698:0:44377:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789130422.809701:0:44377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000020:01000000:2.0:1789130422.812329:0:44363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789130422.812387:0:44363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789130422.812423:0:44363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb59a expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.812439:0:44363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c3c200/0x5c74554e47ceb593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb59a expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130422.812448:0:44363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492731800 from 1 10000000:01000000:2.0:1789130422.812451:0:44363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130422.812497:0:44363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.812505:0:44363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.812517:0:44363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130422.812545:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130422.812649:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.813318:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.815143:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879744 00000100:00100000:3.0:1789130422.815159:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879744 00000100:00100000:3.0:1789130422.815221:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130422.815230:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+14:44363:x1876037626879744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130422.815248:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130422.815264:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb5af expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.815293:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 15 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.815304:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 15 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.815314:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35800, rc 0) 00000100:00100000:3.0:1789130422.815417:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626879744:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.815425:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130422.815752:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130422.815776:0:44363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130422.815786:0:44363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130422.816665:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 13 count 13 00000040:00080000:0.0:1789130422.817142:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130422.818097:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:0.0:1789130422.818151:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:0.0:1789130422.818190:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:0.0:1789130422.818480:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8976 00000040:00080000:0.0:1789130422.818523:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 112 off9088 00000040:00080000:0.0:1789130422.818569:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 224 off9312 00000040:00080000:0.0:1789130422.828640:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].7, 224 off9536 00000040:00080000:0.0:1789130422.828797:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].8, 144 off9680 00000040:00080000:0.0:1789130422.828887:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].9, 224 off9904 00000040:00080000:0.0:1789130422.828922:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].10, 224 off10128 00000040:00080000:0.0:1789130422.828963:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].11, 128 off10256 00000040:00080000:0.0:1789130422.829047:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].12, 224 off10480 00000040:00080000:0.0:1789130422.829055:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 12 count 13 00000100:00100000:0.0:1789130422.829172:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130422.829255:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130422.829304:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4861683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.829480:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626879872 00000100:00100000:3.0:1789130422.829488:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626879872 00000100:00100000:3.0:1789130422.829541:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130422.829550:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626879872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130422.829792:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626879872:12345-0@lo:501:mount.lustre.0 Request processed in 242us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.829800:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130422.832052:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626879872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130422.832112:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130422.832192:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.835813:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880000 00000100:00100000:2.0:1789130422.835831:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880000 00000100:00100000:2.0:1789130422.835903:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130422.835913:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130422.836828:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880000:12345-0@lo:503:mount.lustre.0 Request processed in 913us (4631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.836839:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789130422.843566:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4861683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130422.843645:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789130422.844822:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789130422.846037:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130422.846135:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.846182:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4861683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130422.846369:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880128 00000100:00100000:0.0:1789130422.846377:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880128 00000100:00100000:0.0:1789130422.846456:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130422.846467:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130422.846735:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880128:12345-0@lo:502:mount.lustre.0 Request processed in 269us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.846745:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789130422.847439:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130422.851207:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:1.0:1789130422.853827:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:1.0:1789130422.853970:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:1.0:1789130422.854008:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:1.0:1789130422.854042:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000040:00080000:1.0:1789130422.854091:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:1.0:1789130422.854129:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 224 off9536 00000040:00080000:1.0:1789130422.854161:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 144 off9680 00000040:00080000:1.0:1789130422.854203:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9904 00000040:00080000:1.0:1789130422.854802:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10128 00000040:00080000:1.0:1789130422.854860:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 128 off10256 00000100:00100000:1.0:1789130422.854936:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130422.855044:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.855098:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.855226:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880256 00000100:00100000:2.0:1789130422.855234:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880256 00000100:00100000:2.0:1789130422.855290:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130422.855299:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130422.855534:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880256:12345-0@lo:502:mount.lustre.0 Request processed in 235us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.855542:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130422.855966:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130422.856054:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 224 off10480 00000040:00080000:1.0:1789130422.856064:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789130422.857799:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130422.857815:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.857817:0:44381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789130422.857825:0:44381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b492731800 00000020:00000080:1.0:1789130422.857828:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130422.857836:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130422.857839:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.857840:0:44381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789130422.857843:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130422.857845:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.857847:0:44381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789130422.857850:0:44381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b492731800 00000020:00000080:1.0:1789130422.857851:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130422.857965:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130422.857970:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.857971:0:44381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789130422.857974:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130422.857976:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130422.857978:0:44381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130422.857981:0:44381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b492731800 00000020:00000080:1.0:1789130422.857985:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130422.862770:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130422.875541:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.875550:0:44381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130422.875563:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130422.875570:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.875572:0:44381:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130422.875578:0:44381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b492731800 00000020:00000080:0.0:1789130422.875581:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130422.875736:0:44381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130422.875741:0:44381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130422.875742:0:44381:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789130422.875746:0:44381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 13 count 13 00000020:01000000:3.0:1789130422.876317:0:44363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789130422.876345:0:44363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130422.876461:0:44363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.876474:0:44363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130422.876527:0:44363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130422.876530:0:44363:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b492731800 10000000:01000000:3.0:1789130422.876533:0:44363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b492731800 10000000:01000000:3.0:1789130422.876537:0:44363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130422.876542:0:44363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b492731800 from 1 10000000:01000000:3.0:1789130422.876545:0:44363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130422.876579:0:44363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.876586:0:44363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.876597:0:44363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130422.876639:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130422.876703:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130422.876745:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.876813:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880384 00000100:00100000:2.0:1789130422.876820:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880384 00000100:00100000:2.0:1789130422.876867:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789130422.876876:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626880384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130422.876889:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130422.876902:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce0400/0x5c74554e47ceb5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb5bd expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.876924:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce0400/0x5c74554e47ceb5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb5bd expref: 16 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.876933:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce0400/0x5c74554e47ceb5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb5bd expref: 16 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.876941:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0400, rc 0) 00000100:00100000:2.0:1789130422.876975:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880384:12345-0@lo:101:mount.lustre.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.876982:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130422.879167:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130422.879202:0:44363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5c4 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.879217:0:44363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb5c4 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130422.879966:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000040:00080000:3.0:1789130422.880427:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130422.880756:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:3.0:1789130422.880804:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 120 off8536 00000040:00080000:3.0:1789130422.880842:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 168 off8704 00000040:00080000:3.0:1789130422.880909:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8928 00000040:00080000:3.0:1789130422.880952:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 224 off9152 00000040:00080000:3.0:1789130422.881005:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 120 off9272 00000040:00080000:3.0:1789130422.881043:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 168 off9440 00000040:00080000:3.0:1789130422.881080:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 224 off9664 00000040:00080000:3.0:1789130422.881132:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:3.0:1789130422.881171:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 120 off10008 00000040:00080000:3.0:1789130422.881209:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 224 off10232 00000040:00080000:3.0:1789130422.881262:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 224 off10456 00000040:00080000:3.0:1789130422.881301:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].13, 88 off10544 00000040:00080000:3.0:1789130422.881355:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].14, 128 off10672 00000040:00080000:3.0:1789130422.881423:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].15, 144 off10816 00000040:00080000:3.0:1789130422.881462:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].16, 160 off10976 00000040:00080000:3.0:1789130422.881493:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].17, 224 off11200 00000040:00080000:3.0:1789130422.881535:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].18, 224 off11424 00000040:00080000:3.0:1789130422.881569:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].19, 80 off11504 00000040:00080000:3.0:1789130422.881626:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].20, 224 off11728 00000040:00080000:3.0:1789130422.881678:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].21, 224 off11952 00000040:00080000:3.0:1789130422.881714:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].22, 88 off12040 00000040:00080000:3.0:1789130422.881744:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].23, 128 off12168 00000040:00080000:3.0:1789130422.881792:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].24, 144 off12312 00000040:00080000:3.0:1789130422.881828:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].25, 128 off12440 00000040:00080000:3.0:1789130422.881859:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].26, 224 off12664 00000040:00080000:3.0:1789130422.881901:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].27, 224 off12888 00000040:00080000:3.0:1789130422.881932:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].28, 80 off12968 00000040:00080000:3.0:1789130422.881961:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].29, 224 off13192 00000040:00080000:3.0:1789130422.882017:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].30, 224 off13416 00000040:00080000:3.0:1789130422.882052:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].31, 88 off13504 00000040:00080000:3.0:1789130422.882086:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].32, 128 off13632 00000040:00080000:3.0:1789130422.882120:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].33, 144 off13776 00000040:00080000:3.0:1789130422.882170:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].34, 128 off13904 00000040:00080000:3.0:1789130422.882203:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].35, 224 off14128 00000040:00080000:3.0:1789130422.882249:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].36, 224 off14352 00000040:00080000:3.0:1789130422.887773:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].37, 80 off14432 00000040:00080000:3.0:1789130422.887861:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].38, 224 off14656 00000040:00080000:3.0:1789130422.887933:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].39, 224 off14880 00000040:00080000:3.0:1789130422.887967:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].40, 120 off15000 00000040:00080000:3.0:1789130422.888058:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].41, 224 off15224 00000040:00080000:3.0:1789130422.888066:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 41 count 42 00000100:00100000:3.0:1789130422.888176:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130422.888248:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130422.888306:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130422.890664:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880512 00000100:00100000:0.0:1789130422.890678:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880512 00000100:00100000:0.0:1789130422.890734:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789130422.890744:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130422.895329:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880512:12345-0@lo:501:mount.lustre.0 Request processed in 4577us (7070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.895345:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130422.899164:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130422.899507:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130422.899582:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130422.899646:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130422.899718:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880640 00000100:00100000:2.0:1789130422.899724:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880640 00000100:00100000:2.0:1789130422.899768:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130422.899777:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130422.900754:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880640:12345-0@lo:503:mount.lustre.0 Request processed in 974us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.900766:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130422.906682:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789130422.908710:0:44363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789130422.909492:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130422.909582:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130422.909649:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130422.909738:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880768 00000100:00100000:1.0:1789130422.909745:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880768 00000100:00100000:1.0:1789130422.909787:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130422.909806:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130422.910022:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880768:12345-0@lo:502:mount.lustre.0 Request processed in 226us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130422.910028:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130422.910140:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789130422.910376:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:0.0:1789130422.910437:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 120 off8536 00000040:00080000:0.0:1789130422.910472:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 168 off8704 00000040:00080000:0.0:1789130422.910512:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8928 00000040:00080000:0.0:1789130422.910533:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 224 off9152 00000040:00080000:0.0:1789130422.910559:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 120 off9272 00000040:00080000:0.0:1789130422.910577:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 168 off9440 00000040:00080000:0.0:1789130422.910593:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 224 off9664 00000040:00080000:0.0:1789130422.910669:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:0.0:1789130422.910692:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 120 off10008 00000040:00080000:0.0:1789130422.910709:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 224 off10232 00000040:00080000:0.0:1789130422.910733:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 224 off10456 00000040:00080000:0.0:1789130422.910764:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].13, 88 off10544 00000040:00080000:0.0:1789130422.910784:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].14, 128 off10672 00000040:00080000:0.0:1789130422.910927:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].15, 144 off10816 00000040:00080000:0.0:1789130422.910948:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].16, 160 off10976 00000040:00080000:0.0:1789130422.910964:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].17, 224 off11200 00000040:00080000:0.0:1789130422.910987:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].18, 224 off11424 00000040:00080000:0.0:1789130422.911004:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].19, 80 off11504 00000040:00080000:0.0:1789130422.911020:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].20, 224 off11728 00000040:00080000:0.0:1789130422.911044:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].21, 224 off11952 00000040:00080000:0.0:1789130422.911063:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].22, 88 off12040 00000040:00080000:0.0:1789130422.911080:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].23, 128 off12168 00000040:00080000:0.0:1789130422.911103:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].24, 144 off12312 00000040:00080000:0.0:1789130422.911120:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].25, 128 off12440 00000040:00080000:0.0:1789130422.911135:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].26, 224 off12664 00000040:00080000:0.0:1789130422.911158:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].27, 224 off12888 00000040:00080000:0.0:1789130422.911175:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].28, 80 off12968 00000040:00080000:0.0:1789130422.911203:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].29, 224 off13192 00000040:00080000:0.0:1789130422.911241:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].30, 224 off13416 00000040:00080000:0.0:1789130422.911277:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].31, 88 off13504 00000040:00080000:0.0:1789130422.911311:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].32, 128 off13632 00000040:00080000:0.0:1789130422.911341:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].33, 144 off13776 00000040:00080000:0.0:1789130422.911490:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].34, 128 off13904 00000040:00080000:0.0:1789130422.911527:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].35, 224 off14128 00000040:00080000:0.0:1789130422.911582:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].36, 224 off14352 00000040:00080000:0.0:1789130422.912301:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].37, 80 off14432 00000040:00080000:0.0:1789130422.912345:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].38, 224 off14656 00000040:00080000:0.0:1789130422.912494:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].39, 224 off14880 00000040:00080000:0.0:1789130422.912534:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].40, 120 off15000 00000100:00100000:0.0:1789130422.912585:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130422.915095:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.915194:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.915300:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626880896 00000100:00100000:3.0:1789130422.915311:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626880896 00000100:00100000:3.0:1789130422.915385:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130422.915395:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130422.915694:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626880896:12345-0@lo:502:mount.lustre.0 Request processed in 299us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.915702:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130422.916154:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626880896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130422.916271:0:44363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].41, 224 off15224 00000040:00080000:1.0:1789130422.916288:0:44363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789130422.917335:0:44387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789130422.917413:0:44387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90b4b5760000) 00000020:00000080:1.0:1789130422.917437:0:44387:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789130422.917507:0:44387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b492731800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789130422.917511:0:44387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b492731800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789130422.917513:0:44387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b492731800 3 00010000:00080000:1.0:1789130422.917547:0:44387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b484c20800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789130422.917744:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130422.920168:0:44387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789130422.920434:0:44387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789130422.920473:0:44387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789130422.920486:0:44387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5c74554e47ceb5d2 00000100:00080000:2.0:1789130422.920497:0:44387:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130422.920503:0:44387:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b484c20800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789130422.920542:0:44387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae792c0 x1876037626881024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130422.920572:0:44387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789130422.920783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130422.920789:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130422.920791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130422.920803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789130422.920927:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626881152:0@lo:400:kworker.0 00000100:00100000:2.0:1789130422.920997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789130422.921172:0:44387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 42 count 42 00000020:01000000:2.0:1789130422.921270:0:44363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789130422.921297:0:44363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130422.921312:0:44363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5c4 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.921323:0:44363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c34c00/0x5c74554e47ceb5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5c4 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789130422.921368:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789130422.921371:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130422.921372:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130422.921373:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130422.921374:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130422.921376:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130422.921377:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130422.921379:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130422.921381:0:44363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130422.921384:0:44363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789130422.921387:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130422.921388:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130422.921389:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130422.921390:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130422.921391:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130422.921392:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130422.921393:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130422.921394:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130422.921394:0:44363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130422.921429:0:44363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789130422.921441:0:44363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626881280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789130422.921477:0:44363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.921501:0:44363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484e329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130422.921579:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626881024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789130422.921639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.921747:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881152 00000100:00100000:2.0:1789130422.921755:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881152 00000100:00100000:2.0:1789130422.921804:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881024 00000100:00100000:2.0:1789130422.921808:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881024 00000100:00100000:2.0:1789130422.921823:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130422.921832:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130422.921886:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626881152:12345-0@lo:400:kworker.0 Request processed in 55us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.921894:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130422.921909:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130422.921913:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626881024:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789130422.921934:0:43679:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 1586 last 0 00000020:00000080:2.0:1789130422.921965:0:43679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5c74554e47ceb5d9 00000004:00100000:2.0:1789130422.921981:0:43679:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130422.922013:0:43679:0:(import.c:65:import_set_state_nolock()) ffff90b485748000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130422.922051:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876037626881024:12345-0@lo:38:llog_process_th.0 Request processed in 136us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130422.922058:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789130422.922093:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b3868a0780 x1876037626881152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130422.922106:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626881152:0@lo:400:kworker.0 00010000:00080000:2.0:1789130422.922140:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bae792c0 x1876037626881024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130422.922147:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789130422.922154:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 8 00000100:00080000:2.0:1789130422.922161:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789130422.922166:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789130422.922168:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b484c20800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789130422.922174:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626881024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130422.922572:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881280 00000100:00100000:1.0:1789130422.922576:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881280 00000100:00100000:1.0:1789130422.922623:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789130422.922629:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:44363:x1876037626881280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789130422.922646:0:43673:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789130422.922659:0:43673:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789130422.955902:0:43673:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130422.955926:0:43673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789130422.956004:0:43695:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789130422.956009:0:43695:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789130422.956032:0:43695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.956051:0:43695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 16 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.956060:0:43695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.956103:0:43695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 16 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130422.956118:0:43695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 16 pid: 43674 timeout: 1686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130422.956133:0:43695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626881408:0@lo:104: 00000100:00100000:2.0:1789130422.956201:0:43695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130422.956250:0:43695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484e326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130422.956312:0:43663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881408 00000100:00100000:3.0:1789130422.956319:0:43663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881408 00000100:00100000:3.0:1789130422.956382:0:43663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130422.956392:0:43663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626881408:12345-0@lo:104: 00010000:00010000:3.0:1789130422.956415:0:43663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956471:0:43663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130422.956477:0:43663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626881408:12345-0@lo:104: Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.956484:0:43663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789130422.956507:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130422.956513:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956520:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3dc00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130422.956525:0:43667:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956534:0:43667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130422.956541:0:43667:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130422.956552:0:43667:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130422.956584:0:43667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956591:0:43667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130422.956630:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956638:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb54d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956654:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130422.956656:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130422.956657:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130422.956668:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626881536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130422.956695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130422.956735:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881536 00000100:00100000:3.0:1789130422.956739:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881536 00010000:00010000:3.0:1789130422.956755:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 17 pid: 43674 timeout: 1686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130422.956779:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130422.956786:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:3307:x1876037626881536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130422.956797:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130422.956802:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 17 pid: 43674 timeout: 1686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956812:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 17 pid: 43674 timeout: 1686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956829:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956838:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130422.956850:0:43666:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021658365s 00010000:00010000:3.0:1789130422.956854:0:43666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956861:0:43666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956870:0:43666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956877:0:43666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956883:0:43666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130422.956887:0:43666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956894:0:43666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956903:0:43666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.956912:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130422.956941:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:3307:x1876037626881536:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130422.956949:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130422.956997:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626881536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130422.957027:0:43695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb54d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb546 expref: 16 pid: 43674 timeout: 1686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130422.957037:0:43695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae792c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626881408:0@lo:104: 00010000:00010000:3.0:1789130422.957052:0:43695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.957060:0:43695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.957066:0:43695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130422.957073:0:43695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b383ce0200/0x5c74554e47ceb5e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130422.967306:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:44363:x1876037626881280:12345-0@lo:253:mount.lustre.0 Request processed in 44666us (45818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130422.967322:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130422.967463:0:44363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:44363:1876037626881280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789130422.967481:0:44363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789130422.967484:0:44363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130422.967486:0:44363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130422.967488:0:44363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130422.967489:0:44363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130422.967490:0:44363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130422.967492:0:44363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130422.967493:0:44363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130422.967495:0:44363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130422.967497:0:44363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789130422.967520:0:44363:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789130422.968037:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130422.968203:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789130422.968540:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130422.968955:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789130422.969174:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130422.969330:0:44363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789130422.970223:0:44363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738368 00002000:00080000:3.0:1789130423.007822:0:44363:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789130423.007832:0:44363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789130423.007867:0:44363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789130423.007940:0:44363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789130423.007954:0:44363:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789130423.007982:0:44363:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789130423.944681:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789130424.261993:0:43677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789130424.262001:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4be78c000 from 25 10000000:01000000:3.0:1789130424.262007:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789130424.262188:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130424.262207:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130424.262219:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130424.262977:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626881664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130424.263060:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130424.263109:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130424.263716:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881664 00000100:00100000:2.0:1789130424.263725:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881664 00000100:00100000:2.0:1789130424.263773:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130424.263783:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+15:43677:x1876037626881664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130424.263808:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130424.263827:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb5e7 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130424.263863:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 16 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130424.263874:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 16 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130424.263883:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1e00, rc 0) 00000100:00100000:2.0:1789130424.263942:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:43677:x1876037626881664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130424.263950:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130424.264048:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626881664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130424.264064:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130424.264080:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130424.264157:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626881792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789130424.264190:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130424.264225:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130424.264425:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881792 00000100:00100000:2.0:1789130424.264430:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881792 00000100:00100000:2.0:1789130424.264464:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130424.264473:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:43677:x1876037626881792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789130424.264488:0:43673:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789130424.264506:0:43673:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789130424.264509:0:43673:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 25 00000100:00100000:2.0:1789130424.264591:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:43677:x1876037626881792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130424.264627:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130424.264661:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626881792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789130424.264715:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130424.264721:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130424.264729:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130424.972702:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130425.991043:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130427.023212:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130428.049961:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789130428.169405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130428.169454:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130428.169457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130428.169459:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789130428.169534:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626881920:0@lo:400:kworker.0 00000100:00100000:2.0:1789130428.169622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130428.169671:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130428.169677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626882048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130428.169706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130428.169779:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626881920 00000100:00100000:2.0:1789130428.169786:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626881920 00000100:00100000:2.0:1789130428.169829:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789130428.169838:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3308:x1876037626881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130428.169886:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3308:x1876037626881920:12345-0@lo:400:kworker.0 Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130428.169893:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789130428.169947:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882048 00000100:00100000:2.0:1789130428.169951:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882048 00000100:00100000:2.0:1789130428.169979:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130428.169986:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626882048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130428.170016:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626882048:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130428.170021:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789130428.170055:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd52c0 x1876037626882048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130428.170069:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626882048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130428.170078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626881920:0@lo:400:kworker.0 00000100:00100000:0.0:1789130428.178149:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130428.178178:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626882176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130428.178338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130428.179144:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882176 00000100:00100000:1.0:1789130428.179155:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882176 00000100:00100000:1.0:1789130428.179220:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130428.179234:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626882176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130428.180223:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626882176:12345-0@lo:400:kworker.0 Request processed in 989us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130428.180234:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789130428.182017:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789130428.186806:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd4780 x1876037626882176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130428.186829:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626882176:0@lo:400:kworker.0 00010000:00010000:2.0:1789130429.061687:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130430.087771:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130430.603974:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789130430.782969:0:44732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789130431.111510:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130432.134096:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130417/real 1789130417] req@ffff90b388e16580 x1876037626877696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130432 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.134133:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b388e16580 x1876037626877696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130432 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.134144:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130417/real 1789130417] req@ffff90b388e15e00 x1876037626877824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130432 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.134157:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b388e15e00 x1876037626877824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130432 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130432.134177:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4be6eb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130432.134195:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130432.134199:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626877696:0@lo:8:kworker.0 00000100:00080000:0.0:1789130432.134204:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130432.134209:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130432.134212:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626877824:0@lo:8:kworker.0 00000100:00080000:0.0:1789130432.134290:0:43229:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130432.134295:0:43229:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789130432.134297:0:43229:0:(import.c:65:import_set_state_nolock()) ffff90b4be6eb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130432.134302:0:43229:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 1580 00000100:00080000:0.0:1789130432.134308:0:43229:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789130432.134315:0:43229:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b4be6eb000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789130432.134336:0:43229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd6d00 x1876037626882432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130432.134348:0:43229:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130432.134352:0:43229:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130432.134353:0:43229:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130432.134356:0:43229:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 1580 00000100:00080000:0.0:1789130432.134358:0:43229:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789130432.134362:0:43229:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789130432.134372:0:43229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd6580 x1876037626882560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130432.134418:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626882304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.134487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130432.134545:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626882688:0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.134574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130432.134597:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130432.134619:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626882816:0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.134643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130432.134677:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882304 00000100:00100000:0.0:1789130432.134684:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882304 00000100:00100000:0.0:1789130432.134728:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130432.134738:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3307:x1876037626882304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.134789:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3307:x1876037626882304:12345-0@lo:400:kworker.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130432.134815:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130432.134851:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882688 00000100:00100000:0.0:1789130432.134855:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882688 00000100:00100000:0.0:1789130432.134879:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882816 00000100:00100000:0.0:1789130432.134882:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882816 00000100:00100000:0.0:1789130432.134908:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130432.134915:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626882688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.134954:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626882688:12345-0@lo:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130432.134961:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130432.134972:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130432.134979:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626882816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.135007:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626882816:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130432.135016:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789130432.135043:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789130432.135068:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd6940 x1876037626882816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.135080:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626882816:0@lo:400:kworker.0 00010000:00080000:0.0:1789130432.135091:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd5e00 x1876037626882688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.135100:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626882688:0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.135125:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626882304:0@lo:400:kworker.0 00000100:00100000:0.0:1789130432.135139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626882432:0@lo:8:kworker.0 00000100:00100000:0.0:1789130432.135167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130432.135184:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626882560:0@lo:8:kworker.0 00000100:00100000:0.0:1789130432.135202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130432.136153:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130432.136183:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882432 00000100:00100000:1.0:1789130432.136190:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882432 00000100:00100000:1.0:1789130432.136221:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882560 00000100:00100000:1.0:1789130432.136225:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882560 00000100:00100000:1.0:1789130432.136238:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130432.136253:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876037626882432:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789130432.136279:0:44365:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1595 last 0 00000020:00000080:1.0:1789130432.136308:0:44365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ceb5f5 00002000:00100000:1.0:1789130432.136323:0:44365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90b488101800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789130432.136331:0:44365:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789130432.136334:0:44365:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789130432.136684:0:44365:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789130432.136709:0:44365:0:(import.c:65:import_set_state_nolock()) ffff90b488103000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130432.136782:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626882432:12345-0@lo:8:kworker.0 Request processed in 527us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130432.136789:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130432.137229:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130432.137238:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626882560:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789130432.137270:0:44367:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789130432.139231:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd6d00 x1876037626882432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.139254:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130432.139265:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1789130432.139275:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789130432.139281:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789130432.139284:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4be6eb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789130432.139306:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789130432.139312:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626882432:0@lo:8:kworker.0 00000004:00080000:0.0:1789130432.139380:0:43702:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0xd0:0x0] 00000100:00100000:0.0:1789130432.139402:0:43702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:43702:1876037626883072:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789130432.139455:0:43702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130432.139476:0:43702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4989c0780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130432.139489:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626882944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130432.139510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130432.140203:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626882944 00000100:00100000:1.0:1789130432.140213:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626882944 00000100:00100000:1.0:1789130432.140280:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130432.140291:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626882944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130432.140327:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130432.140386:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626882944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130432.140393:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130432.140414:0:44366:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789130432.140420:0:44366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789130432.140548:0:44365:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789130432.140555:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883072 00000100:00100000:1.0:1789130432.140559:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883072 00000100:00100000:1.0:1789130432.140674:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130432.140682:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:43702:x1876037626883072:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1789130432.143218:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bfcd6d00 x1876037626882944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130432.143259:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626882944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789130432.143291:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789130432.144270:0:43701:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789130432.144545:0:43701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1595241941811ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789130432.166568:0:44793:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789130432.166580:0:44793:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 225 -> diff = -17 00002000:02000040:1.0:1789130432.166586:0:44793:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:209 to 0x240000400:225) 00000100:00100000:0.0:1789130432.183268:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626882560:12345-0@lo:8:kworker.0 Request processed in 46020us (48055us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789130432.183290:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789130432.183351:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130432.183357:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789130432.183361:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626882560:0@lo:8:kworker.0 00002000:00010000:0.0:1789130432.222850:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.222862:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.222880:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe1:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.222886:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.222893:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.222915:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.222925:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.222932:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.222959:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130432.223673:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.223683:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.223694:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe0:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.223698:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.223702:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.223712:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.223720:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.223733:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.223749:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130432.226975:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130432.226989:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227009:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130432.227014:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227025:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227066:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227075:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b38a11/0x5c74554e47ceb5fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227101:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130432.227105:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227111:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130432.227114:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227122:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227131:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227139:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e4aadd/0x5c74554e47ceb603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130432.227151:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130432.227152:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130432.227154:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130432.227162:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130432.234503:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.234518:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.234535:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdf:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.234539:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.234546:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.234563:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.234575:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.234582:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.234629:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130432.235136:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.235143:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235153:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xde:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.235156:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.235161:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235170:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235178:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235186:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235204:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789130432.235219:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130432.235224:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235233:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.235251:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235262:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235279:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235286:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000673925f5/0x5c74554e47ceb60a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235302:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.235305:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235311:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.235314:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235320:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235328:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235335:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a71c5984/0x5c74554e47ceb611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235344:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.235346:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.235348:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130432.235843:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.235851:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235861:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdd:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.235865:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.235870:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235881:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235890:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235898:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235914:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130432.235924:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.235928:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235935:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.235938:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235946:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235957:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235964:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a32f8599/0x5c74554e47ceb618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.235976:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.235978:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.235980:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130432.236409:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.236415:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236424:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdc:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.236427:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.236431:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236445:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236453:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236460:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236473:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130432.236482:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.236485:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236491:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.236494:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236501:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236511:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236518:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007753e52c/0x5c74554e47ceb61f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.236533:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.236535:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.236536:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130432.238479:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130432.242429:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.242445:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242464:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdb:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.242469:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xdb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.242475:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242491:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242501:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242509:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242528:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130432.242542:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.242549:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242563:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.242567:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242576:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242595:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242625:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.242644:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.242646:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.242648:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130432.245431:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.245444:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.245461:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xda:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.245466:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xda:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.245472:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.245486:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.245497:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.245505:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.245528:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130432.249942:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.249954:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.249973:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd9:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.249978:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.249985:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250001:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250011:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250019:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250043:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789130432.250056:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130432.250062:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250071:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.250076:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250087:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250103:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250112:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4ac18f/0x5c74554e47ceb62d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250130:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.250133:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250140:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.250144:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250158:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250168:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250175:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a928cd8d/0x5c74554e47ceb634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.250188:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.250190:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.250191:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.250627:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.279029:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.279042:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279062:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd8:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.279067:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.279073:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279088:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279099:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279107:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279127:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130432.279539:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.279546:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279555:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd7:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.279558:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.279563:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279572:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279580:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279587:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279626:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789130432.279639:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130432.279645:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279653:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.279658:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279666:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279684:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279692:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ceb63b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279707:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.279711:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279718:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.279721:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279729:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279738:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279745:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d59c4e2d/0x5c74554e47ceb642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.279756:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.279758:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.279760:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.280163:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.280171:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280179:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd6:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.280182:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.280187:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280195:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280202:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280209:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280223:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130432.280231:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.280235:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280258:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.280262:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280275:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280285:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280292:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090fb52fa/0x5c74554e47ceb649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280311:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.280312:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.280314:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.280745:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.280752:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280760:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd5:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.280763:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.280767:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280778:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280785:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280793:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280809:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130432.280817:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.280821:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280828:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.280832:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280840:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280850:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280857:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090220099/0x5c74554e47ceb650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.280869:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.280871:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.280872:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.281375:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.281383:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281391:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd4:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.281394:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.281398:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281407:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281416:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281423:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281439:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130432.281448:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.281451:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281458:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.281462:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281470:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281481:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281489:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004238f982/0x5c74554e47ceb657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281500:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.281502:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.281504:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.281968:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.281975:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.281984:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd3:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.281987:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.281992:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282003:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282012:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282020:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282040:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130432.282050:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.282053:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282060:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.282063:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282070:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282080:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282089:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90723d2/0x5c74554e47ceb65e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282102:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.282104:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.282106:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130432.282503:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130432.282510:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282519:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd2:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:0.0:1789130432.282523:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130432.282527:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282538:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282546:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282555:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282568:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130432.282576:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130432.282580:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282587:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130432.282590:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282598:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282632:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282646:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47ceb665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130432.282659:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.282661:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130432.282663:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130432.297860:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130432.311126:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789130432.311182:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130432.311197:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311217:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd1:0x0].0x0 since=1595s v=(0 0) 00010000:00010000:3.0:1789130432.311223:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130432.311230:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311257:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311270:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311278:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311298:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130432.311312:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130432.311318:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311326:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130432.311330:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311339:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311360:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311368:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c18f0cc/0x5c74554e47ceb66c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130432.311393:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.311395:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130432.311397:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789130432.314446:0:44793:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:208 00000100:00100000:3.0:1789130432.317553:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:43702:x1876037626883072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 176862us (178087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130432.317575:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130432.318039:0:43702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:43702:1876037626883072:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789130432.318060:0:43702:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xe1:0x0] from OST, last_created [0x240000400:0xe1:0x0]last_used is [0x240000400:0xd0:0x0] 00000100:00100000:3.0:1789130432.318115:0:43702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:43702:1876037626883200:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789130432.318169:0:43702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130432.318222:0:43702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130432.318250:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883200 00000100:00100000:3.0:1789130432.318256:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883200 00000100:00100000:3.0:1789130432.318303:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130432.318313:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:43702:x1876037626883200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789130432.318363:0:44793:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 226 00000100:00100000:3.0:1789130432.352722:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:43702:x1876037626883200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 34403us (34545us total) trans 34359738369 rc 0/0 00000100:00100000:3.0:1789130432.352738:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130432.352813:0:43702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:43702:1876037626883200:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789130432.352830:0:43702:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xe1:0x0]-[0x240000400:0x101:0x0] 00010000:00010000:3.0:1789130433.160574:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789130433.443498:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789130433.443516:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738369 is committed 00010000:00010000:3.0:1789130434.188851:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130435.208593:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130436.233784:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130437.253821:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130437.382941:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130437.383017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130437.383414:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883328 00000100:00100000:3.0:1789130437.383422:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883328 00000100:00100000:3.0:1789130437.383487:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130437.383499:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130437.383534:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130437.383583:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130437.383591:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789130437.383714:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130437.383741:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738369 gen 2 00000100:00100000:0.0:1789130437.383762:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626883328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789130437.384125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130437.384131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789130437.384136:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130437.384142:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 1595 00000100:00080000:1.0:1789130437.384155:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789130437.384160:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789130437.384200:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b3868a0000 x1876037626883584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130437.384261:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626883456:0@lo:400:kworker.0 00000100:00100000:1.0:1789130437.384301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130437.384343:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130437.384350:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626883712:0@lo:400:kworker.0 00000100:00100000:1.0:1789130437.384376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130437.384413:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883712 00000100:00100000:1.0:1789130437.384417:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883712 00000100:00100000:1.0:1789130437.384453:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130437.384461:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626883712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130437.384500:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626883712:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130437.384506:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130437.384540:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626883840:0@lo:400:kworker.0 00000100:00100000:1.0:1789130437.384566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130437.384594:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883840 00000100:00100000:1.0:1789130437.384598:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883840 00000100:00100000:1.0:1789130437.384647:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130437.384653:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626883840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130437.384685:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626883840:12345-0@lo:400:kworker.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130437.384691:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789130437.384704:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789130437.384720:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b3868a1a40 x1876037626883840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130437.384730:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626883840:0@lo:400:kworker.0 00010000:00080000:1.0:1789130437.384754:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b3868a0b40 x1876037626883712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130437.384762:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626883712:0@lo:400:kworker.0 00000100:00100000:3.0:1789130437.384884:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626883584:0@lo:8:kworker.0 00000100:00100000:3.0:1789130437.384919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130437.385267:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883584 00000100:00100000:1.0:1789130437.385272:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883584 00000100:00100000:1.0:1789130437.385294:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130437.385299:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626883584:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789130437.385375:0:44367:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789130437.385422:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626883584:12345-0@lo:8:kworker.0 Request processed in 121us (501us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130437.385429:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789130437.385679:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130437.385684:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789130437.385688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626883584:0@lo:8:kworker.0 00000100:00100000:2.0:1789130437.387336:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883456 00000100:00100000:2.0:1789130437.387349:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883456 00000100:00100000:2.0:1789130437.387404:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789130437.387412:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3308:x1876037626883456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130437.387492:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3308:x1876037626883456:12345-0@lo:400:kworker.0 Request processed in 81us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130437.387500:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789130437.387566:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626883456:0@lo:400:kworker.0 00010000:00010000:2.0:1789130438.279048:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130439.302363:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789130439.334730:0:45084:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789130439.334734:0:45084:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789130439.334878:0:45084:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b489cb5000 00000020:01000004:3.0:1789130439.334892:0:45084:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789130439.334902:0:45084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789130439.334915:0:45084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90b4bb020000) 00000020:00000080:3.0:1789130439.334931:0:45084:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789130439.345971:0:45084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789130439.346195:0:45084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789130439.347005:0:45084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789130439.347246:0:45084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789130439.347494:0:45084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789130439.348244:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 243: rc = 0 00100000:10000000:3.0:1789130439.348341:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 243: rc = 0 00100000:10000000:3.0:1789130439.348414:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 243: rc = 0 00100000:10000000:3.0:1789130439.348975:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:3.0:1789130439.352325:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 566: rc = 0 00100000:10000000:3.0:1789130439.352571:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 566: rc = 0 00100000:10000000:3.0:1789130439.352898:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:3.0:1789130439.353153:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 566: rc = 0 00100000:10000000:3.0:1789130439.353325:0:45084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 566: rc = 0 00000020:00000080:3.0:1789130439.354261:0:45084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789130439.354274:0:45084:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789130439.354285:0:45084:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ceb67a 00000020:01000004:3.0:1789130439.354294:0:45084:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789130439.354315:0:45084:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789130439.354320:0:45084:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789130439.354326:0:45084:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789130439.354342:0:45084:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789130439.354345:0:45084:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789130439.379468:0:45084:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789130439.379521:0:45084:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.139@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789130439.379526:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789130439.379528:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130439.379529:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130439.379531:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130439.379532:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130439.379534:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130439.379535:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130439.379537:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130439.379538:0:45084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789130439.379542:0:45084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789130439.379544:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130439.379545:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130439.379546:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130439.379547:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130439.379548:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130439.379549:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130439.379550:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130439.379552:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130439.379553:0:45084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789130439.379584:0:45084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789130439.379691:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626883968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789130439.379769:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.379916:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130439.380288:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626883968 00000100:00100000:0.0:1789130439.380296:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626883968 00000100:00100000:0.0:1789130439.380362:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130439.380373:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:45084:x1876037626883968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789130439.380406:0:43673:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789130439.380409:0:43673:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789130439.380413:0:43673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789130439.397241:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:45084:x1876037626883968:12345-0@lo:253:mount.lustre.0 Request processed in 16856us (17458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.397257:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130439.397385:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626883968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789130439.397403:0:45084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789130439.397406:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789130439.397408:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789130439.397410:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130439.397411:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130439.397412:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130439.397414:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130439.397416:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789130439.397418:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130439.397419:0:45084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789130439.397440:0:45084:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b489cb5000 from lustre-OST0001 10000000:01000000:0.0:1789130439.397467:0:45084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789130439.397470:0:45084:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789130439.397478:0:45084:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b487cb0000 local copy 00010000:00010000:0.0:1789130439.397490:0:45084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130439.398092:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130439.398149:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130439.398220:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130439.398749:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884096 00000100:00100000:2.0:1789130439.398757:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884096 00000100:00100000:2.0:1789130439.401171:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789130439.401194:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:45084:x1876037626884096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130439.401592:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:45084:x1876037626884096:12345-0@lo:501:mount.lustre.0 Request processed in 409us (3441us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130439.401628:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789130439.405345:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884096:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789130439.408134:0:45084:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789130439.408393:0:45084:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789130439.408405:0:45084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130439.408415:0:45084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35000/0x5c74554e47ceb46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb474 expref: -99 pid: 43661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130439.408444:0:45084:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b489cb5000 10000000:01000000:0.0:1789130439.408448:0:45084:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789130439.408453:0:45084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789130439.408456:0:45084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130439.408460:0:45084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789130439.408462:0:45084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789130439.408497:0:45084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130439.408509:0:45084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130439.408520:0:45084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130439.408917:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130439.408991:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130439.409040:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130439.412017:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884224 00000100:00100000:2.0:1789130439.412033:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884224 00000100:00100000:2.0:1789130439.412120:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130439.412131:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:45084:x1876037626884224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130439.412149:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130439.412168:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb681 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.412197:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb681 expref: 17 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.412207:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce1400/0x5c74554e47ceb688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb681 expref: 17 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.412216:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1400, rc 0) 00000100:00100000:2.0:1789130439.412311:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884224:12345-0@lo:101:mount.lustre.0 Request processed in 182us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.412318:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789130439.412435:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130439.412454:0:45084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb688 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.412464:0:45084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb688 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130439.413239:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000040:00080000:1.0:1789130439.414082:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130439.414340:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:1.0:1789130439.414385:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 128 off8544 00000040:00080000:1.0:1789130439.414420:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 112 off8656 00000040:00080000:1.0:1789130439.414467:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8880 00000040:00080000:1.0:1789130439.414505:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9104 00000040:00080000:1.0:1789130439.414539:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 80 off9184 00000040:00080000:1.0:1789130439.414586:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 224 off9408 00000040:00080000:1.0:1789130439.414649:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9632 00000040:00080000:1.0:1789130439.414678:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 120 off9752 00000040:00080000:1.0:1789130439.414707:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 224 off9976 00000040:00080000:1.0:1789130439.414711:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 10 count 11 00000100:00100000:1.0:1789130439.414769:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130439.414819:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.414859:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.414876:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884352 00000100:00100000:3.0:1789130439.414885:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884352 00000100:00100000:3.0:1789130439.414938:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130439.414949:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130439.415393:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884352:12345-0@lo:501:mount.lustre.0 Request processed in 443us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.415401:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130439.421062:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130439.421137:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130439.421212:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.421254:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.421418:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884480 00000100:00100000:3.0:1789130439.421426:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884480 00000100:00100000:3.0:1789130439.421550:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130439.421562:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130439.422014:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884480:12345-0@lo:503:mount.lustre.0 Request processed in 454us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.422023:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130439.426902:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789130439.428336:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789130439.428424:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130439.428508:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.433442:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130439.433523:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884608 00000100:00100000:2.0:1789130439.433543:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884608 00000100:00100000:2.0:1789130439.433639:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789130439.433649:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130439.434018:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884608:12345-0@lo:502:mount.lustre.0 Request processed in 371us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.434028:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130439.434494:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130439.434992:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:1.0:1789130439.435091:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 128 off8544 00000040:00080000:1.0:1789130439.435176:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 112 off8656 00000040:00080000:1.0:1789130439.435273:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8880 00000040:00080000:1.0:1789130439.435336:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9104 00000040:00080000:1.0:1789130439.435386:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 80 off9184 00000040:00080000:1.0:1789130439.435445:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 224 off9408 00000040:00080000:1.0:1789130439.435494:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9632 00000040:00080000:1.0:1789130439.435547:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 120 off9752 00000100:00100000:1.0:1789130439.435691:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130439.435756:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.435816:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.436818:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884736 00000100:00100000:3.0:1789130439.436828:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884736 00000100:00100000:3.0:1789130439.436885:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130439.436895:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130439.437107:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884736:12345-0@lo:502:mount.lustre.0 Request processed in 213us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.437134:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130439.437191:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130439.437282:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 224 off9976 00000040:00080000:1.0:1789130439.437294:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789130439.441782:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789130439.441797:0:45085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789130439.442726:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130439.442731:0:45085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789130439.442741:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130439.442761:0:45085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90b4b5763490) 00000020:00000080:1.0:1789130439.442791:0:45085:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789130439.442799:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789130439.442985:0:45085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b489cb5000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789130439.442996:0:45085:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789130439.443006:0:45085:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ceb696 00010000:00010000:1.0:1789130439.453501:0:45085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789130439.454470:0:45085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 8, last_transno is 30064771226 00080000:10000000:1.0:1789130439.463243:0:45085:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x12:0x0] (8/8/4) registered 00000020:00000080:2.0:1789130439.466382:0:45085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789130439.466396:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130439.466404:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130439.466407:0:45085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789130439.466411:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130439.466416:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130439.466418:0:45085:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789130439.466422:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789130439.466424:0:45085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789130439.466426:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130439.466430:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130439.466431:0:45085:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789130439.466434:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130439.466437:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130439.466438:0:45085:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789130439.466442:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789130439.466477:0:45085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130439.466481:0:45085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130439.466483:0:45085:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789130439.466486:0:45085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 11 count 11 00000020:01000000:1.0:1789130439.467214:0:45084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789130439.467242:0:45084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789130439.467263:0:45084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb688 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467276:0:45084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b3873f3c00/0x5c74554e47ceb681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb688 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130439.467283:0:45084:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b489cb5000 from 1 10000000:01000000:1.0:1789130439.467286:0:45084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130439.467324:0:45084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467333:0:45084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467344:0:45084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130439.467371:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789130439.467445:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.467489:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130439.467510:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884864 00000100:00100000:1.0:1789130439.467516:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884864 00000100:00100000:1.0:1789130439.467563:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130439.467572:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:45084:x1876037626884864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130439.467584:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130439.467597:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb69d expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467645:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467657:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467665:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c3ca00, rc 0) 00000100:00100000:1.0:1789130439.467710:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626884864:12345-0@lo:101:mount.lustre.0 Request processed in 138us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130439.467717:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130439.467766:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130439.467779:0:45084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.467787:0:45084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130439.468397:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 13 count 13 00000040:00080000:1.0:1789130439.468810:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130439.469094:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:1.0:1789130439.469159:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:1.0:1789130439.469206:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:1.0:1789130439.469244:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8976 00000040:00080000:1.0:1789130439.469274:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 112 off9088 00000040:00080000:1.0:1789130439.469324:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 224 off9312 00000040:00080000:1.0:1789130439.469361:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].7, 224 off9536 00000040:00080000:1.0:1789130439.469413:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].8, 144 off9680 00000040:00080000:1.0:1789130439.469473:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].9, 224 off9904 00000040:00080000:1.0:1789130439.469509:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].10, 224 off10128 00000040:00080000:1.0:1789130439.469560:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].11, 128 off10256 00000040:00080000:1.0:1789130439.469669:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].12, 224 off10480 00000040:00080000:1.0:1789130439.469678:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 12 count 13 00000100:00100000:1.0:1789130439.469760:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130439.469824:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.469865:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130439.470771:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626884992 00000100:00100000:0.0:1789130439.470781:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626884992 00000100:00100000:0.0:1789130439.470829:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130439.470841:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626884992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130439.474527:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626884992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130439.474595:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130439.474632:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626884992:12345-0@lo:501:mount.lustre.0 Request processed in 3642us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130439.474644:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130439.474674:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130439.474687:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885120 00000100:00100000:0.0:1789130439.474694:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885120 00000100:00100000:2.0:1789130439.474708:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130439.474731:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130439.474741:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130439.474909:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885120:12345-0@lo:503:mount.lustre.0 Request processed in 168us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130439.475569:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130439.476545:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789130439.478533:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130439.478751:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130439.479087:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.479181:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130439.479225:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885248 00000100:00100000:1.0:1789130439.479231:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885248 00000100:00100000:1.0:1789130439.479317:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789130439.479328:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130439.482099:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885248:12345-0@lo:502:mount.lustre.0 Request processed in 2761us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130439.482129:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789130439.490280:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130439.493390:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:1.0:1789130439.493491:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:1.0:1789130439.493543:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:1.0:1789130439.494014:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:1.0:1789130439.494058:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000040:00080000:1.0:1789130439.494158:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:1.0:1789130439.494197:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 224 off9536 00000040:00080000:1.0:1789130439.494233:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 144 off9680 00000040:00080000:1.0:1789130439.494299:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9904 00000040:00080000:1.0:1789130439.494339:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10128 00000040:00080000:1.0:1789130439.494384:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 128 off10256 00000100:00100000:1.0:1789130439.494435:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130439.494522:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130439.494570:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885376 00000100:00100000:1.0:1789130439.495104:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885376 00000100:00100000:1.0:1789130439.495183:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789130439.495195:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130439.495409:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885376:12345-0@lo:502:mount.lustre.0 Request processed in 216us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130439.495417:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789130439.495470:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130439.495491:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130439.497070:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 224 off10480 00000040:00080000:1.0:1789130439.497095:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789130439.500556:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130439.500571:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500574:0:45089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789130439.500583:0:45089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b489cb5000 00000020:00000080:3.0:1789130439.500585:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130439.500594:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130439.500597:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500624:0:45089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789130439.500629:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130439.500634:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500635:0:45089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789130439.500641:0:45089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b489cb5000 00000020:00000080:3.0:1789130439.500644:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130439.500718:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130439.500722:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500724:0:45089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789130439.500728:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130439.500731:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500733:0:45089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130439.500738:0:45089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b489cb5000 00000020:00000080:3.0:1789130439.500741:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130439.500773:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130439.500777:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500779:0:45089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130439.500783:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130439.500786:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.500788:0:45089:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789130439.500793:0:45089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b489cb5000 00000020:00000080:3.0:1789130439.500796:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130439.501258:0:45089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130439.501264:0:45089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130439.501265:0:45089:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789130439.501269:0:45089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 13 count 13 00000020:01000000:2.0:1789130439.502169:0:45084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789130439.502200:0:45084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130439.502220:0:45084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502233:0:45084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130439.502300:0:45084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789130439.502303:0:45084:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b489cb5000 10000000:01000000:2.0:1789130439.502306:0:45084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b489cb5000 10000000:01000000:2.0:1789130439.502311:0:45084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789130439.502317:0:45084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b489cb5000 from 1 10000000:01000000:2.0:1789130439.502320:0:45084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789130439.502362:0:45084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502372:0:45084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502383:0:45084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130439.502408:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130439.502486:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.502526:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885504 00000100:00100000:2.0:1789130439.502533:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885504 00000100:00100000:2.0:1789130439.502584:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130439.502594:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626885504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130439.502640:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130439.502655:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce1a00/0x5c74554e47ceb6b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb6ab expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502680:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1a00/0x5c74554e47ceb6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb6ab expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502692:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce1a00/0x5c74554e47ceb6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb6ab expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502701:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1a00, rc 0) 00000100:00100000:2.0:1789130439.502736:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885504:12345-0@lo:101:mount.lustre.0 Request processed in 143us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.502743:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130439.502789:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130439.502837:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130439.502852:0:45084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6b2 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.502862:0:45084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb6b2 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130439.503704:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000040:00080000:2.0:1789130439.504011:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130439.504300:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:2.0:1789130439.504356:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 120 off8536 00000040:00080000:2.0:1789130439.504396:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 168 off8704 00000040:00080000:2.0:1789130439.504454:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8928 00000040:00080000:2.0:1789130439.504498:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 224 off9152 00000040:00080000:2.0:1789130439.504570:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 120 off9272 00000040:00080000:2.0:1789130439.504641:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 168 off9440 00000040:00080000:2.0:1789130439.504677:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 224 off9664 00000040:00080000:2.0:1789130439.504724:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:2.0:1789130439.504765:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 120 off10008 00000040:00080000:2.0:1789130439.504802:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 224 off10232 00000040:00080000:2.0:1789130439.504854:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 224 off10456 00000040:00080000:2.0:1789130439.504891:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].13, 88 off10544 00000040:00080000:2.0:1789130439.504924:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].14, 128 off10672 00000040:00080000:2.0:1789130439.504973:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].15, 144 off10816 00000040:00080000:2.0:1789130439.505012:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].16, 160 off10976 00000040:00080000:2.0:1789130439.505047:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].17, 224 off11200 00000040:00080000:2.0:1789130439.505097:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].18, 224 off11424 00000040:00080000:2.0:1789130439.521701:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].19, 80 off11504 00000040:00080000:2.0:1789130439.521822:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].20, 224 off11728 00000040:00080000:2.0:1789130439.521990:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].21, 224 off11952 00000040:00080000:2.0:1789130439.522030:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].22, 88 off12040 00000040:00080000:2.0:1789130439.522061:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].23, 128 off12168 00000040:00080000:2.0:1789130439.522123:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].24, 144 off12312 00000040:00080000:2.0:1789130439.522160:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].25, 128 off12440 00000040:00080000:2.0:1789130439.522192:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].26, 224 off12664 00000040:00080000:2.0:1789130439.522242:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].27, 224 off12888 00000040:00080000:2.0:1789130439.522279:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].28, 80 off12968 00000040:00080000:2.0:1789130439.522315:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].29, 224 off13192 00000040:00080000:2.0:1789130439.522360:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].30, 224 off13416 00000040:00080000:2.0:1789130439.522399:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].31, 88 off13504 00000040:00080000:2.0:1789130439.522435:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].32, 128 off13632 00000040:00080000:2.0:1789130439.522472:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].33, 144 off13776 00000040:00080000:2.0:1789130439.522525:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].34, 128 off13904 00000040:00080000:2.0:1789130439.522566:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].35, 224 off14128 00000040:00080000:2.0:1789130439.522662:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].36, 224 off14352 00000040:00080000:2.0:1789130439.522721:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].37, 80 off14432 00000040:00080000:2.0:1789130439.522757:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].38, 224 off14656 00000040:00080000:2.0:1789130439.522810:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].39, 224 off14880 00000040:00080000:2.0:1789130439.524451:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].40, 120 off15000 00000040:00080000:2.0:1789130439.526645:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].41, 224 off15224 00000040:00080000:2.0:1789130439.526672:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 41 count 42 00000100:00100000:2.0:1789130439.526798:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130439.530208:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.530266:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.531210:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885632 00000100:00100000:3.0:1789130439.531225:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885632 00000100:00100000:3.0:1789130439.531281:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789130439.531292:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130439.535174:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885632:12345-0@lo:501:mount.lustre.0 Request processed in 3871us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.535190:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130439.536888:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130439.537066:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130439.537151:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130439.537196:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b58223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130439.538685:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885760 00000100:00100000:2.0:1789130439.538697:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885760 00000100:00100000:2.0:1789130439.538761:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789130439.538772:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885760:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130439.539031:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885760:12345-0@lo:503:mount.lustre.0 Request processed in 259us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.539039:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130439.539224:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130439.540100:0:45084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130439.540206:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130439.540261:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130439.540300:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626885888 00000100:00100000:3.0:1789130439.540306:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626885888 00000100:00100000:3.0:1789130439.540343:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130439.540351:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130439.540540:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626885888:12345-0@lo:502:mount.lustre.0 Request processed in 189us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.540550:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130439.540620:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b58223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.540636:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626885888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130439.540843:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:3.0:1789130439.540888:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 120 off8536 00000040:00080000:3.0:1789130439.540918:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 168 off8704 00000040:00080000:3.0:1789130439.540972:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8928 00000040:00080000:3.0:1789130439.541012:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 224 off9152 00000040:00080000:3.0:1789130439.541073:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 120 off9272 00000040:00080000:3.0:1789130439.541126:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 168 off9440 00000040:00080000:3.0:1789130439.541164:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 224 off9664 00000040:00080000:3.0:1789130439.541212:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:3.0:1789130439.541252:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 120 off10008 00000040:00080000:3.0:1789130439.541291:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 224 off10232 00000040:00080000:3.0:1789130439.541344:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 224 off10456 00000040:00080000:3.0:1789130439.541385:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].13, 88 off10544 00000040:00080000:3.0:1789130439.541418:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].14, 128 off10672 00000040:00080000:3.0:1789130439.541464:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].15, 144 off10816 00000040:00080000:3.0:1789130439.541499:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].16, 160 off10976 00000040:00080000:3.0:1789130439.541533:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].17, 224 off11200 00000040:00080000:3.0:1789130439.541579:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].18, 224 off11424 00000040:00080000:3.0:1789130439.541641:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].19, 80 off11504 00000040:00080000:3.0:1789130439.541676:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].20, 224 off11728 00000040:00080000:3.0:1789130439.541725:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].21, 224 off11952 00000040:00080000:3.0:1789130439.541775:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].22, 88 off12040 00000040:00080000:3.0:1789130439.541808:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].23, 128 off12168 00000040:00080000:3.0:1789130439.541852:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].24, 144 off12312 00000040:00080000:3.0:1789130439.541886:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].25, 128 off12440 00000040:00080000:3.0:1789130439.541921:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].26, 224 off12664 00000040:00080000:3.0:1789130439.541970:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].27, 224 off12888 00000040:00080000:3.0:1789130439.542006:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].28, 80 off12968 00000040:00080000:3.0:1789130439.542041:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].29, 224 off13192 00000040:00080000:3.0:1789130439.542090:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].30, 224 off13416 00000040:00080000:3.0:1789130439.547220:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].31, 88 off13504 00000040:00080000:3.0:1789130439.547321:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].32, 128 off13632 00000040:00080000:3.0:1789130439.547361:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].33, 144 off13776 00000040:00080000:3.0:1789130439.547439:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].34, 128 off13904 00000040:00080000:3.0:1789130439.547621:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].35, 224 off14128 00000040:00080000:3.0:1789130439.547690:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].36, 224 off14352 00000040:00080000:3.0:1789130439.547939:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].37, 80 off14432 00000040:00080000:3.0:1789130439.548085:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].38, 224 off14656 00000040:00080000:3.0:1789130439.548164:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].39, 224 off14880 00000040:00080000:3.0:1789130439.548221:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].40, 120 off15000 00000100:00100000:3.0:1789130439.548358:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626886016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130439.548449:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130439.548947:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886016 00000100:00100000:3.0:1789130439.548956:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886016 00000100:00100000:3.0:1789130439.549129:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130439.549143:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626886016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130439.550447:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626886016:12345-0@lo:502:mount.lustre.0 Request processed in 1302us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.550471:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130439.550569:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b58223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.550592:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626886016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130439.550727:0:45084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].41, 224 off15224 00000040:00080000:3.0:1789130439.550744:0:45084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789130439.556543:0:45094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789130439.556563:0:45094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90b4bb024ed8) 00000020:00000080:3.0:1789130439.556586:0:45094:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789130439.556706:0:45094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b489cb5000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789130439.556712:0:45094:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b489cb5000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789130439.556715:0:45094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b489cb5000 3 00010000:00080000:3.0:1789130439.557156:0:45094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b38686b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1789130439.563143:0:45094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789130439.563373:0:45094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789130439.563411:0:45094:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789130439.563425:0:45094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5c74554e47ceb6c0 00000100:00080000:3.0:1789130439.563435:0:45094:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130439.563441:0:45094:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b38686b000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130439.565994:0:45094:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e14f00 x1876037626886144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130439.566045:0:45094:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789130439.566134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130439.566139:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130439.566142:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130439.566148:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 1600 00000100:00080000:3.0:1789130439.566152:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789130439.566159:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789130439.566178:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b388e161c0 x1876037626886400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130439.566236:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626886528:0@lo:400:kworker.0 00000100:00100000:2.0:1789130439.566308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626886144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130439.566696:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626886272:0@lo:400:kworker.0 00000100:00100000:2.0:1789130439.569549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.569648:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626886400:0@lo:8:kworker.0 00000100:00100000:2.0:1789130439.569710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130439.572030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130439.572199:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886400 00000100:00100000:3.0:1789130439.572210:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886400 00000100:00100000:3.0:1789130439.572257:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130439.572265:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1876037626886400:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789130439.572416:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3305:x1876037626886400:12345-0@lo:8:kworker.0 Request processed in 149us (2704us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789130439.572424:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130439.572536:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130439.572545:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130439.572550:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789130439.572554:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626886400:0@lo:8:kworker.0 00000100:00100000:3.0:1789130439.572588:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130439.572599:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626886656:0@lo:400:kworker.0 00000100:00100000:3.0:1789130439.572651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.574272:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886144 00000100:00100000:2.0:1789130439.574285:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886144 00000100:00100000:2.0:1789130439.574313:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886528 00000100:00100000:2.0:1789130439.574316:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886528 00000100:00100000:2.0:1789130439.574337:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886656 00000100:00100000:2.0:1789130439.574340:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886656 00000100:00100000:2.0:1789130439.574377:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130439.574386:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130439.574465:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626886528:12345-0@lo:400:kworker.0 Request processed in 81us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.574473:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130439.574488:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130439.574495:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626886656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130439.574523:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626886656:12345-0@lo:400:kworker.0 Request processed in 29us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.574530:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130439.574545:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130439.574550:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626886144:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789130439.574561:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b388e170c0 x1876037626886656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130439.574576:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626886656:0@lo:400:kworker.0 00010000:00080000:2.0:1789130439.574586:0:43680:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 1602 last 0 00010000:00080000:3.0:1789130439.574590:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b388e15680 x1876037626886528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130439.574622:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626886528:0@lo:400:kworker.0 00000020:00000080:2.0:1789130439.574647:0:43680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5c74554e47ceb6c7 00000004:00100000:2.0:1789130439.574664:0:43680:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130439.574695:0:43680:0:(import.c:65:import_set_state_nolock()) ffff90b4c094b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130439.574744:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876037626886144:12345-0@lo:38:llog_process_th.0 Request processed in 192us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.574751:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789130439.574883:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b388e14f00 x1876037626886144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130439.574893:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130439.574899:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 8 00000100:00080000:3.0:1789130439.574907:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789130439.574912:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789130439.574915:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b38686b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130439.574921:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626886144:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789130439.575425:0:45094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 42 count 42 00000020:01000000:2.0:1789130439.575506:0:45084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789130439.575543:0:45084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130439.575560:0:45084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6b2 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.575572:0:45084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b383ce0200/0x5c74554e47ceb6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6b2 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789130439.575647:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789130439.575649:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130439.575651:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130439.575652:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130439.575653:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130439.575655:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130439.575656:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130439.575658:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130439.575660:0:45084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130439.575664:0:45084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789130439.575666:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130439.575668:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130439.575669:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130439.575670:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130439.575671:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130439.575673:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130439.575674:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130439.575675:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130439.575676:0:45084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130439.575697:0:45084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789130439.575715:0:45084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626886784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789130439.575763:0:45084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.575801:0:45084:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130439.575961:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886784 00000100:00100000:3.0:1789130439.575967:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886784 00000100:00100000:3.0:1789130439.576020:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130439.576028:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:45084:x1876037626886784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789130439.576051:0:43671:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789130439.576132:0:43671:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789130439.576380:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130439.576432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.577962:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886272 00000100:00100000:2.0:1789130439.577975:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886272 00000100:00100000:2.0:1789130439.578028:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130439.578038:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626886272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130439.578244:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626886272:12345-0@lo:400:kworker.0 Request processed in 208us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.578253:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789130439.580471:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130439.581142:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626886272:0@lo:400:kworker.0 20000000:01000000:0.0:1789130439.626028:0:43671:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789130439.626164:0:43671:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789130439.629743:0:43695:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789130439.629754:0:43695:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789130439.629778:0:43695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.630126:0:43695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 19 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.630134:0:43695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.630175:0:43695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 19 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.630189:0:43695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 19 pid: 43674 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130439.630304:0:43695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626886912:0@lo:104: 00000100:00100000:2.0:1789130439.630371:0:43695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.630461:0:43695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130439.630561:0:43662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626886912 00000100:00100000:1.0:1789130439.630570:0:43662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626886912 00000100:00100000:1.0:1789130439.630753:0:43662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130439.630763:0:43662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626886912:12345-0@lo:104: 00010000:00010000:1.0:1789130439.630778:0:43662:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130439.631004:0:43662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130439.631011:0:43662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:43695:x1876037626886912:12345-0@lo:104: Request processed in 249us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130439.631018:0:43662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789130439.638433:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130439.638448:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638460:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130439.638465:0:43667:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638486:0:43667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130439.638494:0:43667:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130439.638506:0:43667:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789130439.638563:0:43667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638569:0:43667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130439.638594:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638615:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b390c35e00/0x5c74554e47ceb5e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5ee expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638638:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130439.638640:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130439.638642:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130439.638667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626887040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130439.638731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130439.638813:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887040 00000100:00100000:2.0:1789130439.638819:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887040 00010000:00010000:2.0:1789130439.638852:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 20 pid: 43674 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130439.638882:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130439.638891:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+20:3306:x1876037626887040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130439.638903:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130439.638908:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 20 pid: 43674 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638930:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 20 pid: 43674 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638950:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638959:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789130439.638973:0:43666:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021658365s 00010000:00010000:2.0:1789130439.638978:0:43666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638985:0:43666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638991:0:43666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.638997:0:43666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639002:0:43666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130439.639006:0:43666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639013:0:43666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639022:0:43666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639031:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130439.639078:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+20:3306:x1876037626887040:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130439.639087:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130439.639141:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626887040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130439.639172:0:43695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b383ce1e00/0x5c74554e47ceb5ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb5e7 expref: 19 pid: 43674 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130439.639183:0:43695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:43695:1876037626886912:0@lo:104: 00010000:00010000:2.0:1789130439.639197:0:43695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639206:0:43695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639212:0:43695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130439.639218:0:43695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b383ce1600/0x5c74554e47ceb6ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130439.665653:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:45084:x1876037626886784:12345-0@lo:253:mount.lustre.0 Request processed in 89616us (89880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130439.665668:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789130439.665720:0:45084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:45084:1876037626886784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789130439.665736:0:45084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789130439.665739:0:45084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130439.665741:0:45084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130439.665742:0:45084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130439.665744:0:45084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130439.665745:0:45084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130439.665747:0:45084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130439.665748:0:45084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130439.665750:0:45084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130439.665752:0:45084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789130439.665767:0:45084:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789130439.666238:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130439.666352:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789130439.666452:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130439.666734:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789130439.666938:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789130439.667095:0:45084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789130439.668232:0:45084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 8, last_transno is 34359738368 00002000:00080000:0.0:1789130439.746027:0:45084:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789130439.746037:0:45084:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789130439.746199:0:45084:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789130439.746260:0:45084:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789130439.746276:0:45084:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789130439.746308:0:45084:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789130440.328250:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789130440.774013:0:43677:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130440.774022:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4be78c000 from 26 10000000:01000000:2.0:1789130440.774028:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130440.774099:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130440.774111:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130440.774122:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130440.774149:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626887168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130440.774217:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130440.774275:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130440.774332:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887168 00000100:00100000:0.0:1789130440.774340:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887168 00000100:00100000:0.0:1789130440.774394:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130440.774403:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626887168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130440.774416:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130440.774430:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b3873f2a00/0x5c74554e47ceb6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceb6d5 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130440.774452:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f2a00/0x5c74554e47ceb6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceb6d5 expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130440.774461:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b3873f2a00/0x5c74554e47ceb6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb6d5 expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130440.774471:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2a00, rc 0) 00000100:00100000:0.0:1789130440.774512:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626887168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130440.774519:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130440.774563:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626887168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130440.774578:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6dc expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130440.774623:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceb6dc expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130440.774682:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626887296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789130440.774713:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130440.774740:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130440.779332:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887296 00000100:00100000:2.0:1789130440.779349:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887296 00000100:00100000:2.0:1789130440.779426:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789130440.779438:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626887296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789130440.779465:0:43674:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789130440.779494:0:43674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789130440.779497:0:43674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 26 00000100:00100000:2.0:1789130440.779654:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626887296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130440.779662:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130440.779770:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626887296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789130440.779838:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130440.779848:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6dc expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130440.779859:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b383ce0800/0x5c74554e47ceb6d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceb6dc expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130440.841722:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789130441.349817:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130442.374711:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130442.503994:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626887424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130442.504098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130442.504386:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887424 00000100:00100000:3.0:1789130442.504394:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887424 00000100:00100000:3.0:1789130442.504468:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130442.504478:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626887424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130442.504513:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130442.504563:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626887424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130442.504569:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130442.504639:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626887424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789130442.504939:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130443.397723:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130444.430320:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789130445.068959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130445.068967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130445.068971:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789130445.068972:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626887680:0@lo:400:kworker.0 00000100:00080000:0.0:1789130445.068982:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b497ef8800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789130445.069022:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bfcd6580 x1876037626887808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130445.069062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130445.069095:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626887552:0@lo:400:kworker.0 00000100:00100000:0.0:1789130445.069137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130445.069144:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887680 00000100:00100000:1.0:1789130445.069151:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887680 00000100:00100000:0.0:1789130445.069169:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626888192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130445.069203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130445.069209:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130445.069222:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626887680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130445.069238:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626887808:0@lo:8:kworker.0 00000100:00100000:2.0:1789130445.070288:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887552 00000100:00100000:2.0:1789130445.070295:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887552 00000100:00100000:2.0:1789130445.070331:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130445.070339:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626887552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130445.072850:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626887680:12345-0@lo:400:kworker.0 Request processed in 3622us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130445.072866:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789130445.072908:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130445.072965:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626887680:0@lo:400:kworker.0 00000100:00100000:1.0:1789130445.073955:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888192 00000100:00100000:1.0:1789130445.073973:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888192 00000100:00100000:1.0:1789130445.074032:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130445.074045:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626888192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130445.074118:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626888192:12345-0@lo:400:kworker.0 Request processed in 78us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130445.074126:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789130445.074144:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789130445.074182:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b390ced680 x1876037626888192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130445.074195:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626888192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130445.075777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130445.076205:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887808 00000100:00100000:1.0:1789130445.076215:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887808 00000100:00100000:1.0:1789130445.076259:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130445.076267:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876037626887808:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789130445.076299:0:44365:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1608 last 0 00000020:00000080:1.0:1789130445.076340:0:44365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ceb6e3 00002000:00100000:1.0:1789130445.076354:0:44365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90b4a7a4c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789130445.076359:0:44365:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789130445.076362:0:44365:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789130445.077038:0:44365:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130445.077069:0:44365:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a48000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130445.077157:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626887808:12345-0@lo:8:kworker.0 Request processed in 888us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130445.077168:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130445.077225:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626887552:12345-0@lo:400:kworker.0 Request processed in 6884us (8084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130445.077236:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130445.077300:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626888064:0@lo:400:kworker.0 00000100:00100000:2.0:1789130445.077333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130445.077360:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130445.077367:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626887936:0@lo:400:kworker.0 00000100:00100000:2.0:1789130445.077388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130445.077687:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888064 00000100:00100000:2.0:1789130445.077694:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888064 00000100:00100000:2.0:1789130445.077747:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626887936 00000100:00100000:2.0:1789130445.077751:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626887936 00000100:00100000:2.0:1789130445.077763:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130445.077769:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130445.077809:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626888064:12345-0@lo:400:kworker.0 Request processed in 40us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130445.077815:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130445.077827:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130445.077833:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626887936:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789130445.077863:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130445.077870:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626887936:12345-0@lo:400:kworker.0 Request processed in 36us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130445.077877:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789130445.077900:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626887552:0@lo:400:kworker.0 00010000:00080000:2.0:1789130445.077912:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd6940 x1876037626887936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130445.077925:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626887936:0@lo:400:kworker.0 00010000:00080000:2.0:1789130445.077936:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b390cef840 x1876037626888064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130445.077945:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626888064:0@lo:400:kworker.0 00010000:00080000:0.0:1789130445.078131:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bfcd6580 x1876037626887808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130445.078145:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1789130445.078153:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789130445.078157:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789130445.078161:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b497ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789130445.078179:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789130445.078183:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626887808:0@lo:8:kworker.0 00000100:00100000:0.0:1789130445.078285:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626888320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130445.078314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789130445.078349:0:43704:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0xd0:0x0] 00000100:00100000:2.0:1789130445.078365:0:43704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:43704:1876037626888448:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789130445.078386:0:43704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130445.078397:0:43704:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130445.078925:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888320 00000100:00100000:0.0:1789130445.078931:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888320 00000100:00100000:0.0:1789130445.079020:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130445.079030:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626888320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130445.079060:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3767533568 avail 3765436416 00000004:00080000:1.0:1789130445.079069:0:43703:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789130445.079108:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626888320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130445.079115:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789130445.079148:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bae7b480 x1876037626888320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130445.079166:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626888320:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789130445.079373:0:43703:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1608176770348ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789130445.079409:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888448 00000100:00100000:1.0:1789130445.079414:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888448 00000100:00100000:1.0:1789130445.079441:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130445.079449:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:43704:x1876037626888448:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789130445.081216:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789130445.093658:0:44793:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789130445.093670:0:44793:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 225 -> diff = -17 00002000:02000040:1.0:1789130445.093676:0:44793:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:209 to 0x280000400:225) 00002000:00010000:1.0:1789130445.110567:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.110579:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110597:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe1:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.110627:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.110635:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110653:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110664:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110671:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110694:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.110706:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.110712:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110721:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.110726:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110735:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110751:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110758:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfd594af/0x5c74554e47ceb6ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.110777:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.110779:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.110781:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.111259:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.111266:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111276:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe0:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.111280:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.111285:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111294:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111304:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111312:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111329:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.111341:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.111345:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111352:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3da00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.111356:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111364:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111376:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111383:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dd8a90d/0x5c74554e47ceb6f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111398:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.111400:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.111402:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.111845:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.111852:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111861:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdf:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.111865:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.111869:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111878:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111885:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111891:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111907:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.111915:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.111918:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111926:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3c000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.111929:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111943:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111953:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111960:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5db899e/0x5c74554e47ceb6f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.111973:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.111975:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.111977:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.118581:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.118594:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118630:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xde:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.118636:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.118642:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118658:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118668:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118676:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118697:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.118709:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.118714:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118722:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3de00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.118726:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118735:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118752:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118759:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ac74ebc/0x5c74554e47ceb6ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.118780:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.118782:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.118783:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.119809:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.119821:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119833:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdd:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.119837:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.119842:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119854:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119863:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119871:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119888:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.119899:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.119903:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119911:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.119915:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119924:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119937:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119944:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f65291cd/0x5c74554e47ceb706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.119960:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.119962:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.119963:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.120382:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.120388:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120397:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdc:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.120400:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.120405:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120414:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120422:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120429:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120450:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.120460:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.120463:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120470:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.120473:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120481:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120490:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120498:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59e9858/0x5c74554e47ceb70d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120511:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.120512:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.120514:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.120955:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.120961:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120969:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdb:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.120973:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xdb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.120978:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120988:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.120995:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.121003:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.123653:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130445.124069:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130445.124077:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130445.124090:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3d000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130445.124095:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130445.124106:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130445.124134:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130445.124142:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dfc2f0/0x5c74554e47ceb714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130445.124169:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130445.124171:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130445.124173:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.124677:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.124685:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124696:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xda:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.124701:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xda:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.124708:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124719:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124727:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124735:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124751:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.124761:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.124765:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124772:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ec00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.124776:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124784:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124795:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124803:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065f9e2ac/0x5c74554e47ceb71b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.124816:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.124818:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.124819:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.126411:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.126424:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126439:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd9:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.126443:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.126449:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126460:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126470:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126478:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126498:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130445.126900:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.126906:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126913:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd8:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.126916:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.126919:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126928:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126936:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126942:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.126955:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130445.128660:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130445.128673:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128685:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.128691:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128701:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128721:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128728:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002108c322/0x5c74554e47ceb722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128754:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.128760:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128768:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.128771:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128778:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128787:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128793:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004db8446e/0x5c74554e47ceb729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.128804:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.128805:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.128807:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.129526:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.129535:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.129546:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd7:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.129551:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.129557:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.129573:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.129582:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.129589:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.129695:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130445.131488:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.131501:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.131515:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd6:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.131520:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.131527:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.131539:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.131549:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.131563:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134456:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130445.134470:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134483:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130445.134488:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134499:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134527:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134534:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c1df446/0x5c74554e47ceb730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134570:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130445.134574:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134580:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130445.134583:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134590:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134615:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130445.134624:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130445.134626:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130445.134628:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130445.134956:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.135379:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789130445.135389:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009add0e9e/0x5c74554e47ceb737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.135417:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.136582:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.136593:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136631:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd5:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.136637:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.136644:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136659:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136669:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136677:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136705:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.136716:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.136721:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136728:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.136732:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136742:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136757:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136765:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47ceb73e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.136779:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.136781:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.136783:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.137202:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.137207:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137216:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd4:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.137220:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.137224:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137234:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137242:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137248:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137262:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.137270:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.137274:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137282:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.137285:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137293:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137304:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137317:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ceb745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137328:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.137330:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.137331:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.137742:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.137748:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137756:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd3:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.137759:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.137763:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137772:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137780:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137787:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137801:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.137810:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.137813:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137820:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.137823:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137830:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137840:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137847:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47ceb74c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.137859:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.137861:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.137862:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.138230:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.138236:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138244:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd2:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.138246:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.138250:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138262:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138269:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138275:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138287:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.138294:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.138298:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138304:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.138307:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138313:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138323:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138329:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2cdfc0/0x5c74554e47ceb753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138341:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.138343:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.138344:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130445.138726:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130445.138733:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138741:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd1:0x0].0x0 since=1608s v=(0 0) 00010000:00010000:1.0:1789130445.138744:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130445.138748:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138757:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138765:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138772:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138785:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130445.138793:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130445.138796:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138809:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130445.138812:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138820:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138830:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138837:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff6ff500/0x5c74554e47ceb75a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130445.138849:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.138850:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130445.138852:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789130445.138999:0:44793:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:208 00000004:00080000:0.0:1789130445.143737:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789130445.144257:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:43704:x1876037626888448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64803us (65864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130445.144269:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130445.146451:0:43704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:43704:1876037626888448:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789130445.146471:0:43704:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xe1:0x0] from OST, last_created [0x280000400:0xe1:0x0]last_used is [0x280000400:0xd0:0x0] 00000100:00100000:2.0:1789130445.146516:0:43704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:43704:1876037626888576:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789130445.146563:0:43704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130445.146594:0:43704:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130445.146674:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888576 00000100:00100000:1.0:1789130445.146680:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888576 00000100:00100000:1.0:1789130445.146725:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130445.146733:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:43704:x1876037626888576:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789130445.146778:0:44365:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 226 00000100:00100000:2.0:1789130445.164749:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:43704:x1876037626888576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18009us (18178us total) trans 34359738369 rc 0/0 00000100:00100000:2.0:1789130445.164762:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130445.165053:0:43704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:43704:1876037626888576:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789130445.165070:0:43704:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xe1:0x0]-[0x280000400:0x101:0x0] 00010000:00010000:1.0:1789130445.446143:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130446.158062:0:45440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789130446.471364:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130447.509376:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130447.626138:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626888704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130447.626216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130447.626345:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888704 00000100:00100000:1.0:1789130447.626353:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888704 00000100:00100000:1.0:1789130447.626414:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130447.626425:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626888704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130447.626459:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130447.626505:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626888704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130447.626513:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789130447.626758:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130447.626798:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626888704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130448.518328:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130448.537562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.537628:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114240 00000100:00100000:3.0:1789130448.537636:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114240 00000100:00100000:3.0:1789130448.537676:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130448.537684:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2366:x1876037605114240:12345-192.168.201.39@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789130448.537713:0:43671:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 39c6b468-e11e-4c24-bf56-0ab5301cc278@192.168.201.39@tcp t0 exp 0000000000000000 cur 1611 last 0 00000020:00000080:3.0:1789130448.537743:0:43671:0:(genops.c:1385:class_connect()) connect: client 39c6b468-e11e-4c24-bf56-0ab5301cc278, cookie 0x5c74554e47ceb761 00000100:00080000:3.0:1789130448.537877:0:43671:0:(import.c:65:import_set_state_nolock()) ffff90b38686b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130448.537960:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+5:2366:x1876037605114240:12345-192.168.201.39@tcp:250:mount.lustre.0 Request processed in 265us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130448.537968:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1789130448.558175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130448.558259:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114368 00000100:00100000:0.0:1789130448.558270:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114368 00000100:00100000:0.0:1789130448.558335:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789130448.558344:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+5:44595:x1876037605114368:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789130448.558362:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130448.558379:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b3873f3a00/0x5c74554e47ceb768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac57e expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.558408:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f3a00/0x5c74554e47ceb768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac57e expref: 6 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.558419:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b3873f3a00/0x5c74554e47ceb768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac57e expref: 6 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.558429:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3a00, rc 0) 00000100:00100000:0.0:1789130448.558566:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+6:44595:x1876037605114368:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 221us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.558573:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789130448.570522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.571492:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114496 00000100:00100000:1.0:1789130448.571504:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114496 00000100:00100000:1.0:1789130448.571567:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1789130448.571586:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+6:44595:x1876037605114496:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789130448.571884:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+6:44595:x1876037605114496:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 307us (1432us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130448.571892:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1789130448.574046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130448.574111:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114624 00000100:00100000:0.0:1789130448.574120:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114624 00000100:00100000:0.0:1789130448.574169:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130448.574179:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+6:44595:x1876037605114624:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789130448.574194:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130448.574211:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b3873f2000/0x5c74554e47ceb76f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac585 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.574251:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f2000/0x5c74554e47ceb76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac585 expref: 7 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.574262:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b3873f2000/0x5c74554e47ceb76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac585 expref: 7 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130448.574272:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2000, rc 0) 00000100:00100000:0.0:1789130448.574331:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+7:44595:x1876037605114624:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 153us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.574338:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1789130448.588516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.588653:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114752 00000100:00100000:3.0:1789130448.588663:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114752 00000100:00100000:3.0:1789130448.588712:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130448.588722:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+7:44595:x1876037605114752:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130448.589078:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44595:x1876037605114752:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 356us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130448.589086:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130448.606314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.606396:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605114880 00000100:00100000:1.0:1789130448.606406:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605114880 00000100:00100000:1.0:1789130448.606462:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:1.0:1789130448.606472:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44595:x1876037605114880:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789130448.606745:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44595:x1876037605114880:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 272us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.606756:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130448.611380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130448.611637:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115008 00000100:00100000:2.0:1789130448.611647:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115008 00000100:00100000:2.0:1789130448.611715:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130448.611724:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44614:x1876037605115008:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130448.612269:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44614:x1876037605115008:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 544us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130448.612278:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130448.660758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.660958:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115136 00000100:00100000:3.0:1789130448.660968:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115136 00000100:00100000:3.0:1789130448.661028:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130448.661039:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44614:x1876037605115136:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130448.661388:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44614:x1876037605115136:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 279us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130448.661397:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1789130448.670033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130448.671549:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115264 00000100:00100000:2.0:1789130448.671564:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115264 00000100:00100000:2.0:1789130448.671674:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130448.671694:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+8:44595:x1876037605115264:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789130448.671713:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130448.671731:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b383ce1c00/0x5c74554e47ceb776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac5af expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130448.671759:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b383ce1c00/0x5c74554e47ceb776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5af expref: 9 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130448.671769:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b383ce1c00/0x5c74554e47ceb776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5af expref: 9 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130448.671778:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1c00, rc 0) 00000100:00100000:2.0:1789130448.671852:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+9:44595:x1876037605115264:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 168us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130448.671860:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:0.0:1789130448.687662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.687744:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115392 00000100:00100000:3.0:1789130448.687755:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115392 00000100:00100000:0.0:1789130448.687870:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789130448.687883:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+9:44595:x1876037605115392:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789130448.687921:0:43671:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789130448.687974:0:43671:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789130448.687980:0:43671:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789130448.687983:0:43671:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789130448.687985:0:43671:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 26 00000100:00100000:0.0:1789130448.690485:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+9:44595:x1876037605115392:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 2595us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.690499:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130448.704267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.704420:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115520 00000100:00100000:1.0:1789130448.704431:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115520 00000100:00100000:1.0:1789130448.704489:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130448.704500:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+9:44595:x1876037605115520:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130448.704517:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130448.704534:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac5b6 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130448.704562:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 10 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130448.704573:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 10 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130448.704582:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130448.704686:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44595:x1876037605115520:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 177us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.704693:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130448.706696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130448.706777:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115648 00000100:00100000:0.0:1789130448.706785:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115648 00000100:00100000:0.0:1789130448.706834:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130448.706843:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44595:x1876037605115648:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789130448.707136:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44595:x1876037605115648:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 293us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.707144:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130448.710246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130448.713491:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115776 00000100:00100000:2.0:1789130448.713508:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115776 00000100:00100000:2.0:1789130448.713639:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130448.713652:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44595:x1876037605115776:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130448.713929:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44595:x1876037605115776:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 279us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130448.713937:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789130448.720240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.720332:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605115904 00000100:00100000:1.0:1789130448.720341:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605115904 00000100:00100000:1.0:1789130448.720391:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130448.720400:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44618:x1876037605115904:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130448.720700:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44618:x1876037605115904:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 300us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.720708:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789130448.724708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130448.724814:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116032 00000100:00100000:2.0:1789130448.724825:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116032 00000100:00100000:2.0:1789130448.724882:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130448.724893:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44618:x1876037605116032:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130448.725174:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44618:x1876037605116032:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130448.725183:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130448.747320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.747466:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116160 00000100:00100000:1.0:1789130448.747475:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116160 00000100:00100000:1.0:1789130448.747527:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789130448.747536:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2366:x1876037605116160:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789130448.747565:0:43680:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp t0 exp 0000000000000000 cur 1611 last 0 00000020:00000080:1.0:1789130448.747654:0:43680:0:(genops.c:1385:class_connect()) connect: client 6f164769-cccd-48c1-b7fa-967be7565442, cookie 0x5c74554e47ceb784 00000004:00100000:1.0:1789130448.747686:0:43680:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:1.0:1789130448.747691:0:43680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738368 00000100:00080000:3.0:1789130448.870537:0:43680:0:(import.c:65:import_set_state_nolock()) ffff90b38686f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130448.871190:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2366:x1876037605116160:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 123651us (123885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130448.871201:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130448.875912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.875965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.876050:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116288 00000100:00100000:1.0:1789130448.876060:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116288 00000100:00100000:1.0:1789130448.876135:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116416 00000100:00100000:1.0:1789130448.876139:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116416 00000100:00100000:1.0:1789130448.876156:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130448.876165:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:0:x1876037605116288:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130448.876212:0:43681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130448.876302:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:0:x1876037605116288:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 137us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.876309:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130448.876325:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130448.876331:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116416:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130448.876342:0:43681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789130448.876364:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116416:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.876370:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00080000:3.0:1789130448.877636:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130448.880815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130448.880919:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116544 00000100:00100000:1.0:1789130448.880929:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116544 00000100:00100000:1.0:1789130448.881002:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1789130448.881013:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116544:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789130448.881128:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116544:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130448.881136:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130448.895099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.895147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130448.895181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130448.895463:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116672 00000100:00100000:0.0:1789130448.895474:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116672 00000100:00100000:0.0:1789130448.895511:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116800 00000100:00100000:0.0:1789130448.895514:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116800 00000100:00100000:0.0:1789130448.895533:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130448.895553:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1876037605116672:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789130448.895592:0:44793:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp t0 exp 0000000000000000 cur 1611 last 0 00000020:00000080:0.0:1789130448.895657:0:44793:0:(genops.c:1385:class_connect()) connect: client 6f164769-cccd-48c1-b7fa-967be7565442, cookie 0x5c74554e47ceb78b 00002000:00100000:0.0:1789130448.895670:0:44793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6f164769-cccd-48c1-b7fa-967be7565442/ffff90b388f30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789130448.895680:0:44793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789130448.896021:0:44793:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789130448.896052:0:44793:0:(import.c:65:import_set_state_nolock()) ffff90b388f35800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130448.896115:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2366:x1876037605116672:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 573us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.896123:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130448.896141:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789130448.896146:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1876037605116800:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789130448.896173:0:44793:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp t0 exp 0000000000000000 cur 1611 last 0 00000020:00000080:0.0:1789130448.896189:0:44793:0:(genops.c:1385:class_connect()) connect: client 6f164769-cccd-48c1-b7fa-967be7565442, cookie 0x5c74554e47ceb792 00002000:00100000:0.0:1789130448.896196:0:44793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6f164769-cccd-48c1-b7fa-967be7565442/ffff90b388f34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789130448.896213:0:44793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789130448.896323:0:44793:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789130448.896337:0:44793:0:(import.c:65:import_set_state_nolock()) ffff90b388f31000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130448.896360:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2366:x1876037605116800:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 213us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.896366:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130448.897258:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605116928 00000100:00100000:2.0:1789130448.897268:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605116928 00000100:00100000:2.0:1789130448.897313:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130448.897322:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116928:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789130448.901282:0:43682:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3898us 00000004:00200000:0.0:1789130448.952536:0:43682:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:0.0:1789130448.952772:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:44595:x1876037605116928:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 55444us (57617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130448.952788:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789130449.199460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130449.199569:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117056 00000100:00100000:2.0:1789130449.199579:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117056 00000100:00100000:2.0:1789130449.199670:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789130449.199688:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:44640:x1876037605117056:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:2.0:1789130449.199712:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130449.199738:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac5e0 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.199804:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.199818:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.199831:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130449.200045:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130449.200050:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130449.200129:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.200156:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5e0 expref: 8 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.200172:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5e0 expref: 7 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130449.200181:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130449.200184:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130449.200187:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:2.0:1789130449.200256:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:44640:x1876037605117056:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 569us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130449.200262:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:2.0:1789130449.543842:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130450.054741:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789130450.182162:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626888832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130450.182239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130450.182330:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888832 00000100:00100000:1.0:1789130450.182339:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888832 00000100:00100000:3.0:1789130450.182416:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130450.182426:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130450.182430:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626888960:0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.182440:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626888832:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789130450.182458:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789130450.182483:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130450.182490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130450.182509:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130450.182521:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626889088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.182555:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626888832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130450.182565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130450.182631:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626889472:0@lo:400:kworker.0 00000100:00100000:3.0:1789130450.182649:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626889216:0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.182669:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130450.182678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130450.182707:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889088 00000100:00100000:3.0:1789130450.182713:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889088 00000100:00100000:2.0:1789130450.182728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130450.182760:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130450.182763:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130450.182771:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626889088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130450.182772:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626889344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130450.182817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130450.182824:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626888832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130450.182837:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626889088:12345-0@lo:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130450.182847:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789130450.182865:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130450.182873:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889472 00000100:00100000:1.0:1789130450.182878:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889472 00000100:00100000:2.0:1789130450.182891:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626889088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.182914:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889216 00000100:00080000:3.0:1789130450.182927:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130450.182927:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889216 00000100:00100000:1.0:1789130450.182945:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889344 00000100:00100000:1.0:1789130450.182948:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889344 00000100:00100000:3.0:1789130450.182957:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130450.182969:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.182985:0:43681:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789130450.182994:0:43681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789130450.183013:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626889472:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130450.183022:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130450.183037:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130450.183045:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626889216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.183115:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789130450.183123:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130450.183157:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626889344:12345-0@lo:400:kworker.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130450.183164:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789130450.183178:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130450.183202:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626889344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130450.183213:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626889216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130450.183238:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626889472:0@lo:400:kworker.0 00000100:00100000:3.0:1789130450.183572:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626889216:12345-0@lo:400:kworker.0 Request processed in 37us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130450.183591:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130450.184184:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626888960 00000100:00100000:2.0:1789130450.184191:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626888960 00000100:00100000:2.0:1789130450.184227:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130450.184235:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626888960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130450.184434:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626888960:0@lo:400:kworker.0 00000100:00100000:2.0:1789130450.185715:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626888960:12345-0@lo:400:kworker.0 Request processed in 1475us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130450.185729:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000001:00100000:0.0:1789130450.262634:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f164769-cccd-48c1-b7fa-967be7565442 00000001:00080000:0.0:1789130450.262656:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738369 is committed 00000001:00100000:0.0:1789130450.262697:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789130450.566538:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130451.313373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.314352:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117184 00000100:00100000:2.0:1789130451.314370:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117184 00000100:00100000:2.0:1789130451.314552:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789130451.314565:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:44692:x1876037605117184:12345-192.168.201.39@tcp:41:lfs.0 00000004:00000024:2.0:1789130451.314646:0:43681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789130451.314786:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:44692:x1876037605117184:12345-192.168.201.39@tcp:41:lfs.0 Request processed in 223us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130451.314807:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:3.0:1789130451.319736:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130451.320408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.320664:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117312 00000100:00100000:1.0:1789130451.320677:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117312 00000100:00100000:1.0:1789130451.320831:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130451.320845:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f164769-cccd-48c1-b7fa-967be7565442+6:44692:x1876037605117312:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:1.0:1789130451.321104:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130451.321273:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f164769-cccd-48c1-b7fa-967be7565442+6:44692:x1876037605117312:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 430us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.321283:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00080000:3.0:1789130451.324708:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130451.324997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.325190:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117440 00000100:00100000:0.0:1789130451.325205:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117440 00000100:00100000:0.0:1789130451.325330:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1789130451.325343:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f164769-cccd-48c1-b7fa-967be7565442+5:44692:x1876037605117440:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:0.0:1789130451.325381:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130451.325499:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f164769-cccd-48c1-b7fa-967be7565442+5:44692:x1876037605117440:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 157us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.325508:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00080000:3.0:1789130451.329892:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130451.523173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.523313:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117568 00000100:00100000:1.0:1789130451.523327:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117568 00000100:00100000:1.0:1789130451.523457:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130451.523471:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+10:44727:x1876037605117568:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130451.523495:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130451.523519:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3ec00/0x5c74554e47ceb7a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac5e7 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.523568:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3ec00/0x5c74554e47ceb7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5e7 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.523582:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3ec00/0x5c74554e47ceb7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5e7 expref: 11 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.523594:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ec00, rc 0) 00000100:00100000:1.0:1789130451.523737:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605117568:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 269us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.523745:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130451.541344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.541566:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117696 00000100:00100000:0.0:1789130451.541581:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117696 00000100:00100000:0.0:1789130451.541720:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130451.541733:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605117696:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789130451.542184:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605117696:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 451us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.542194:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789130451.548572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.549200:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117824 00000100:00100000:1.0:1789130451.549215:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117824 00000100:00100000:1.0:1789130451.549295:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1789130451.549308:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605117824:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789130451.551086:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605117824:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 399us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.551110:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1789130451.566021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.566135:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605117952 00000100:00100000:2.0:1789130451.566148:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605117952 00000100:00100000:2.0:1789130451.566214:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789130451.566224:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44732:x1876037605117952:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130451.569298:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44732:x1876037605117952:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 3063us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130451.569312:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00010000:00010000:2.0:1789130451.590096:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130451.604790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.610834:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118080 00000100:00100000:0.0:1789130451.610862:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118080 00000100:00100000:0.0:1789130451.611171:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789130451.611184:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44732:x1876037605118080:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130451.611598:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44732:x1876037605118080:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 416us (6824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.611625:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130451.620269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.620536:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118208 00000100:00100000:1.0:1789130451.620552:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118208 00000100:00100000:1.0:1789130451.620651:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130451.620664:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44727:x1876037605118208:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130451.620808:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130451.620836:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3fa00/0x5c74554e47ceb7ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac611 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.620885:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3fa00/0x5c74554e47ceb7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac611 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.621007:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3fa00/0x5c74554e47ceb7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac611 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.621020:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fa00, rc 0) 00000100:00100000:1.0:1789130451.621163:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44727:x1876037605118208:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 500us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.621169:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130451.624459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.624588:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118336 00000100:00100000:2.0:1789130451.624643:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118336 00000100:00100000:2.0:1789130451.624708:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130451.624721:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44727:x1876037605118336:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789130451.624760:0:43674:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789130451.624798:0:43674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789130451.624803:0:43674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789130451.624807:0:43674:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789130451.624809:0:43674:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 26 00000100:00100000:3.0:1789130451.627459:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44727:x1876037605118336:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 2725us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130451.627477:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130451.635951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.636101:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118464 00000100:00100000:1.0:1789130451.636114:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118464 00000100:00100000:1.0:1789130451.636190:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789130451.636204:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44727:x1876037605118464:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130451.636228:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130451.636256:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac618 expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.636296:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 13 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.636312:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 13 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130451.636324:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f800, rc 0) 00000100:00100000:1.0:1789130451.636445:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44727:x1876037605118464:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 243us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.636453:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789130451.639175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130451.639293:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118592 00000100:00100000:3.0:1789130451.639307:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118592 00000100:00100000:3.0:1789130451.639432:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130451.639445:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44727:x1876037605118592:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130451.640040:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44727:x1876037605118592:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 595us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130451.640050:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130451.642278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.642403:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118720 00000100:00100000:1.0:1789130451.642416:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118720 00000100:00100000:1.0:1789130451.642537:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:1.0:1789130451.642550:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44727:x1876037605118720:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789130451.642903:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44727:x1876037605118720:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 344us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.642913:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789130451.646347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130451.646486:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118848 00000100:00100000:3.0:1789130451.646499:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118848 00000100:00100000:3.0:1789130451.647636:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130451.647657:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44737:x1876037605118848:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130451.648044:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44737:x1876037605118848:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 394us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130451.648055:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:2.0:1789130451.652053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130451.652293:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605118976 00000100:00100000:1.0:1789130451.652308:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605118976 00000100:00100000:1.0:1789130451.652392:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130451.652404:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44737:x1876037605118976:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130451.653432:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44737:x1876037605118976:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1022us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.653447:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789130451.660781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.660970:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119232 00000100:00100000:0.0:1789130451.660983:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119232 00000100:00100000:0.0:1789130451.661062:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130451.661085:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605119232:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130451.661200:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605119232:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.661209:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130451.662121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.662180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.662256:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119360 00000100:00100000:0.0:1789130451.662266:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119360 00000100:00100000:0.0:1789130451.662316:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119488 00000100:00100000:0.0:1789130451.662320:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119488 00000100:00100000:0.0:1789130451.662353:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789130451.662363:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605119360:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130451.662430:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605119360:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.662439:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789130451.662454:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789130451.662462:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605119488:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130451.662487:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605119488:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.662494:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130451.664815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.665023:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119104 00000100:00100000:2.0:1789130451.665035:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119104 00000100:00100000:2.0:1789130451.665093:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130451.665103:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2366:x1876037605119104:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789130451.665144:0:43681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp t0 exp 0000000000000000 cur 1614 last 0 00000020:00000080:2.0:1789130451.665191:0:43681:0:(genops.c:1385:class_connect()) connect: client ab440178-5f2c-43fa-b0e2-24b6c08464d6, cookie 0x5c74554e47ceb7bc 00000004:00100000:2.0:1789130451.665236:0:43681:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789130451.665410:0:43681:0:(import.c:65:import_set_state_nolock()) ffff90b4856be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130451.665500:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2366:x1876037605119104:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 397us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130451.665508:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789130451.668432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.668658:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119616 00000100:00100000:2.0:1789130451.668673:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119616 00000100:00100000:2.0:1789130451.668766:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130451.668779:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:0:x1876037605119616:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789130451.668825:0:43680:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789130451.668993:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:0:x1876037605119616:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 215us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130451.669002:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00080000:3.0:1789130451.669135:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130451.671206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.672137:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119744 00000100:00100000:2.0:1789130451.672155:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119744 00000100:00100000:2.0:1789130451.672233:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130451.672246:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605119744:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789130451.672288:0:43681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789130451.675274:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605119744:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 3010us (4061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130451.675296:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130451.682397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130451.682551:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605119872 00000100:00100000:3.0:1789130451.682566:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605119872 00000100:00100000:3.0:1789130451.682688:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789130451.682703:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605119872:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789130451.683733:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605119872:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 1022us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130451.683746:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130451.695146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.695192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130451.695233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.695335:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120000 00000100:00100000:0.0:1789130451.695349:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120000 00000100:00100000:0.0:1789130451.695400:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120128 00000100:00100000:0.0:1789130451.695403:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120128 00000100:00100000:0.0:1789130451.695436:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789130451.695447:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037605120000:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789130451.695499:0:44365:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp t0 exp 0000000000000000 cur 1614 last 0 00000020:00000080:0.0:1789130451.695870:0:44365:0:(genops.c:1385:class_connect()) connect: client ab440178-5f2c-43fa-b0e2-24b6c08464d6, cookie 0x5c74554e47ceb7c3 00002000:00100000:0.0:1789130451.695889:0:44365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab440178-5f2c-43fa-b0e2-24b6c08464d6/ffff90b489cb6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789130451.695913:0:44365:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1789130451.696036:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130451.696044:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1876037605120128:12345-192.168.201.39@tcp:8:mount.lustre.0 00002000:00080000:0.0:1789130451.696056:0:44365:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:1.0:1789130451.696063:0:44793:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp t0 exp 0000000000000000 cur 1614 last 0 00000020:00000080:1.0:1789130451.696083:0:44793:0:(genops.c:1385:class_connect()) connect: client ab440178-5f2c-43fa-b0e2-24b6c08464d6, cookie 0x5c74554e47ceb7ca 00002000:00100000:1.0:1789130451.696088:0:44793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ab440178-5f2c-43fa-b0e2-24b6c08464d6/ffff90b48574a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130451.696095:0:44793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789130451.696098:0:44365:0:(import.c:65:import_set_state_nolock()) ffff90b489cb1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130451.696185:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2366:x1876037605120000:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 738us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.696195:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00002000:00080000:1.0:1789130451.696225:0:44793:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130451.696240:0:44793:0:(import.c:65:import_set_state_nolock()) ffff90b48574d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130451.696263:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2366:x1876037605120128:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 218us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130451.696269:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789130451.704947:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120256 00000100:00100000:3.0:1789130451.704975:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120256 00000100:00100000:3.0:1789130451.705165:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789130451.705178:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605120256:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789130451.705481:0:43683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:3.0:1789130451.706067:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44727:x1876037605120256:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 887us (10828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130451.706077:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789130451.884921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130451.885093:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120384 00000100:00100000:0.0:1789130451.885107:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120384 00000100:00100000:0.0:1789130451.885192:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1789130451.885205:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:44759:x1876037605120384:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789130451.885233:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130451.885265:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac642 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885352:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885370:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885387:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130451.885738:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130451.885743:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130451.885834:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885898:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 8 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885924:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 7 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130451.885936:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130451.885939:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130451.885944:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130451.886042:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:44759:x1876037605120384:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 838us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130451.886050:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:0.0:1789130452.615939:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130452.745972:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626889600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130452.746063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130452.746204:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889600 00000100:00100000:1.0:1789130452.746212:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889600 00000100:00100000:1.0:1789130452.746369:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130452.746380:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626889600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130452.746532:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130452.746588:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626889600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130452.746694:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130452.746778:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626889600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789130452.746931:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789130453.637804:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789130453.855527:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000001:00100000:2.0:1789130453.855547:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f164769-cccd-48c1-b7fa-967be7565442 00000001:00100000:2.0:1789130453.862349:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000001:00100000:0.0:1789130453.862705:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f164769-cccd-48c1-b7fa-967be7565442 00010000:00010000:0.0:1789130454.661820:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130455.307077:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626889856:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307157:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307202:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626890368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307248:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130455.307253:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626889728:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626890240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626889984:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307369:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130455.307373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626890112:0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130455.307417:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889856 00000100:00100000:2.0:1789130455.307423:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889856 00000100:00100000:2.0:1789130455.307471:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889984 00000100:00100000:2.0:1789130455.307473:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889984 00000100:00100000:2.0:1789130455.307493:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130455.307502:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626889856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307547:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626889856:12345-0@lo:400:kworker.0 Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.307554:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130455.307572:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130455.307578:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626889984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307624:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626889984:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.307631:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130455.307648:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626890368 00000100:00100000:2.0:1789130455.307651:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626890368 00000100:00100000:2.0:1789130455.307672:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626890240 00000100:00100000:2.0:1789130455.307674:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626890240 00000100:00100000:2.0:1789130455.307684:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626890112 00000100:00100000:2.0:1789130455.307686:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626890112 00000100:00100000:2.0:1789130455.307696:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130455.307702:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626890368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307728:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626890368:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.307734:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130455.307744:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789130455.307749:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626890240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.307769:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626890240:12345-0@lo:400:kworker.0 Request processed in 20us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.307774:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789130455.307967:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130455.307974:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626890112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.308001:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626890112:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.308006:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130455.308023:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626889728 00000100:00100000:2.0:1789130455.308026:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626889728 00000100:00100000:2.0:1789130455.308085:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130455.308092:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626889728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130455.308126:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626889728:12345-0@lo:400:kworker.0 Request processed in 36us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130455.308132:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130455.312295:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130455.312318:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626890496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130455.312385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130455.312432:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626890496 00000100:00100000:3.0:1789130455.312439:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626890496 00000100:00100000:3.0:1789130455.312480:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130455.312489:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626890496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130455.312522:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130455.312561:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626890496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130455.312568:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130455.312616:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738369 gen 2 00000100:00100000:3.0:1789130455.312637:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626890496:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130455.313685:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130455.313692:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130455.313694:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130455.317379:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626889728:0@lo:400:kworker.0 00000100:00100000:0.0:1789130455.317406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626890240:0@lo:400:kworker.0 00000100:00100000:0.0:1789130455.317424:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626889856:0@lo:400:kworker.0 00000100:00100000:0.0:1789130455.317438:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626890368:0@lo:400:kworker.0 00000100:00100000:3.0:1789130455.317678:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626890112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130455.317708:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626889984:0@lo:400:kworker.0 00000001:00100000:0.0:1789130455.427870:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000001:02000400:3.0:1789130455.493292:0:45645:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789130455.690714:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130456.713137:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130457.121019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130457.121068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130457.121103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130457.121128:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120512 00000100:00100000:1.0:1789130457.121138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130457.121139:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120512 00000100:00100000:1.0:1789130457.121159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130457.121179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130457.121193:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1789130457.121208:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605120512:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.121238:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121024 00000100:00100000:0.0:1789130457.121242:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121024 00000100:00100000:3.0:1789130457.121275:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605120512:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.121276:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120640 00000100:00100000:0.0:1789130457.121279:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120640 00000100:00100000:3.0:1789130457.121283:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:0.0:1789130457.121298:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130457.121304:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605121024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130457.121349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130457.121386:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605121024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.121393:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130457.121406:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130457.121413:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605120640:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.121435:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605120640:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.121442:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130457.129953:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120768 00000100:00100000:2.0:1789130457.129969:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120768 00000100:00100000:0.0:1789130457.133026:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121280 00000100:00100000:0.0:1789130457.133041:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121280 00000100:00100000:0.0:1789130457.133096:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605120896 00000100:00100000:0.0:1789130457.133099:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605120896 00000100:00100000:0.0:1789130457.133113:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121152 00000100:00100000:0.0:1789130457.133116:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121152 00000100:00100000:0.0:1789130457.133138:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1789130457.133149:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605120768:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.133225:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605120768:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (12156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.133231:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1789130457.133251:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:0.0:1789130457.133257:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605121280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.133276:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605121280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (12138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.133282:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:0.0:1789130457.133293:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130457.133298:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605120896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.133315:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605120896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 18us (12136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.133320:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130457.133328:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789130457.133333:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605121152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130457.133358:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605121152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (12009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130457.133363:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00080000:3.0:1789130457.138274:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130457.138285:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130457.138289:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130457.735240:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130457.887315:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626890624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130457.887394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130457.887475:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626890624 00000100:00100000:3.0:1789130457.887484:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626890624 00000100:00100000:3.0:1789130457.887543:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130457.887552:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626890624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130457.887598:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130457.887664:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626890624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130457.887672:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789130457.887693:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130457.887732:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626890624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130458.758520:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789130459.373922:0:45793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde85aa2f0 20000000:00000080:0.0:1789130459.373950:0:45793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b390cb9400 uarg=0000000000000000 20000000:01000000:0.0:1789130459.374010:0:45793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789130459.374018:0:45793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789130459.374025:0:45793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789130459.375690:0:45794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789130459.376047:0:45793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789130459.376070:0:45793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789130459.376103:0:45793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376128:0:45793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 18 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376138:0:45793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 18 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376145:0:45793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376155:0:45793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376162:0:45793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376169:0:45793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376227:0:45793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376247:0:45793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 12 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.376266:0:45793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626890752:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130459.376417:0:45793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 12 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376426:0:45793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 12 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.376435:0:45793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626890880:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130459.376469:0:45793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.376478:0:45793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 18 pid: 43671 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.376488:0:45793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891008:0@lo:104: 00000100:00100000:0.0:1789130459.376543:0:45793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130459.376596:0:45793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 18 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130459.376903:0:43663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891008 00000100:00100000:3.0:1789130459.376915:0:43663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891008 00000100:00100000:3.0:1789130459.376988:0:43663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130459.377000:0:43663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891008:12345-0@lo:104: 00010000:00010000:3.0:1789130459.377020:0:43663:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.377336:0:43663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130459.377344:0:43663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891008:12345-0@lo:104: Request processed in 347us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130459.377352:0:43663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789130459.377418:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130459.377427:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.377436:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c3dc00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130459.377441:0:43668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.377451:0:43668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130459.377461:0:43668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130459.377467:0:43668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130459.377517:0:43668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.377524:0:43668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130459.377551:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.377559:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b390c3dc00/0x5c74554e47ceb69d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb6a4 expref: -99 pid: 45084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.377575:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130459.377577:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130459.377578:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130459.377594:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626891264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130459.377657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130459.377783:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891264 00000100:00100000:2.0:1789130459.377789:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891264 00010000:00010000:2.0:1789130459.377815:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 19 pid: 43671 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130459.377839:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130459.377846:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626891264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130459.377858:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130459.377864:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 19 pid: 43671 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.378082:0:45793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 19 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.378099:0:45793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891136:0@lo:104: 00000100:00100000:0.0:1789130459.378239:0:45793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130459.379031:0:43662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891136 00000100:00100000:3.0:1789130459.379041:0:43662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891136 00000100:00100000:3.0:1789130459.379096:0:43662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130459.379107:0:43662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891136:12345-0@lo:104: 00010000:00010000:3.0:1789130459.379124:0:43662:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379195:0:43662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130459.379201:0:43662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891136:12345-0@lo:104: Request processed in 97us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130459.379210:0:43662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789130459.379232:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130459.379239:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379248:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789130459.379254:0:43667:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379262:0:43667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130459.379270:0:43667:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130459.379277:0:43667:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789130459.379314:0:43667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379321:0:43667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130459.379344:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379458:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b383ce0000/0x5c74554e47ceb5af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb5b6 expref: -99 pid: 44363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.379484:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130459.379486:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130459.379488:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130459.379511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626891392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130459.379551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130459.379633:0:43665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789130459.379646:0:43665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789130459.379803:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891392 00000100:00100000:3.0:1789130459.379808:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891392 00010000:00010000:3.0:1789130459.379829:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 20 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130459.379851:0:43665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789130459.379860:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130459.379867:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+20:3307:x1876037626891392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130459.379879:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130459.379884:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 20 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.381628:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 20 pid: 43671 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.381675:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130459.381815:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+20:3306:x1876037626891264:12345-0@lo:103:ldlm_bl.0 Request processed in 3968us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130459.381828:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130459.381926:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626891264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130459.382532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130459.382656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130459.382680:0:43666:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789130459.382694:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121408 00000100:00100000:2.0:1789130459.382705:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121408 00010000:00010000:2.0:1789130459.382744:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 13 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130459.382779:0:43666:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789130459.382786:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121536 00000100:00100000:2.0:1789130459.382799:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121536 00010000:00010000:2.0:1789130459.382812:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 14 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130459.382824:0:43666:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789130459.382835:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130459.382845:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c6b468-e11e-4c24-bf56-0ab5301cc278+14:2369:x1876037605121408:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130459.382861:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130459.382868:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 14 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.382880:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 14 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.382896:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130459.382952:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c6b468-e11e-4c24-bf56-0ab5301cc278+14:2369:x1876037605121408:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 107us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130459.382959:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130459.382975:0:43666:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789130459.382981:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789130459.382987:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605121536:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130459.382995:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130459.382999:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 13 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.383008:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 13 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.383022:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130459.383038:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605121536:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130459.383045:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00010000:00010000:0.0:1789130459.384249:0:45793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 19 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.384268:0:45793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 19 pid: 43674 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.384286:0:45793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891520:0@lo:104: 00000100:00100000:0.0:1789130459.384354:0:45793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130459.384416:0:45793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1000 going to sleep for 11 seconds 00010000:00010000:0.0:1789130459.384449:0:45793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bac3f800/0x5c74554e47ceb7b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac618 expref: 12 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.384463:0:45793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626890752:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130459.384477:0:45793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4bac3f600/0x5c74554e47ceb77d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5b6 expref: 11 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.384485:0:45793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626890880:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130459.384496:0:45793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b390c3ca00/0x5c74554e47ceb6a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb69d expref: 19 pid: 43671 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.384505:0:45793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891008:0@lo:104: 00000100:00100000:0.0:1789130459.384515:0:45793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891136:0@lo:104: 00000100:00100000:2.0:1789130459.384590:0:43662:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789130459.384987:0:43662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891520 00000100:00100000:2.0:1789130459.384995:0:43662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891520 00000100:00100000:2.0:1789130459.385154:0:43662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130459.385171:0:43662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3837a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891520:12345-0@lo:104: 00010000:00010000:2.0:1789130459.385192:0:43662:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385278:0:43662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130459.385289:0:43662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3837a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+3:45793:x1876037626891520:12345-0@lo:104: Request processed in 119us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130459.385297:0:43662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789130459.385373:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130459.385381:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385391:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789130459.385395:0:43668:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385405:0:43668:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130459.385413:0:43668:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130459.385422:0:43668:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130459.385471:0:43668:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385479:0:43668:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130459.385502:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385510:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b3873f3400/0x5c74554e47ceb562 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ceb569 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130459.385529:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130459.385531:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130459.385533:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130459.385737:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 18 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.385766:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b390c35800/0x5c74554e47ceb5b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb5af expref: 18 pid: 43673 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.385782:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130459.385848:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:3307:x1876037626891392:12345-0@lo:103:ldlm_bl.0 Request processed in 5981us (6296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130459.385865:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130459.385971:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626891648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130459.386007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130459.386245:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891648 00000100:00100000:3.0:1789130459.386254:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891648 00010000:00010000:3.0:1789130459.386280:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 17 pid: 43674 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130459.386305:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130459.386313:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:3308:x1876037626891648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130459.386327:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130459.386332:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 17 pid: 43674 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386341:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 17 pid: 43674 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386355:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386365:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386382:0:43664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386390:0:43664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386398:0:43664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386405:0:43664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386412:0:43664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130459.386416:0:43664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386425:0:43664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386435:0:43664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.386445:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130459.386480:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:3308:x1876037626891648:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130459.386486:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130459.386522:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626891648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130459.386640:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626891392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130459.386764:0:45793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b383ce0e00/0x5c74554e47ceb569 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ceb562 expref: 16 pid: 43674 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130459.386786:0:45793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:45793:1876037626891520:0@lo:104: 00010000:00010000:0.0:1789130459.386936:0:45793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.386948:0:45793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.386955:0:45793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130459.386961:0:45793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b3873f2c00/0x5c74554e47ceb7df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130459.782949:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130460.294467:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789130460.422095:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130460.422121:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626891776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130460.422207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130460.422620:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626892288:0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.422654:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130460.422676:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130460.422681:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.422703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130460.422730:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892288 00000100:00100000:0.0:1789130460.422747:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892288 00000100:00100000:0.0:1789130460.422801:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892160 00000100:00100000:0.0:1789130460.422805:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892160 00000100:00100000:0.0:1789130460.422829:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130460.422838:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.422886:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626892288:12345-0@lo:400:kworker.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.422894:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130460.422909:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130460.422915:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.422940:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626892160:12345-0@lo:400:kworker.0 Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.422946:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789130460.422965:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130460.423001:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.423012:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626892288:0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.423988:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626891904:0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.424089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130460.424234:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891904 00000100:00100000:0.0:1789130460.424243:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891904 00000100:00100000:1.0:1789130460.425843:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626891776 00000100:00100000:1.0:1789130460.425858:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626891776 00000100:00100000:1.0:1789130460.425941:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130460.425950:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626891776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130460.425989:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130460.426231:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626891776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.426240:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789130460.426269:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130460.426312:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626891776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130460.427496:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626892032:0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.428667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390ced2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626892416:0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.428776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130460.428953:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892416 00000100:00100000:2.0:1789130460.428963:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892416 00000100:00100000:2.0:1789130460.429040:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130460.429051:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626892416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.429126:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626892416:12345-0@lo:400:kworker.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130460.429136:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789130460.429167:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130460.429237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390ced2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626892416:0@lo:400:kworker.0 00000100:00100000:1.0:1789130460.429253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130460.429315:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892032 00000100:00100000:2.0:1789130460.429323:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892032 00000100:00100000:2.0:1789130460.429387:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130460.429398:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626892032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130460.429468:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626892032:12345-0@lo:400:kworker.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130460.429475:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789130460.429496:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130460.431316:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130460.431345:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3306:x1876037626891904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130460.431376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626892032:0@lo:400:kworker.0 00000100:00100000:0.0:1789130460.431476:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:3306:x1876037626891904:12345-0@lo:400:kworker.0 Request processed in 144us (7385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.431484:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789130460.431582:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626891904:0@lo:400:kworker.0 00000100:00100000:1.0:1789130460.533060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.533220:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121664 00000100:00100000:0.0:1789130460.533231:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121664 00000100:00100000:0.0:1789130460.533308:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1789130460.533319:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:45214:x1876037605121664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130460.533341:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.533364:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb7e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac649 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533438:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533451:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533464:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533477:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533483:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533489:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533890:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533900:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.533908:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.533987:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789130460.533991:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:2.0:1789130460.534127:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1789130460.534227:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534243:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534249:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534256:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534261:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.534265:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534273:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534285:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130460.534288:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.534293:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534298:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb7ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534308:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534315:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534320:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534326:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.534328:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534333:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534339:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.534342:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.534344:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534349:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb7f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534381:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb7e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac649 expref: 8 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534393:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac649 expref: 7 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.534399:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130460.534401:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130460.534403:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130460.534475:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:45214:x1876037605121664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1157us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.534482:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130460.539564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.540412:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605121920 00000100:00100000:0.0:1789130460.540427:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605121920 00000100:00100000:0.0:1789130460.540493:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789130460.540503:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:45214:x1876037605121920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130460.540524:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.540546:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb802 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac650 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540661:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540675:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540697:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540713:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540720:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.540726:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541172:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb817 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541183:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541190:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.541201:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130460.541436:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541444:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541450:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541455:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.541458:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541465:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541476:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130460.541479:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.541484:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541490:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb809 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541503:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541509:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541519:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541524:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.541527:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541533:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541540:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.541543:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.541545:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.541552:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb810 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.542077:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb802 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac650 expref: 10 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.542093:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb817 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac650 expref: 9 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.542101:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130460.542103:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.542106:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130460.542186:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:45214:x1876037605121920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1684us (2632us total) trans 34359738369 rc 0/0 00000100:00100000:0.0:1789130460.542198:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130460.546183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.546330:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122048 00000100:00100000:0.0:1789130460.546343:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122048 00000100:00100000:0.0:1789130460.546415:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130460.546427:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:45214:x1876037605122048:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789130460.546550:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:45214:x1876037605122048:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.546558:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789130460.681869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.682119:0:43688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122176 00000100:00100000:1.0:1789130460.682130:0:43688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122176 00000100:00100000:1.0:1789130460.682238:0:43688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789130460.682250:0:43688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6f164769-cccd-48c1-b7fa-967be7565442+9:45229:x1876037605122176:12345-192.168.201.39@tcp:700:mkdir.0 00000100:00100000:1.0:1789130460.682341:0:43688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6f164769-cccd-48c1-b7fa-967be7565442+9:45229:x1876037605122176:12345-192.168.201.39@tcp:700:mkdir.0 Request processed in 93us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.682349:0:43688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130460.689979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.692155:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122432 00000100:00100000:0.0:1789130460.692171:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122432 00000100:00100000:0.0:1789130460.692303:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789130460.692315:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:45229:x1876037605122432:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789130460.692374:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130460.692401:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb7a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac5e0 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.692421:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130460.692426:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130460.692764:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.692780:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.692789:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.692826:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.692842:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 5 pid: 43679 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.692857:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626892544:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130460.692960:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130460.701891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.704137:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122560 00000100:00100000:3.0:1789130460.704152:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122560 00010000:00010000:3.0:1789130460.704231:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 6 pid: 43679 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.704272:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130460.704282:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605122560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130460.704298:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130460.704305:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 6 pid: 43679 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.704317:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 6 pid: 43679 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.704344:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130460.704349:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.704359:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.704367:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.704387:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130460.704443:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605122560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 163us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130460.704451:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:0.0:1789130460.705596:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130460.708705:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb7d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac642 expref: 5 pid: 43679 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130460.708739:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cefc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626892544:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130460.708764:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.708775:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.708780:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.708810:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.708827:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.708838:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130460.710999:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789130460.711018:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711028:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711036:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711043:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130460.711047:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711054:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711070:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130460.711073:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130460.711079:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.711086:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb825 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130460.711116:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000dcbf6549 reply state 0000000025693d99 transno 34359738370 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130460.711125:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130460.711232:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:45229:x1876037605122432:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 18916us (21258us total) trans 34359738370 rc 0/0 00000100:00100000:2.0:1789130460.711242:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:2.0:1789130460.716559:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716578:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716587:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716593:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130460.716597:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716646:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716666:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8958b82 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130460.716670:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130460.716678:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.716685:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb82c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.741529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.742255:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122688 00000100:00100000:0.0:1789130460.742272:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122688 00000100:00100000:0.0:1789130460.742358:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130460.742380:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:45230:x1876037605122688:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:0.0:1789130460.742413:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.742446:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac657 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.742767:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.742787:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.742813:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.742894:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130460.742899:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130460.742958:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.742992:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac657 expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.743016:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac657 expref: 10 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.743025:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.743028:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130460.743033:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130460.743120:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:45230:x1876037605122688:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 743us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.743129:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130460.747223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.747349:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605122816 00000100:00100000:2.0:1789130460.747366:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605122816 00000100:00100000:2.0:1789130460.747450:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130460.747463:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:45230:x1876037605122816:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:2.0:1789130460.747485:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130460.747505:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac65e expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747591:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747648:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747662:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747682:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747690:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747697:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747805:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747813:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747820:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130460.747858:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789130460.747861:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130460.747888:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747899:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747905:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747911:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747916:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130460.747920:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747926:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747937:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130460.747940:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130460.747944:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747950:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747968:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747974:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747979:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747984:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130460.747987:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747992:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.747998:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8958b82 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130460.748001:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130460.748003:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.748009:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb84f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.748055:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac65e expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.748068:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac65e expref: 11 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.748080:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130460.748082:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130460.748084:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130460.748160:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:45230:x1876037605122816:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 701us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130460.748168:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130460.751754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.752095:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123072 00000100:00100000:0.0:1789130460.752109:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123072 00000100:00100000:0.0:1789130460.752198:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130460.752209:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:45230:x1876037605123072:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:0.0:1789130460.752293:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130460.752332:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47ceb856 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac65e expref: 11 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.753169:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130460.753198:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130460.753245:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.753263:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.753278:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130460.753693:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bb8dc68a reply state 0000000092d0032c transno 34359738371 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.753706:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789130460.753723:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1789130460.753873:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:45230:x1876037605123072:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 1663us (2143us total) trans 34359738371 rc 0/0 00000100:00100000:0.0:1789130460.753883:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00010000:00010000:1.0:1789130460.756340:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756373:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756382:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756389:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.756395:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756404:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756429:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b497c01700) 00010000:00010000:1.0:1789130460.756432:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130460.756438:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.756446:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2400/0x5c74554e47ceb85d lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.765227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.765429:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123200 00000100:00100000:0.0:1789130460.765444:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123200 00000100:00100000:0.0:1789130460.765528:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789130460.765540:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+11:44609:x1876037605123200:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130460.765564:0:43674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.765592:0:43674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b3873f2400/0x5c74554e47ceb864 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac665 expref: -99 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.765674:0:43674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b3873f2400/0x5c74554e47ceb864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac665 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.765694:0:43674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b3873f2400/0x5c74554e47ceb864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac665 expref: 12 pid: 43674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.765705:0:43674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2400, rc 0) 00000100:00100000:0.0:1789130460.765988:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123200:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 448us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.765997:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1789130460.770014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.770373:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123456 00000100:00100000:0.0:1789130460.770386:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123456 00000100:00100000:0.0:1789130460.770464:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130460.770476:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:45231:x1876037605123456:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789130460.770562:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130460.770661:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb83a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac657 expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.770697:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.770712:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130460.771250:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:45231:x1876037605123456:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 775us (1251us total) trans 0 rc -17/-17 00000100:00100000:0.0:1789130460.771260:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789130460.774137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.774408:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123584 00000100:00100000:1.0:1789130460.774426:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123584 00000100:00100000:1.0:1789130460.774504:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1789130460.774516:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123584:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130460.774973:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123584:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 457us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.774983:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1789130460.775294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.777727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.777928:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123840 00000100:00100000:0.0:1789130460.777941:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123840 00000100:00100000:0.0:1789130460.777999:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789130460.778009:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123840:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130460.778302:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123840:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 293us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.778312:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1789130460.784596:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123712 00000100:00100000:2.0:1789130460.784634:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123712 00000100:00100000:2.0:1789130460.784738:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130460.784753:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:45231:x1876037605123712:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:2.0:1789130460.784784:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130460.784866:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb86b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac66c expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.785043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130460.785228:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.785248:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.785261:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130460.785469:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130460.785544:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130460.785582:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.785641:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb86b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac66c expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.785663:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac66c expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.785672:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130460.785676:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130460.785680:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:1.0:1789130460.785744:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605123968 00000100:00100000:1.0:1789130460.785751:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605123968 00000100:00100000:1.0:1789130460.785805:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789130460.785815:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+12:44609:x1876037605123968:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130460.785827:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789130460.785828:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:45231:x1876037605123712:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 1079us (10537us total) trans 0 rc 0/0 00010000:00010000:1.0:1789130460.785842:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3e800/0x5c74554e47ceb879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592ac673 expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.785862:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3e800/0x5c74554e47ceb879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac673 expref: 13 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.785871:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3e800/0x5c74554e47ceb879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac673 expref: 13 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.785879:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e800, rc 0) 00000100:00100000:1.0:1789130460.785903:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44609:x1876037605123968:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 91us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.785909:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1789130460.789436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.789490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.789593:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124096 00000100:00100000:1.0:1789130460.789641:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124096 00000100:00100000:1.0:1789130460.789714:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789130460.789726:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44609:x1876037605124096:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130460.790143:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44609:x1876037605124096:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 418us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.790153:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130460.790578:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124224 00000100:00100000:0.0:1789130460.790586:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124224 00000100:00100000:0.0:1789130460.790646:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789130460.790654:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:45231:x1876037605124224:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789130460.790673:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.790703:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac67a expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790796:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790815:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790829:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790846:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790853:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790861:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790967:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790975:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.790983:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.791029:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789130460.791034:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130460.791059:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791073:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791094:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791102:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791110:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.791115:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791124:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791140:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:0.0:1789130460.791143:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.791148:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791155:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791171:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791178:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791190:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791196:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.791199:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791206:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791213:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8958b82 (ffff90b497c01c00) 00010000:00010000:0.0:1789130460.791215:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.791218:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791224:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb88e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791259:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac67a expref: 14 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791274:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac67a expref: 13 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.791283:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130460.791285:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130460.791288:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2e00, rc 0) 00000100:00100000:0.0:1789130460.791345:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:45231:x1876037605124224:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 692us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.791895:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789130460.793239:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789130460.798394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.798545:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124480 00000100:00100000:3.0:1789130460.798559:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124480 00000100:00100000:3.0:1789130460.798660:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130460.798673:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:45231:x1876037605124480:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:3.0:1789130460.798823:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130460.798860:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb895 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac67a expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.798886:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b497c01700) 00010000:00010000:3.0:1789130460.798899:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130460.799026:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.799043:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.799055:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.799072:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.799311:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.799385:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130460.802022:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789130460.802048:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802061:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802068:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802075:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130460.802193:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802205:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802225:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130460.802228:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130460.802234:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.802242:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb89c lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130460.802273:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009e03fa1f reply state 00000000fc4c21e4 transno 34359738372 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.802285:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130460.802854:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:45231:x1876037605124480:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 4176us (4471us total) trans 34359738372 rc 0/0 00000100:00100000:3.0:1789130460.802866:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00010000:00010000:2.0:1789130460.805761:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130460.807938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130460.810267:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810291:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810301:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810307:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.810313:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810336:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810360:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b488939300) 00010000:00010000:0.0:1789130460.810364:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.810371:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.810377:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceb8a3 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130460.814069:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124608 00000100:00100000:1.0:1789130460.814467:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124608 00000100:00100000:1.0:1789130460.815015:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789130460.815030:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44609:x1876037605124608:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130460.815374:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:44609:x1876037605124608:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 345us (7447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.815384:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789130460.820564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.821668:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124864 00000100:00100000:1.0:1789130460.821686:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124864 00000100:00100000:1.0:1789130460.821779:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1789130460.821791:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:45233:x1876037605124864:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:1.0:1789130460.821874:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130460.821923:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47ceb872 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac66c expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.821948:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:1.0:1789130460.821967:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130460.822251:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:45233:x1876037605124864:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 461us (1702us total) trans 0 rc -17/-17 00000100:00100000:1.0:1789130460.822260:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130460.825652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.825780:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605124992 00000100:00100000:2.0:1789130460.825792:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605124992 00000100:00100000:2.0:1789130460.825868:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789130460.825881:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:45233:x1876037605124992:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:2.0:1789130460.825909:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130460.825941:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac681 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826032:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826048:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826060:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130460.826154:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130460.826159:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130460.826190:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826224:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac681 expref: 13 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826248:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac681 expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.826259:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130460.826262:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130460.826266:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130460.826356:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:45233:x1876037605124992:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 477us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130460.826365:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130460.830175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.830289:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605125120 00000100:00100000:1.0:1789130460.830302:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605125120 00000100:00100000:1.0:1789130460.830384:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1789130460.830396:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:45233:x1876037605125120:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:1.0:1789130460.830423:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130460.830450:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb8b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac688 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830531:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830549:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830564:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830581:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830589:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830595:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830894:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830904:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.830912:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130460.830967:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789130460.830971:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130460.831004:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831019:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831032:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831039:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831045:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.831049:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831056:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831071:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130460.831075:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.831081:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831087:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831102:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831112:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831118:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831123:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.831126:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831131:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831138:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8958b82 (ffff90b4909bd400) 00010000:00010000:1.0:1789130460.831141:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.831143:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831149:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831185:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb8b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac688 expref: 14 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831200:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac688 expref: 13 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.831208:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdd00) 00010000:00010000:1.0:1789130460.831210:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130460.831214:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130460.831292:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:45233:x1876037605125120:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 898us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.831302:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130460.849141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.849265:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605125376 00000100:00100000:2.0:1789130460.849277:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605125376 00000100:00100000:2.0:1789130460.849349:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1789130460.849361:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:45233:x1876037605125376:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:2.0:1789130460.849434:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130460.849468:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceb8cd lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac688 expref: 13 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849492:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdd00) 00010000:00010000:2.0:1789130460.849507:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130460.849675:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849803:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849817:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849833:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849842:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.849848:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130460.850557:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00010000:00010000:2.0:1789130460.850572:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850579:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850586:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850590:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130460.850594:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850646:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850663:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b48a1fd100) 00010000:00010000:2.0:1789130460.850666:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130460.850671:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.850677:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb8d4 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130460.850702:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000342c730f reply state 00000000cf019889 transno 34359738373 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130460.850712:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130460.850843:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:45233:x1876037605125376:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 1481us (1711us total) trans 34359738373 rc 0/0 00000100:00100000:2.0:1789130460.850853:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:1.0:1789130460.852264:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852282:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852290:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852297:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.852302:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852309:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852328:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b48a1fd200) 00010000:00010000:1.0:1789130460.852332:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.852336:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.852342:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceb8db lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.861145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.861236:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605125504 00000100:00100000:1.0:1789130460.861247:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605125504 00000100:00100000:1.0:1789130460.861312:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130460.861322:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390ceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:45235:x1876037605125504:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130460.861358:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130460.861395:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb8e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac68f expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861487:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861503:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861514:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861527:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861532:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861536:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861737:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861745:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861751:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130460.861788:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789130460.861844:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130460.861880:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861900:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861905:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861910:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861914:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.861917:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861922:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861933:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130460.861935:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.861939:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861944:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb8e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861954:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861958:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861965:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861969:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.861970:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861973:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861977:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8958b82 (ffff90b4909bd400) 00010000:00010000:1.0:1789130460.861978:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.861980:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.861983:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb8f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe8958b82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.862009:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb8e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac68f expref: 15 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.862018:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac68f expref: 14 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.862022:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130460.862023:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130460.862025:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e200, rc 0) 00000100:00100000:1.0:1789130460.862089:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390ceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:45235:x1876037605125504:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 769us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.862098:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789130460.864105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.864190:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605125632 00000100:00100000:1.0:1789130460.864200:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605125632 00000100:00100000:1.0:1789130460.864288:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789130460.864297:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:45235:x1876037605125632:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130460.864321:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130460.864344:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceb8fe lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac696 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864425:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864436:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864446:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864457:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864462:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864466:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864568:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864576:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864581:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130460.864642:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789130460.864645:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130460.864671:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864696:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864703:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864710:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864717:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.864722:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864739:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864751:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130460.864753:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.864758:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864766:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ceb905 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864778:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864781:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864785:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864788:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.864790:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864796:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864803:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b4909bd000) 00010000:00010000:1.0:1789130460.864805:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.864808:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864814:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb90c lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864848:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceb8fe lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac696 expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864863:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac696 expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.864872:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:1.0:1789130460.864874:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130460.864876:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130460.865091:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:45235:x1876037605125632:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 795us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.865097:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130460.867484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.867553:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605125888 00000100:00100000:1.0:1789130460.867563:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605125888 00000100:00100000:0.0:1789130460.867852:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130460.867867:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+15:45235:x1876037605125888:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130460.867956:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.867985:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb91a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac69d expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.868122:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789130460.868261:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb91a lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac69d expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.868275:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130460.868277:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130460.868281:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb91a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac69d expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.868293:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130460.868445:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+16:45235:x1876037605125888:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 583us (970us total) trans 34359738374 rc 301/301 00000100:00100000:0.0:1789130460.868451:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130460.870324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.870422:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605126144 00000100:00100000:2.0:1789130460.870436:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605126144 00000100:00100000:2.0:1789130460.870495:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789130460.870507:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:45235:x1876037605126144:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789130460.870569:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130460.870596:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ceb913 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac696 expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.870868:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:2.0:1789130460.870880:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130460.870913:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.870929:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130460.870942:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130460.871181:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f2327552 reply state 00000000b9cc5680 transno 34359738375 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130460.871189:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789130460.871199:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000100:00100000:2.0:1789130460.871291:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:45235:x1876037605126144:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 785us (974us total) trans 34359738375 rc 0/0 00000100:00100000:2.0:1789130460.871301:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00010000:00010000:0.0:1789130460.872545:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872564:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872578:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872584:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.872589:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872596:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872644:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b48a1fd100) 00010000:00010000:0.0:1789130460.872648:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789130460.872653:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.872661:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceb928 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.873505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.873824:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605126400 00000100:00100000:2.0:1789130460.873837:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605126400 00000100:00100000:2.0:1789130460.873899:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789130460.873911:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:45235:x1876037605126400:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130460.874194:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:45235:x1876037605126400:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 284us (695us total) trans 34359738376 rc 0/0 00000100:00100000:2.0:1789130460.874203:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789130460.877087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.877152:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605126656 00000100:00100000:3.0:1789130460.877165:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605126656 00000100:00100000:3.0:1789130460.877285:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789130460.877297:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:45235:x1876037605126656:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130460.877329:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130460.877356:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb92f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6a4 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877444:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877467:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877478:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877490:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877495:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877499:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130460.877691:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789130460.877843:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877851:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877858:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877865:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130460.877869:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877878:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877906:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130460.877910:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130460.877915:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877923:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb936 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877937:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877944:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877950:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877953:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130460.877956:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877963:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877969:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b488939200) 00010000:00010000:3.0:1789130460.877970:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130460.877972:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.877976:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb93d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.878018:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb92f lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6a4 expref: 19 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.878026:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130460.878028:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130460.878030:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb92f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6a4 expref: 19 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.878037:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35800, rc 0) 00000100:00100000:3.0:1789130460.878107:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:45235:x1876037605126656:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 813us (1032us total) trans 34359738377 rc 301/301 00000100:00100000:3.0:1789130460.878116:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130460.880005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.880077:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605126784 00000100:00100000:1.0:1789130460.880087:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605126784 00000100:00100000:1.0:1789130460.880143:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130460.880153:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:45235:x1876037605126784:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130460.880181:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130460.880208:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceb94b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6ab expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880331:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880343:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880353:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130460.880399:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789130460.880401:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130460.880426:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880458:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceb94b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ab expref: 20 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880475:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ab expref: 19 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.880482:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:1.0:1789130460.880484:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130460.880487:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e000, rc 0) 00000100:00100000:1.0:1789130460.880545:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+19:45235:x1876037605126784:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 393us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130460.880552:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789130460.884916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130460.885041:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605126912 00000100:00100000:2.0:1789130460.885053:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605126912 00000100:00100000:2.0:1789130460.885165:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1789130460.885178:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:45235:x1876037605126912:12345-192.168.201.39@tcp:37:lfs.0 00000100:00100000:0.0:1789130460.888469:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:45235:x1876037605126912:12345-192.168.201.39@tcp:37:lfs.0 Request processed in 3282us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.888481:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789130460.890804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.890865:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605127168 00000100:00100000:3.0:1789130460.890878:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605127168 00000100:00100000:3.0:1789130460.890950:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130460.890963:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:45235:x1876037605127168:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130460.891281:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:45235:x1876037605127168:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 319us (492us total) trans 34359738378 rc 0/0 00000100:00100000:3.0:1789130460.891293:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130460.901199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.901308:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605127296 00000100:00100000:0.0:1789130460.901322:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605127296 00000100:00100000:0.0:1789130460.901405:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1789130460.901418:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:45236:x1876037605127296:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130460.901451:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.901481:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb959 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6b2 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901572:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901591:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901653:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901682:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901690:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901697:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901843:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901852:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901860:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.901905:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000004:00200000:0.0:1789130460.901910:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130460.901938:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901953:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901960:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901968:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901975:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.901980:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.901989:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902004:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130460.902008:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.902015:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902022:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb960 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902037:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902044:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902055:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902060:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.902063:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902068:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902075:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b497c01c00) 00010000:00010000:0.0:1789130460.902078:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.902081:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902087:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb967 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902125:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb959 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6b2 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902143:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6b2 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.902151:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.902153:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130460.902156:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2e00, rc 0) 00000100:00100000:0.0:1789130460.902241:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:45236:x1876037605127296:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 825us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.902253:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1789130460.905598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.905822:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605127552 00000100:00100000:0.0:1789130460.905835:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605127552 00000100:00100000:0.0:1789130460.905944:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130460.905954:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:45236:x1876037605127552:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130460.905979:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.906003:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb975 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6b9 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.906178:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00010000:00010000:0.0:1789130460.906311:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb975 lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6b9 expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.906324:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130460.906327:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130460.906331:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb975 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6b9 expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.906345:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130460.906422:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:45236:x1876037605127552:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 470us (835us total) trans 34359738379 rc 301/301 00000100:00100000:0.0:1789130460.906430:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130460.909534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.909711:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605127808 00000100:00100000:0.0:1789130460.909736:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605127808 00000100:00100000:0.0:1789130460.909818:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130460.909831:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+22:45236:x1876037605127808:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:0.0:1789130460.909918:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130460.909956:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb96e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6b2 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.909980:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.909992:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130460.910025:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.910042:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.910054:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130460.910365:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d1802967 reply state 00000000e365e3fe transno 34359738380 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.910377:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789130460.910393:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000100:00100000:0.0:1789130460.910513:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+23:45236:x1876037605127808:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 684us (994us total) trans 34359738380 rc 0/0 00000100:00100000:0.0:1789130460.910522:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:1.0:1789130460.912484:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.912504:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.912513:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.912519:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.912525:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.912534:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130460.912542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130460.912559:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130460.912563:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789130460.912568:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.912575:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb983 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130460.912761:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128064 00000100:00100000:0.0:1789130460.912774:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128064 00000100:00100000:0.0:1789130460.913067:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1789130460.913080:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:45236:x1876037605128064:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130460.913385:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:45236:x1876037605128064:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 307us (846us total) trans 34359738381 rc 0/0 00000100:00100000:0.0:1789130460.913397:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789130460.915549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130460.915624:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128320 00000100:00100000:1.0:1789130460.915637:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128320 00000100:00100000:1.0:1789130460.915840:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130460.915853:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+23:45236:x1876037605128320:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130460.915884:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130460.915922:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb98a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6c0 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916022:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916040:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916054:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916072:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916080:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916092:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130460.916261:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00010000:00010000:1.0:1789130460.916410:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916419:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916426:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916433:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.916438:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916446:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916460:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130460.916463:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.916469:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916475:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47ceb991 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916492:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916503:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916509:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916514:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130460.916517:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916523:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916530:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b4909bd400) 00010000:00010000:1.0:1789130460.916533:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130460.916535:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916541:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ceb998 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916589:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb98a lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6c0 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916636:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130460.916639:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130460.916643:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceb98a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6c0 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130460.916666:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130460.916758:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+24:45236:x1876037605128320:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 907us (1217us total) trans 34359738382 rc 301/301 00000100:00100000:1.0:1789130460.916768:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130460.920400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.920560:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128448 00000100:00100000:3.0:1789130460.920573:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128448 00000100:00100000:3.0:1789130460.920781:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130460.920806:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+24:45236:x1876037605128448:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130460.920838:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130460.920870:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb9a6 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6c7 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921024:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921042:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921058:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130460.921123:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000004:00200000:3.0:1789130460.921128:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130460.921160:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921193:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35800/0x5c74554e47ceb9a6 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6c7 expref: 26 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921217:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6c7 expref: 25 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130460.921228:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130460.921231:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130460.921235:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35c00, rc 0) 00000100:00100000:3.0:1789130460.921433:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:45236:x1876037605128448:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 641us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130460.921442:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789130460.928020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.929190:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128576 00000100:00100000:3.0:1789130460.929209:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128576 00000100:00100000:2.0:1789130460.929523:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130460.929538:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:45236:x1876037605128576:12345-192.168.201.39@tcp:37:lfs.0 00000100:00100000:0.0:1789130460.935088:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:45236:x1876037605128576:12345-192.168.201.39@tcp:37:lfs.0 Request processed in 5535us (7063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.935108:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130460.939690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130460.940004:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128832 00000100:00100000:3.0:1789130460.940016:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128832 00000100:00100000:3.0:1789130460.940146:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130460.940156:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:45236:x1876037605128832:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130460.940942:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:45236:x1876037605128832:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 782us (1262us total) trans 34359738383 rc 0/0 00000100:00100000:1.0:1789130460.940959:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789130460.994423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130460.996090:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605128960 00000100:00100000:0.0:1789130460.996112:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605128960 00000100:00100000:0.0:1789130460.996342:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789130460.996365:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:45242:x1876037605128960:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130460.996400:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130460.996429:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb9b4 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6ce expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996520:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996540:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996556:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996573:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996580:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996588:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996796:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996807:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996814:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130460.996855:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789130460.996860:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130460.996929:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996940:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996945:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996950:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996954:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.996958:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996964:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996974:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130460.996977:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.996982:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996986:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ceb9bb lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.996997:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997000:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997004:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997007:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130460.997009:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997012:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997016:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b497c01d00) 00010000:00010000:0.0:1789130460.997017:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130460.997019:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997022:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ceb9c2 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997050:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47ceb9b4 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ce expref: 28 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997065:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ce expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130460.997070:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130460.997072:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130460.997074:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130460.997171:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:45242:x1876037605128960:12345-192.168.201.39@tcp:101:dd.0 Request processed in 817us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130460.997178:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130461.005295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.005396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.005540:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605129088 00000100:00100000:3.0:1789130461.005554:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605129088 00000100:00100000:3.0:1789130461.005672:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789130461.006141:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:2370:x1876037605129088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130461.006165:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130461.006204:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ceb9c9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ce expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.006232:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:3.0:1789130461.006240:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130461.006331:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605129088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 198us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.006341:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1789130461.007565:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605129344 00000100:00100000:0.0:1789130461.007582:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605129344 00000100:00100000:0.0:1789130461.007930:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:0.0:1789130461.007944:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:45242:x1876037605129344:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130461.007971:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130461.007974:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130461.008011:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e000/0x5c74554e47ceb952 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ab expref: 26 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008034:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b4909bd000) 00010000:00010000:0.0:1789130461.008045:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130461.008066:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb9d0 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6d5 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008240:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008263:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008276:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008293:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008300:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.008308:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130461.009082:0:45555:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xd1:0x0], count =17 00000004:00080000:0.0:1789130461.009093:0:45555:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xd1:0x0]+17 in llog 00000004:00080000:0.0:1789130461.009151:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe2:0x0], index 1: 0 00010000:00010000:0.0:1789130461.009362:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceb9e5 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009374:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceb9e5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009384:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceb9e5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009428:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009435:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009442:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009449:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.009454:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009463:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009474:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130461.009477:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130461.009482:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009489:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47ceb9d7 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130461.009503:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c921f07f reply state 00000000c7dfa7fe transno 34359738384 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130461.009513:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130461.009553:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47ceb9d0 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6d5 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009574:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceb9e5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6d5 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.009583:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130461.009587:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130461.009590:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031e00, rc 0) 00000100:00100000:0.0:1789130461.009714:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:45242:x1876037605129344:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1773us (4436us total) trans 34359738384 rc 0/0 00000100:00100000:0.0:1789130461.009738:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130461.017430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.017695:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605129472 00000100:00100000:3.0:1789130461.017708:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605129472 00000100:00100000:3.0:1789130461.017802:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789130461.017817:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:45242:x1876037605129472:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130461.017841:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.017876:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6dc expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130461.018075:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130461.018116:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe2:0x0].0x0 since=1624s v=(0 0) 00010000:00010000:3.0:1789130461.018121:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130461.018135:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.018159:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.018176:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35800, rc 0) 00000100:00100000:3.0:1789130461.018249:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:45242:x1876037605129472:12345-192.168.201.39@tcp:101:dd.0 Request processed in 435us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.018258:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00080000:2.0:1789130461.018547:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789130461.020585:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020787:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020795:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020802:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.020809:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020818:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020840:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0xeab58702 (ffff90b497c01600) 00010000:00010000:0.0:1789130461.020843:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130461.020849:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.020856:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceb9de lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.027181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.027327:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605129728 00000100:00100000:3.0:1789130461.027339:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605129728 00000100:00100000:3.0:1789130461.027431:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789130461.027444:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:45242:x1876037605129728:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130461.030370:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:45242:x1876037605129728:12345-192.168.201.39@tcp:35:dd.0 Request processed in 2901us (3177us total) trans 34359738385 rc 0/0 00000100:00100000:2.0:1789130461.030388:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130461.152438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.152543:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605129984 00000100:00100000:3.0:1789130461.152556:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605129984 00000100:00100000:3.0:1789130461.153478:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130461.153498:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:45252:x1876037605129984:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130461.153533:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.153563:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb9fa lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6e3 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153715:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153743:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153759:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153779:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153787:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.153808:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130461.153979:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789130461.154117:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154131:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154138:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154146:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.154151:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154159:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154174:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130461.154178:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.154183:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154190:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba01 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154206:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154212:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154218:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154223:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c35600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.154228:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154234:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154241:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b488939100) 00010000:00010000:3.0:1789130461.154243:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.154246:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154252:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35600/0x5c74554e47ceba08 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154300:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb9fa lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6e3 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154313:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130461.154315:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130461.154330:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35a00/0x5c74554e47ceb9fa lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6e3 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.154341:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35a00, rc 0) 00000100:00100000:3.0:1789130461.154431:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:45252:x1876037605129984:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 939us (2007us total) trans 34359738386 rc 301/301 00000100:00100000:3.0:1789130461.154440:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1789130461.160160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.160938:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605130240 00000100:00100000:2.0:1789130461.160955:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605130240 00000100:00100000:2.0:1789130461.161052:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789130461.161065:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:45252:x1876037605130240:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130461.161440:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:45252:x1876037605130240:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 376us (1294us total) trans 34359738387 rc 0/0 00000100:00100000:2.0:1789130461.161450:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 10000000:01000000:3.0:1789130461.189685:0:43677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789130461.189695:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b489cb5000 from 13 10000000:01000000:3.0:1789130461.189703:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130461.189788:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.189816:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.189830:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130461.189866:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.189964:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130461.190039:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130461.190131:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892672 00000100:00100000:1.0:1789130461.190141:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892672 00000100:00100000:1.0:1789130461.190207:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789130461.190219:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+16:43677:x1876037626892672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130461.190237:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130461.190255:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3fc00/0x5c74554e47ceba1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceba16 expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.190288:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3fc00/0x5c74554e47ceba1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceba16 expref: 17 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.190301:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3fc00/0x5c74554e47ceba1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceba16 expref: 17 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.190312:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fc00, rc 0) 00000100:00100000:1.0:1789130461.190393:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626892672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.190403:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789130461.190577:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130461.190597:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba1d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.190648:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceba1d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.190737:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130461.190774:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130461.190803:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b382b13480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130461.190869:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892800 00000100:00100000:3.0:1789130461.190874:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892800 00000100:00100000:3.0:1789130461.190910:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130461.190918:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626892800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.191268:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626892800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.191277:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789130461.192452:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130461.192530:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130461.192616:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130461.192649:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130461.193416:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626892928 00000100:00100000:3.0:1789130461.193428:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626892928 00000100:00100000:3.0:1789130461.193492:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130461.193503:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626892928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.193811:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626892928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.193820:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789130461.193912:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626892928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130461.199383:0:45808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789130461.204017:0:43677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789130461.204065:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130461.204217:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba1d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.204233:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35a00/0x5c74554e47ceba16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba1d expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130461.204249:0:43677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130461.204252:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492731800 from 13 10000000:01000000:2.0:1789130461.204256:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:3.0:1789130461.205002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789130461.205002:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.205014:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.205029:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.205059:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130461.205203:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130461.205208:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605130368 00000100:00100000:0.0:1789130461.205218:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605130368 00000100:00100000:0.0:1789130461.205289:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130461.205291:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b382b13d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130461.205301:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:45253:x1876037605130368:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130461.205327:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130461.205350:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceba2b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6ea expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205432:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205449:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.205452:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893056 00000100:00100000:1.0:1789130461.205457:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893056 00010000:00010000:0.0:1789130461.205461:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205493:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205502:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205509:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.205530:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789130461.205538:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+17:43677:x1876037626893056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130461.205546:0:43671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130461.205558:0:43671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3f400/0x5c74554e47ceba40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceba24 expref: -99 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.205576:0:43671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3f400/0x5c74554e47ceba40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceba24 expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.205585:0:43671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3f400/0x5c74554e47ceba40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceba24 expref: 18 pid: 43671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.205595:0:43671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f400, rc 0) 00000100:00100000:1.0:1789130461.205676:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.205683:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:0.0:1789130461.205752:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205762:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.205770:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130461.205813:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789130461.205817:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130461.205869:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.205977:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130461.205993:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba40 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.206002:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceba40 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.206085:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893184:0@lo:501:ll_cfg_requeue.0 00010000:00010000:0.0:1789130461.206114:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.206115:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130461.206122:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206130:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206137:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.206142:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.206143:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b382b13d80 going to sleep for 11 seconds 00010000:00010000:0.0:1789130461.206152:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206166:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130461.206170:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130461.206175:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206181:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ceba32 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206197:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206203:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206208:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206214:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.206217:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206223:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206231:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x56ea59b (ffff90b497c01600) 00010000:00010000:0.0:1789130461.206233:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130461.206234:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893184 00010000:00010000:0.0:1789130461.206236:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.206238:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893184 00010000:00010000:0.0:1789130461.206242:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ceba39 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x56ea59b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206280:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ceba2b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ea expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.206302:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130461.206310:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893184:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:0.0:1789130461.206337:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ea expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.206344:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130461.206346:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130461.206348:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030000, rc 0) 00000100:00100000:0.0:1789130461.206400:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:45253:x1876037605130368:12345-192.168.201.39@tcp:101:rm.0 Request processed in 1102us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130461.206406:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130461.206640:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.206647:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789130461.206762:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130461.206803:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130461.206850:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130461.213666:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130461.213918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130461.213949:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605130624 00000100:00100000:0.0:1789130461.213963:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605130624 00000100:00100000:0.0:1789130461.214037:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789130461.214049:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:45253:x1876037605130624:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789130461.214134:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130461.214172:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ceb9e5 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6d5 expref: 31 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.214847:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130461.218403:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130461.219112:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.219138:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.219152:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.219174:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.219179:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.219184:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.220424:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.220444:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.220458:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130461.224811:0:43679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].2, 64 off8320 00000004:00080000:0.0:1789130461.225761:0:43679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1624323155849ns, next at 1625323065531ns, rc = 0 00000100:00100000:3.0:1789130461.225908:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893312 00000100:00100000:3.0:1789130461.225921:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893312 00010000:00010000:0.0:1789130461.226104:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226128:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226142:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226153:0:43679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226160:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226166:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226189:0:43679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130461.226192:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789130461.226209:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893312:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1789130461.226219:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226225:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226230:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226236:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.226241:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226250:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226263:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130461.226266:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130461.226272:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226278:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ceba5c lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226305:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226311:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226316:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226321:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130461.226324:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226329:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226336:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130461.226338:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130461.226341:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.226346:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ceba4e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130461.226359:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000051af2729 reply state 0000000074492466 transno 34359738388 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130461.226374:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130461.229011:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130461.229029:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.229043:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130461.229049:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.229061:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.229154:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130461.229158:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130461.229165:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.229172:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ceba63 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.229206:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130461.229208:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130461.229209:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130461.229878:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:45253:x1876037605130624:12345-192.168.201.39@tcp:36:rm.0 Request processed in 15819us (15955us total) trans 34359738388 rc 0/0 00000100:00100000:0.0:1789130461.229908:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130461.233257:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7036us (26389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.233278:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:3.0:1789130461.233329:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233343:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233351:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233358:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.233363:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233372:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233393:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0xeab58702 (ffff90b497c01d00) 00010000:00010000:3.0:1789130461.233396:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.233402:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.233409:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ceba55 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.233764:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789130461.235080:0:45809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789130461.235517:0:43677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789130461.235544:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130461.235558:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba40 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.235571:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b383ce1e00/0x5c74554e47ceba24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba40 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130461.235583:0:43677:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789130461.235587:0:43677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4be78c000 from 13 10000000:01000000:3.0:1789130461.235591:0:43677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130461.235666:0:43677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.235676:0:43677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.235687:0:43677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130461.235735:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.235832:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130461.235920:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893440 00000100:00100000:1.0:1789130461.235930:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893440 00000100:00100000:1.0:1789130461.235991:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789130461.236004:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+18:43677:x1876037626893440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130461.236022:0:43673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789130461.236037:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306840 going to sleep for 11 seconds 00010000:00010000:1.0:1789130461.236040:0:43673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4bac3e000/0x5c74554e47ceba71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ceba6a expref: -99 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.236069:0:43673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4bac3e000/0x5c74554e47ceba71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ceba6a expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.237476:0:43673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4bac3e000/0x5c74554e47ceba71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ceba6a expref: 19 pid: 43673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.237490:0:43673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e000, rc 0) 00000100:00100000:1.0:1789130461.237595:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626893440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1592us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.237619:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789130461.239079:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130461.239115:0:43677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba71 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.239130:0:43677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ceba71 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130461.239243:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.239314:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130461.239366:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130461.239534:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893568 00000100:00100000:1.0:1789130461.239542:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893568 00000100:00100000:1.0:1789130461.239594:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789130461.239626:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626893568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130461.242005:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626893568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2389us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.242020:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130461.242024:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789130461.242091:0:43677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.242162:0:43677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130461.242193:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893696 00000100:00100000:1.0:1789130461.242199:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893696 00000100:00100000:3.0:1789130461.242206:0:43677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130461.242256:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789130461.242265:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626893696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130461.243007:0:43677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:43677:1876037626893696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130461.243276:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:43677:x1876037626893696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1010us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130461.243285:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000040:00080000:3.0:1789130461.244024:0:45810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789130461.244370:0:43677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789130461.244403:0:43677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130461.244419:0:43677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba71 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.244433:0:43677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b390c35600/0x5c74554e47ceba6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ceba71 expref: -99 pid: 43677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130461.310991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.311578:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605130880 00000100:00100000:3.0:1789130461.311589:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605130880 00000100:00100000:3.0:1789130461.311679:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130461.311692:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+31:45259:x1876037605130880:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130461.311734:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.311765:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba78 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6f1 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.311962:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.311981:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.311998:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.312016:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.312024:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.312030:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315236:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceba8d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315255:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceba8d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315265:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceba8d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130461.315276:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789130461.315304:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315313:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315319:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315325:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.315330:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315338:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315353:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130461.315356:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.315362:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315369:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47ceba7f lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130461.315386:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c5ef66f0 reply state 00000000d6d87b38 transno 34359738389 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130461.315397:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130461.315448:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47ceba78 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6f1 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315462:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceba8d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6f1 expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.315476:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130461.315478:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789130461.315481:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34e00, rc 0) 00000100:00100000:3.0:1789130461.315587:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:45259:x1876037605130880:12345-192.168.201.39@tcp:101:dd.0 Request processed in 3898us (4614us total) trans 34359738389 rc 0/0 00000100:00100000:3.0:1789130461.315599:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00010000:00010000:1.0:1789130461.318300:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318329:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318338:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318344:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130461.318350:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318358:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318377:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0xd15934bc (ffff90b488939400) 00010000:00010000:1.0:1789130461.318380:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130461.318386:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.318396:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47ceba86 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130461.319103:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789130461.339198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.339527:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605131136 00000100:00100000:2.0:1789130461.339542:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605131136 00000100:00100000:2.0:1789130461.339635:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130461.339658:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:45259:x1876037605131136:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130461.340383:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:45259:x1876037605131136:12345-192.168.201.39@tcp:35:dd.0 Request processed in 735us (1199us total) trans 34359738390 rc 0/0 00000100:00100000:2.0:1789130461.340390:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789130461.451940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.454969:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605131392 00000100:00100000:2.0:1789130461.454995:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605131392 00000100:00100000:2.0:1789130461.455118:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789130461.455131:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:45269:x1876037605131392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130461.455167:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130461.455205:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceba9b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6f8 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130461.455385:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789130461.456057:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceba9b lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6f8 expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.456777:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130461.456783:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130461.456791:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47ceba9b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6f8 expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.456813:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130461.458486:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:45269:x1876037605131392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3343us (6545us total) trans 34359738391 rc 301/301 00000100:00100000:2.0:1789130461.458503:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:3.0:1789130461.463134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130461.463244:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605131648 00000100:00100000:0.0:1789130461.463258:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605131648 00000100:00100000:0.0:1789130461.463369:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789130461.463382:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:45269:x1876037605131648:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130461.463873:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:45269:x1876037605131648:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 492us (821us total) trans 34359738392 rc 0/0 00000100:00100000:0.0:1789130461.464273:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789130461.545568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.545728:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605131776 00000100:00100000:3.0:1789130461.545738:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605131776 00000100:00100000:3.0:1789130461.545808:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789130461.545819:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:45275:x1876037605131776:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130461.545846:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.545873:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac6ff expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.545945:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.545960:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.545973:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130461.546033:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789130461.546036:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130461.546060:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.546085:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ff expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.546104:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ff expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.546112:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130461.546115:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130461.546119:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34400, rc 0) 00000100:00100000:3.0:1789130461.546179:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:45275:x1876037605131776:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 362us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.546187:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789130461.548805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130461.548898:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605131904 00000100:00100000:0.0:1789130461.548909:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605131904 00000100:00100000:0.0:1789130461.548970:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1789130461.548981:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+37:45275:x1876037605131904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130461.549005:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130461.549026:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebab7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac706 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549090:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549104:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549116:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130461.549171:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789130461.549176:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130461.549198:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549223:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebab7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac706 expref: 39 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549239:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac706 expref: 38 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130461.549247:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130461.549262:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130461.549266:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130461.549324:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:45275:x1876037605131904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 345us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130461.549332:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789130461.560552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.560767:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605132032 00000100:00100000:3.0:1789130461.560779:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605132032 00000100:00100000:3.0:1789130461.560860:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130461.560872:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:45275:x1876037605132032:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130461.560896:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.560920:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebac5 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac70d expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.560994:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561009:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561026:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130461.561067:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789130461.561072:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130461.561090:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561103:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561127:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebac5 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac70d expref: 40 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561144:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac70d expref: 39 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.561153:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130461.561156:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130461.561160:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c35e00, rc 0) 00000100:00100000:3.0:1789130461.561228:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:45275:x1876037605132032:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 358us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.561236:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130461.575464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130461.575557:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605132288 00000100:00100000:0.0:1789130461.575567:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605132288 00000100:00100000:0.0:1789130461.575796:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1789130461.575875:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:45275:x1876037605132288:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130461.575903:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.575927:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebad3 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac714 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.576064:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebada lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.576081:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebada lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.576093:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebada lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130461.576105:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789130461.576238:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebad3 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac714 expref: 42 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.576260:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebada lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac714 expref: 41 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.576269:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130461.576272:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130461.576276:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b390c34600, rc 0) 00000100:00100000:3.0:1789130461.576355:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+41:45275:x1876037605132288:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 549us (901us total) trans 34359738393 rc 0/0 00000100:00100000:3.0:1789130461.576363:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789130461.583239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130461.583292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.583590:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605132672 00000100:00100000:2.0:1789130461.583629:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605132672 00000100:00100000:2.0:1789130461.583699:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130461.583711:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+41:45275:x1876037605132672:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130461.583975:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+42:45275:x1876037605132672:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 266us (682us total) trans 34359738394 rc 0/0 00000100:00100000:2.0:1789130461.583984:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789130461.585455:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605132544 00000100:00100000:3.0:1789130461.585467:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605132544 00000100:00100000:3.0:1789130461.585548:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789130461.585559:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+42:2369:x1876037605132544:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130461.585575:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130461.585622:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebada lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac714 expref: 42 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.585643:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130461.585648:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130461.585707:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+41:2369:x1876037605132544:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 150us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.585726:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:1.0:1789130461.643778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.643970:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605132928 00000100:00100000:3.0:1789130461.643981:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605132928 00000100:00100000:3.0:1789130461.644055:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789130461.644065:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+41:45276:x1876037605132928:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130461.644139:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789130461.644168:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35e00/0x5c74554e47cebacc lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac70d expref: 41 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644194:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34e00/0x5c74554e47ceba8d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6f1 expref: 40 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644205:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130461.644222:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebabe lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac706 expref: 39 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644231:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130461.644234:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130461.644561:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644581:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644590:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644785:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644793:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644800:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644903:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644911:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.644918:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645573:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645584:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645591:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645640:0:43680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645647:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645653:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645684:0:43680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130461.645705:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645712:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645733:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645738:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.645742:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645749:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645759:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130461.645761:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130461.645765:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645775:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34200/0x5c74554e47cebaf6 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645792:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645798:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645804:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645810:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.645813:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645818:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645826:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130461.645829:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.645831:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.645837:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34600/0x5c74554e47cebae8 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130461.645846:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000df4fa3b reply state 00000000e5d60fd9 transno 34359738395 ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130461.645855:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130461.645955:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+40:45276:x1876037605132928:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1888us (2184us total) trans 34359738395 rc 0/0 00000100:00100000:3.0:1789130461.645963:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:2.0:1789130461.646118:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130461.646125:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.646183:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130461.646187:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.646193:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.646203:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff90b488939400) 00010000:00010000:2.0:1789130461.646205:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130461.646208:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.646213:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cebafd lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.646229:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130461.646231:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130461.646232:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130461.652203:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652221:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652229:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652235:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b390c34800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130461.652240:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652248:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652275:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0xd15934bc (ffff90b488939600) 00010000:00010000:3.0:1789130461.652278:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130461.652283:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.652290:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34800/0x5c74554e47cebaef lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x3:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.748403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.750394:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605133056 00000100:00100000:3.0:1789130461.750413:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605133056 00000100:00100000:3.0:1789130461.750509:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130461.750522:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:45282:x1876037605133056:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130461.750561:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.750592:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cebb04 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac71b expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751881:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751908:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751924:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751945:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751953:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.751961:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752220:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752241:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752254:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130461.752291:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000004:00200000:2.0:1789130461.752295:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130461.752321:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752340:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752347:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752354:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752361:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130461.752364:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752372:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752384:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130461.752387:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130461.752391:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752398:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cebb0b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752412:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752418:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752424:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752430:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130461.752433:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752439:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752447:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b488939600) 00010000:00010000:2.0:1789130461.752449:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130461.752452:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752458:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cebb12 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752496:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cebb04 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac71b expref: 41 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752511:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac71b expref: 40 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.752519:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b488939200) 00010000:00010000:2.0:1789130461.752521:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130461.752523:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:2.0:1789130461.752646:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+40:45282:x1876037605133056:12345-192.168.201.39@tcp:101:dd.0 Request processed in 2082us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130461.752656:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789130461.759831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130461.759916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.760210:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605133184 00000100:00100000:3.0:1789130461.760223:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605133184 00000100:00100000:3.0:1789130461.760322:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1789130461.760335:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+40:2367:x1876037605133184:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130461.760367:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130461.760405:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb19 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac71b expref: 40 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.760438:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130461.760444:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130461.760542:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:2367:x1876037605133184:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 209us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.760551:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789130461.761322:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605133440 00000100:00100000:1.0:1789130461.761334:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605133440 00000100:00100000:1.0:1789130461.761400:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:1.0:1789130461.761412:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+39:45282:x1876037605133440:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130461.761440:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130461.761442:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130461.761476:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c35c00/0x5c74554e47ceb9ad lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6c7 expref: 39 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761495:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b488939200) 00010000:00010000:1.0:1789130461.761507:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130461.761526:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cebb20 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac722 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761743:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761760:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761778:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761793:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761800:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.761807:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130461.762463:0:45555:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0xd1:0x0], count =17 00000004:00080000:1.0:1789130461.762473:0:45555:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0xd1:0x0]+17 in llog 00000004:00080000:1.0:1789130461.762489:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe2:0x0], index 0: 0 00010000:00010000:1.0:1789130461.762754:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cebb35 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762766:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cebb35 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762777:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cebb35 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762824:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762832:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762840:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762848:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130461.762854:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762862:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762875:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130461.762878:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130461.762884:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762890:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cebb27 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130461.762906:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f7590f20 reply state 000000002fd0557f transno 34359738396 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130461.762917:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130461.762958:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cebb20 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac722 expref: 41 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762978:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cebb35 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac722 expref: 40 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.762985:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789130461.762988:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130461.762990:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130461.763103:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+41:45282:x1876037605133440:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1692us (3185us total) trans 34359738396 rc 0/0 00000100:00100000:1.0:1789130461.763113:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130461.772448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130461.772978:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605133568 00000100:00100000:3.0:1789130461.772992:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605133568 00000100:00100000:3.0:1789130461.773101:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789130461.773117:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:45282:x1876037605133568:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130461.773145:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130461.773175:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac729 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130461.773212:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130461.773243:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe2:0x0].0x0 since=1624s v=(0 0) 00010000:00010000:3.0:1789130461.773249:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130461.773262:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.773286:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130461.773304:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:3.0:1789130461.773391:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:45282:x1876037605133568:12345-192.168.201.39@tcp:101:dd.0 Request processed in 279us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130461.773404:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00080000:2.0:1789130461.773501:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130461.774251:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774266:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774275:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774283:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130461.774289:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774299:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774320:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0xeab58702 (ffff90b4909bd100) 00010000:00010000:1.0:1789130461.774324:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130461.774330:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130461.774440:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebb2e lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130461.779217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.779471:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605133824 00000100:00100000:2.0:1789130461.779485:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605133824 00000100:00100000:2.0:1789130461.779562:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130461.779574:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+40:45282:x1876037605133824:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130461.780407:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+41:45282:x1876037605133824:12345-192.168.201.39@tcp:35:dd.0 Request processed in 829us (1200us total) trans 34359738397 rc 0/0 00000100:00100000:2.0:1789130461.780419:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00010000:00010000:3.0:1789130461.831140:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130461.951292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.951424:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605134080 00000100:00100000:2.0:1789130461.951438:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605134080 00000100:00100000:2.0:1789130461.951523:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:2.0:1789130461.951536:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+41:45292:x1876037605134080:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130461.951571:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130461.951651:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb4a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac730 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951787:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951809:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951827:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951847:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951855:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.951868:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130461.952047:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00010000:00010000:2.0:1789130461.952180:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952189:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952198:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952204:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130461.952208:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952216:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952232:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130461.952236:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130461.952241:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952249:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb51 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952268:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952278:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952284:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952288:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130461.952291:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952296:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952303:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b48a1fd100) 00010000:00010000:2.0:1789130461.952305:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130461.952308:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952313:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb58 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952365:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb4a lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac730 expref: 43 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952377:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130461.952379:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130461.952383:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb4a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac730 expref: 43 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130461.952399:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130461.952491:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+42:45292:x1876037605134080:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 957us (1216us total) trans 34359738398 rc 301/301 00000100:00100000:2.0:1789130461.952500:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130461.977386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130461.977580:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605134336 00000100:00100000:2.0:1789130461.977596:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605134336 00000100:00100000:2.0:1789130461.977705:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130461.977727:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+42:45292:x1876037605134336:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130461.978134:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:45292:x1876037605134336:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 408us (4196us total) trans 34359738399 rc 0/0 00000100:00100000:2.0:1789130461.978145:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789130462.019764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.019905:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605134464 00000100:00100000:0.0:1789130462.019921:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605134464 00000100:00100000:0.0:1789130462.020025:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789130462.020039:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+43:45293:x1876037605134464:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1789130462.020073:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130462.020102:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebb66 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac737 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020193:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020221:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020236:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020255:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020263:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020269:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020410:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020418:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020426:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130462.020463:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000004:00200000:0.0:1789130462.020467:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130462.020495:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020509:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020516:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020522:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020529:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130462.020534:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020541:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020555:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130462.020558:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130462.020563:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020571:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebb6d lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020591:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020598:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020660:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020666:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130462.020669:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020675:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020683:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x4f902bbd (ffff90b497c01200) 00010000:00010000:0.0:1789130462.020685:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130462.020689:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020695:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebb74 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x4f902bbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020748:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebb66 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac737 expref: 45 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020763:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac737 expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.020771:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130462.020773:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130462.020776:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2e00, rc 0) 00000100:00100000:0.0:1789130462.020862:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+44:45293:x1876037605134464:12345-192.168.201.39@tcp:101:rm.0 Request processed in 826us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130462.020871:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00080000:2.0:1789130462.020974:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130462.031946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.034880:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605134720 00000100:00100000:2.0:1789130462.034903:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605134720 00000100:00100000:2.0:1789130462.036173:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130462.036202:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+44:45293:x1876037605134720:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1789130462.036286:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130462.036324:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cebb35 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac722 expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036362:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:2.0:1789130462.036377:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130462.036409:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036431:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036443:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036461:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036469:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036476:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036655:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036673:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.036681:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130462.037470:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].2, 64 off8320 00000004:00080000:2.0:1789130462.037485:0:43681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1625134881677ns, next at 1626134878594ns, rc = 0 00010000:00010000:2.0:1789130462.037565:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037579:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037593:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037632:0:43681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037641:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037647:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037692:0:43681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130462.037734:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037742:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037749:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037755:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130462.037761:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037770:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037781:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130462.037785:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130462.037790:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037798:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebb90 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037819:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037826:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037833:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037839:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130462.037842:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037849:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037857:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130462.037860:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130462.037864:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.037870:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebb82 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130462.037882:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006f62ae5f reply state 000000000cc501c8 transno 34359738400 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130462.037900:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130462.038020:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+45:45293:x1876037605134720:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1827us (6086us total) trans 34359738400 rc 0/0 00000100:00100000:2.0:1789130462.038030:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00010000:00010000:3.0:1789130462.039439:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130462.039454:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.039467:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130462.039471:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.039481:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.039499:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:3.0:1789130462.039513:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130462.039520:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.039527:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebb97 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.039554:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130462.039556:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130462.039558:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130462.042364:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042390:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042399:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042407:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130462.042413:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042422:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042443:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0xeab58702 (ffff90b48a1fd100) 00010000:00010000:1.0:1789130462.042447:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130462.042452:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.042458:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebb89 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xeab58702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130462.135479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.135895:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605134976 00000100:00100000:3.0:1789130462.135910:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605134976 00000100:00100000:3.0:1789130462.135990:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789130462.136001:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+44:45299:x1876037605134976:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130462.136033:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130462.136059:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebb9e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac73e expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136259:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136277:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136290:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136308:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136314:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.136321:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137207:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebbb3 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137220:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebbb3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137230:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebbb3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130462.137244:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x9:0x0]: returning size 0 00010000:00010000:3.0:1789130462.137276:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137283:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137290:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137297:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130462.137301:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137309:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137324:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:3.0:1789130462.137327:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130462.137333:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137340:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebba5 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130462.137355:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b1426d8f reply state 00000000b8487052 transno 34359738401 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130462.137365:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130462.137405:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebb9e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac73e expref: 47 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137422:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebbb3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac73e expref: 46 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.137429:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130462.137433:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789130462.137435:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:3.0:1789130462.137528:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+47:45299:x1876037605134976:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1528us (2063us total) trans 34359738401 rc 0/0 00000100:00100000:3.0:1789130462.137537:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:2.0:1789130462.142598:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142675:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142684:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142690:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130462.142696:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142715:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142739:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0xd15934bc (ffff90b488939f00) 00010000:00010000:2.0:1789130462.142743:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130462.142749:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.142756:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cebbac lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130462.145934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.146209:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135232 00000100:00100000:2.0:1789130462.146222:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135232 00000100:00100000:2.0:1789130462.146293:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130462.146304:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+46:45299:x1876037605135232:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:2.0:1789130462.147360:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+47:45299:x1876037605135232:12345-192.168.201.39@tcp:35:dd.0 Request processed in 1050us (1433us total) trans 34359738402 rc 0/0 00000100:00100000:2.0:1789130462.147372:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789130462.233179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.233235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.233277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.233306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.233351:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.233386:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135872 00000100:00100000:1.0:1789130462.233399:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135872 00000100:00100000:1.0:1789130462.233482:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135488 00000100:00100000:1.0:1789130462.233486:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135488 00000100:00100000:1.0:1789130462.233501:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135744 00000100:00100000:1.0:1789130462.233504:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135744 00000100:00100000:1.0:1789130462.233529:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130462.233541:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135872:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130462.233690:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135872:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130462.233700:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789130462.233728:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789130462.233735:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605135488:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130462.233764:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605135488:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130462.233770:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789130462.233784:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130462.233903:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135616 00000100:00100000:2.0:1789130462.233908:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135616 00000100:00100000:2.0:1789130462.233955:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789130462.233963:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135616:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130462.233999:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135616:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130462.234005:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00080000:2.0:1789130462.234054:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130462.234060:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130462.234063:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130462.234341:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605135360 00000100:00100000:0.0:1789130462.234350:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605135360 00000100:00100000:1.0:1789130462.234434:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135744:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130462.234467:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605135744:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 677us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130462.234475:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1789130462.236051:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1789130462.236077:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605135360:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130462.236176:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605135360:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 111us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130462.236184:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130462.254485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.254595:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605136128 00000100:00100000:3.0:1789130462.254668:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605136128 00000100:00100000:3.0:1789130462.254747:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1789130462.254761:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+47:45309:x1876037605136128:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130462.254794:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130462.254825:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebbc1 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac745 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130462.254990:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00010000:00010000:3.0:1789130462.255150:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebbc1 lrc: 1/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac745 expref: 49 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.255168:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130462.255171:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130462.255177:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebbc1 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac745 expref: 49 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.255196:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130462.255282:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+48:45309:x1876037605136128:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 524us (812us total) trans 34359738403 rc 301/301 00000100:00100000:3.0:1789130462.255291:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130462.259386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.259991:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605136384 00000100:00100000:2.0:1789130462.260006:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605136384 00000100:00100000:2.0:1789130462.260072:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130462.260084:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+48:45309:x1876037605136384:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130462.261456:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+49:45309:x1876037605136384:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 572us (1284us total) trans 34359738404 rc 0/0 00000100:00100000:2.0:1789130462.261471:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130462.347184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.347308:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605136512 00000100:00100000:2.0:1789130462.347324:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605136512 00000100:00100000:2.0:1789130462.347422:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1789130462.347435:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+49:45315:x1876037605136512:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130462.347473:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130462.347502:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebbcf lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac74c expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347677:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347697:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347722:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130462.347815:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 512 00000004:00200000:2.0:1789130462.347820:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130462.347848:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347883:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebbcf lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac74c expref: 51 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347906:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac74c expref: 50 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.347915:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130462.347918:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130462.347922:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130462.348008:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+50:45315:x1876037605136512:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 576us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130462.348017:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130462.352544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.352646:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605136640 00000100:00100000:3.0:1789130462.352665:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605136640 00000100:00100000:3.0:1789130462.352745:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789130462.352757:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+50:45315:x1876037605136640:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130462.352784:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130462.352814:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebbdd lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac753 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.352889:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.352903:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.352914:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130462.352965:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x9:0x0]: returning size 0 00000004:00200000:3.0:1789130462.352970:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130462.352994:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.353007:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.353029:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebbdd lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac753 expref: 52 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.353046:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac753 expref: 51 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.353053:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130462.353056:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130462.353060:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:3.0:1789130462.353125:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+51:45315:x1876037605136640:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 372us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130462.353131:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1789130462.357596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.357954:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605136896 00000100:00100000:2.0:1789130462.357969:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605136896 00000100:00100000:2.0:1789130462.358039:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1789130462.358048:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+51:45315:x1876037605136896:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130462.358072:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130462.358095:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebbeb lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac75a expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.358207:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebbf2 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.358222:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebbf2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.358236:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebbf2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130462.358249:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1789130462.358415:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebbeb lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac75a expref: 54 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.358432:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebbf2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac75a expref: 53 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.358439:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939500) 00010000:00010000:2.0:1789130462.358442:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130462.358446:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130462.358516:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+53:45315:x1876037605136896:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 469us (935us total) trans 34359738405 rc 0/0 00000100:00100000:2.0:1789130462.358528:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130462.364435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.364591:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605137024 00000100:00100000:3.0:1789130462.364646:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605137024 00000100:00100000:3.0:1789130462.364751:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789130462.364764:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdaf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+53:2367:x1876037605137024:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130462.364788:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130462.364832:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebbf2 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac75a expref: 53 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.364857:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130462.364864:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130462.364934:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdaf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+52:2367:x1876037605137024:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 173us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130462.364943:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1789130462.368574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.368899:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605137280 00000100:00100000:0.0:1789130462.368912:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605137280 00000100:00100000:0.0:1789130462.368983:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130462.368996:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+52:45315:x1876037605137280:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130462.369354:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+53:45315:x1876037605137280:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 359us (794us total) trans 34359738406 rc 0/0 00000100:00100000:0.0:1789130462.369363:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130462.395083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.395185:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605137536 00000100:00100000:3.0:1789130462.395199:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605137536 00000100:00100000:3.0:1789130462.395275:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1789130462.395286:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+53:45316:x1876037605137536:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130462.395365:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789130462.395400:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebbe4 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac753 expref: 53 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395427:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebbb3 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac73e expref: 52 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395440:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939500) 00010000:00010000:3.0:1789130462.395460:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebbd6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac74c expref: 51 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395470:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:3.0:1789130462.395474:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130462.395516:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395531:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395544:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395560:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395567:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395574:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395774:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395783:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.395808:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396442:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396453:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396462:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396470:0:43680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396476:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396482:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396507:0:43680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130462.396532:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396538:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396545:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396551:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130462.396557:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396566:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396577:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130462.396581:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130462.396585:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396592:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebc0e lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396644:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396652:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396659:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396665:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130462.396668:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396675:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396684:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:3.0:1789130462.396686:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130462.396690:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.396697:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebc00 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130462.396720:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006863c61f reply state 00000000176ecae2 transno 34359738407 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130462.396731:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130462.396855:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+52:45316:x1876037605137536:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1567us (1785us total) trans 34359738407 rc 0/0 00000100:00100000:3.0:1789130462.396864:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00010000:00010000:1.0:1789130462.397840:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130462.397854:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.397870:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130462.397874:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.397883:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.397899:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130462.397902:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130462.397905:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.397911:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cebc15 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.397937:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130462.397938:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130462.397940:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130462.404101:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404126:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404136:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404143:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130462.404149:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404158:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404181:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0xd15934bc (ffff90b488939c00) 00010000:00010000:3.0:1789130462.404185:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130462.404191:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.404199:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc07 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0xd15934bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130462.486254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.486373:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605137792 00000100:00100000:2.0:1789130462.486388:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605137792 00000100:00100000:2.0:1789130462.486474:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789130462.486487:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+51:45322:x1876037605137792:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130462.486521:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130462.486525:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130462.486565:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b390c34400/0x5c74554e47cebab0 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ff expref: 51 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.486587:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130462.486593:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130462.486682:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebc1c lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac761 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130462.498214:0:43681:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 11432us 00010000:00010000:2.0:1789130462.526012:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526037:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526051:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526068:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526074:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526084:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526791:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebc31 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526801:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebc31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526810:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebc31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130462.526820:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 0 00010000:00010000:2.0:1789130462.526844:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526851:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526858:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526864:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130462.526868:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526875:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526887:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130462.526890:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130462.526896:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526902:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebc23 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130462.526915:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000087284755 reply state 000000003e73e921 transno 34359738408 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130462.526924:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130462.526963:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebc1c lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac761 expref: 53 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526977:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebc31 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac761 expref: 52 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.526985:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130462.526987:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789130462.526989:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130462.527067:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+53:45322:x1876037605137792:12345-192.168.201.39@tcp:101:dd.500 Request processed in 40583us (40828us total) trans 34359738408 rc 0/0 00000100:00100000:2.0:1789130462.527076:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130462.532253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.532401:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605138048 00000100:00100000:0.0:1789130462.532414:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605138048 00000100:00100000:0.0:1789130462.532490:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789130462.532502:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+53:45322:x1876037605138048:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:0.0:1789130462.533051:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+54:45322:x1876037605138048:12345-192.168.201.39@tcp:35:dd.500 Request processed in 548us (808us total) trans 34359738409 rc 0/0 00000100:00100000:0.0:1789130462.533061:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:2.0:1789130462.534915:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.534935:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.534944:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.534955:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130462.534960:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.534969:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.534990:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x13ae18cf (ffff90b48a1fd900) 00010000:00010000:2.0:1789130462.534993:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130462.534999:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130462.535006:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebc2a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130462.629959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130462.630203:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605138304 00000100:00100000:3.0:1789130462.630219:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605138304 00000100:00100000:3.0:1789130462.630306:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130462.630320:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+53:45332:x1876037605138304:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130462.630357:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130462.630385:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac768 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130462.630893:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789130462.631063:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac768 expref: 55 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.631082:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:3.0:1789130462.631085:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130462.631091:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebc3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac768 expref: 55 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.631110:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:3.0:1789130462.631198:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+54:45332:x1876037605138304:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 881us (1254us total) trans 34359738410 rc 301/301 00000100:00100000:3.0:1789130462.631206:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130462.634041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.634228:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605138560 00000100:00100000:0.0:1789130462.634243:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605138560 00000100:00100000:0.0:1789130462.634315:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130462.634326:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+54:45332:x1876037605138560:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130462.634745:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+55:45332:x1876037605138560:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 418us (715us total) trans 34359738411 rc 0/0 00000100:00100000:0.0:1789130462.634754:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130462.714002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.715253:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605138688 00000100:00100000:0.0:1789130462.715270:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605138688 00000100:00100000:0.0:1789130462.715358:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130462.715369:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+55:45338:x1876037605138688:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130462.715401:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130462.715425:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac76f expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715556:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715575:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715589:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130462.715778:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789130462.715783:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130462.715814:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715847:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac76f expref: 57 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715869:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac76f expref: 56 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.715880:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130462.715883:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130462.715888:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130462.715983:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+56:45338:x1876037605138688:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 615us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130462.715992:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130462.720027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.720166:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605138816 00000100:00100000:0.0:1789130462.720181:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605138816 00000100:00100000:0.0:1789130462.720273:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1789130462.720286:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+56:45338:x1876037605138816:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130462.720314:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130462.720342:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc5b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac776 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720432:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720450:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720464:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130462.720519:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 0 00000004:00200000:0.0:1789130462.720525:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130462.720551:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720565:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720595:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc5b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac776 expref: 58 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720641:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac776 expref: 57 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.720649:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130462.720653:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130462.720658:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130462.720753:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+57:45338:x1876037605138816:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 471us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130462.720761:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:3.0:1789130462.725732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.726098:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139072 00000100:00100000:0.0:1789130462.726111:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139072 00000100:00100000:0.0:1789130462.726190:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1789130462.726201:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+57:45338:x1876037605139072:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130462.726229:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130462.726256:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc69 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac77d expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.726398:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc70 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.726417:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc70 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.726430:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc70 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130462.726444:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 0 00010000:00010000:0.0:1789130462.727455:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc69 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac77d expref: 60 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.727486:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc70 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac77d expref: 59 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.727518:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130462.727522:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130462.727527:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130462.727663:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+59:45338:x1876037605139072:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1463us (1946us total) trans 34359738412 rc 0/0 00000100:00100000:0.0:1789130462.727673:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1789130462.730650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130462.730850:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139328 00000100:00100000:2.0:1789130462.730866:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139328 00000100:00100000:2.0:1789130462.730942:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130462.730955:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+59:45338:x1876037605139328:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130462.731284:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+60:45338:x1876037605139328:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 330us (651us total) trans 34359738413 rc 0/0 00000100:00100000:2.0:1789130462.731293:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130462.731521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130462.731580:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139456 00000100:00100000:1.0:1789130462.731586:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139456 00000100:00100000:1.0:1789130462.731664:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789130462.731673:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+60:2368:x1876037605139456:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130462.731711:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130462.731742:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc70 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac77d expref: 60 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.731763:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:1.0:1789130462.731775:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130462.731804:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+59:2368:x1876037605139456:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 133us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130462.731811:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789130462.754991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130462.755155:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139712 00000100:00100000:0.0:1789130462.755171:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139712 00000100:00100000:0.0:1789130462.755256:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130462.755269:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+59:45339:x1876037605139712:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789130462.755352:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789130462.755390:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebc62 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac776 expref: 59 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755413:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebc31 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac761 expref: 58 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755424:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130462.755444:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebc54 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac76f expref: 57 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755449:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130462.755452:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130462.755479:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755492:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755500:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755584:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755589:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755594:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755887:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755896:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.755902:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756470:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756479:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756486:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756496:0:45555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756501:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756750:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756772:0:45555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130462.756805:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756812:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756818:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756824:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130462.756830:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756838:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756851:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130462.756855:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789130462.756859:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756870:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebc8c lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756893:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756901:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756906:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756908:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130462.756911:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130462.756914:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756916:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.756920:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756923:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130462.756927:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756933:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756944:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff90b497c01300) 00010000:00010000:3.0:1789130462.756947:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130462.756951:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756956:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebc93 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.756973:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130462.756975:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130462.756977:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130462.757003:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130462.757005:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130462.757007:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130462.757012:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebc7e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130462.757021:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b0d8f036 reply state 000000001d11354e transno 34359738414 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130462.757028:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130462.757137:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+58:45339:x1876037605139712:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1867us (2158us total) trans 34359738414 rc 0/0 00000100:00100000:0.0:1789130462.757149:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:3.0:1789130462.764583:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764626:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764635:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764643:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130462.764650:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764658:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764681:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x13ae18cf (ffff90b497c01200) 00010000:00010000:3.0:1789130462.764684:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130462.764691:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130462.764709:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebc85 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1:0x0].0x13ae18cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130462.855015:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130462.987578:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626893824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130462.987749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130462.988075:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893824 00000100:00100000:3.0:1789130462.988086:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893824 00000100:00100000:3.0:1789130462.988185:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130462.988197:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626893824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789130462.988251:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789130462.988263:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130462.993345:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626893824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5128us (5574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130462.993369:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130462.993571:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626893824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130463.886822:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130464.112777:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738414 is committed 00000004:00080000:3.0:1789130464.112811:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1789130464.112873:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789130464.113173:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626893952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789130464.113284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130464.113732:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626893952 00000100:00100000:0.0:1789130464.113745:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626893952 00000100:00100000:0.0:1789130464.113834:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130464.113846:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626893952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789130464.113883:0:44793:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:226 count 1 00010000:00010000:0.0:1789130464.113922:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130464.113952:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 5 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130464.113964:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe2:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789130464.113969:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130464.113974:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130464.114011:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 5 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130464.114027:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 5 pid: 44365 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130464.114039:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:44793:1876037626894208:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130464.116378:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bfba1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130464.116436:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626894080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789130464.116531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789130464.116721:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130464.117889:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894080 00000100:00100000:3.0:1789130464.117905:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894080 00000100:00100000:3.0:1789130464.117991:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130464.118005:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626894080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130464.118051:0:44365:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:226 count 1 00010000:00010000:3.0:1789130464.118087:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.118116:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 5 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.118126:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe2:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789130464.118131:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130464.118137:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.118181:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 5 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.118197:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 5 pid: 44366 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130464.118215:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626894336:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130464.118300:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306900 going to sleep for 11 seconds 00000100:00080000:2.0:1789130464.118653:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130464.123145:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:44793:1876037626894208:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130464.123188:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130464.130665:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b388e14f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626894336:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130464.130719:0:44365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130464.131873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130464.131916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130464.131966:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139840 00000100:00100000:3.0:1789130464.131981:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139840 00010000:00010000:3.0:1789130464.132048:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130464.132081:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605139968 00000100:00100000:3.0:1789130464.132084:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605139968 00010000:00010000:3.0:1789130464.132099:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130464.132119:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789130464.132129:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605139840:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130464.132147:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130464.132152:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132165:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132194:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007afe5906/0x5c74554e47ceb9f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6dc expref: 6 pid: 44365 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132211:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130464.132216:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130464.132223:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132235:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132266:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130464.132332:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605139840:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 204us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130464.132340:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789130464.132359:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789130464.132365:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605139968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130464.132373:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130464.132377:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132387:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132402:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e11a904/0x5c74554e47cebb43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac729 expref: 6 pid: 44366 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132413:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130464.132415:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130464.132420:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132427:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132441:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130464.132456:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605139968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 92us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130464.132463:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00080000:3.0:1789130464.132480:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130464.132484:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789130464.132502:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132512:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132523:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132531:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.132550:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130464.133233:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626893952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19386us (19946us total) trans 34359738370 rc 0/0 00000100:00100000:3.0:1789130464.133245:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789130464.133310:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b390cef480/2, rc 0, transno 34359738370 00000100:00100000:2.0:1789130464.133326:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626893952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789130464.134001:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130464.134016:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134029:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130464.134034:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134046:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134067:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134075:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038e4aadd/0x5c74554e47cebc9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134099:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130464.134101:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130464.134102:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130464.134113:0:44365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134119:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134125:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134130:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.134145:0:44365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130464.136504:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626894080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18493us (19963us total) trans 34359738370 rc 0/0 00000100:00100000:3.0:1789130464.136524:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789130464.136579:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130464.136589:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.137152:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130464.137161:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.137176:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.137204:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.137213:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaff93df/0x5c74554e47cebca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130464.137247:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130464.137251:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130464.137257:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130464.137344:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b486f41680/2, rc 0, transno 34359738370 00000100:00100000:3.0:1789130464.137356:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626894080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789130464.901913:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130465.541836:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130465.541862:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626894464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130465.542004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130465.542068:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894464 00000100:00100000:3.0:1789130465.542075:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894464 00000100:00100000:3.0:1789130465.542116:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130465.542124:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626894464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130465.542160:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130465.542202:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626894464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130465.542210:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130465.542253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626894464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130465.542541:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626894592:0@lo:400:kworker.0 00000100:00100000:0.0:1789130465.542592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130465.542795:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130465.542801:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626894976:0@lo:400:kworker.0 00000100:00100000:0.0:1789130465.542828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130465.542936:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626895104:0@lo:400:kworker.0 00000100:00100000:0.0:1789130465.542956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130465.542999:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626894720:0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543025:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130465.543045:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130465.543049:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626894848:0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130465.543093:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894720 00000100:00100000:3.0:1789130465.543097:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894720 00000100:00100000:3.0:1789130465.543127:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130465.543134:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543168:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626894720:12345-0@lo:400:kworker.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130465.543174:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130465.543191:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894976 00000100:00100000:3.0:1789130465.543193:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894976 00000100:00100000:3.0:1789130465.543218:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895104 00000100:00100000:3.0:1789130465.543220:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895104 00000100:00100000:3.0:1789130465.543232:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894848 00000100:00100000:3.0:1789130465.543234:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894848 00000100:00100000:3.0:1789130465.543244:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789130465.543249:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543312:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626894976:12345-0@lo:400:kworker.0 Request processed in 62us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130465.543319:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789130465.543330:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130465.543336:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626895104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543362:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626895104:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130465.543368:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130465.543378:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130465.543384:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626894848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543412:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626894848:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130465.543417:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789130465.543437:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130465.543459:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626894848:0@lo:400:kworker.0 00000100:00100000:3.0:1789130465.543469:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626894720:0@lo:400:kworker.0 00000100:00100000:0.0:1789130465.543529:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626894976:0@lo:400:kworker.0 00000100:00100000:0.0:1789130465.543546:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626895104:0@lo:400:kworker.0 00000100:00100000:1.0:1789130465.546002:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626894592 00000100:00100000:1.0:1789130465.546022:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626894592 00000100:00100000:1.0:1789130465.546096:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789130465.546106:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130465.546200:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626894592:12345-0@lo:400:kworker.0 Request processed in 95us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130465.546207:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789130465.546266:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626894592:0@lo:400:kworker.0 00000001:00080000:0.0:1789130465.609373:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738370 is committed 00010000:00010000:0.0:1789130465.925812:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130466.950647:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130467.360267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130467.360473:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140352 00000100:00100000:2.0:1789130467.360483:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140352 00000100:00100000:2.0:1789130467.360538:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140864 00000100:00100000:2.0:1789130467.360542:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140864 00000100:00100000:2.0:1789130467.360557:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140480 00000100:00100000:2.0:1789130467.360560:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140480 00000100:00100000:2.0:1789130467.360586:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140736 00000100:00100000:2.0:1789130467.360589:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140736 00000100:00100000:2.0:1789130467.360640:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130467.360651:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605140352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.360723:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605140352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 74us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.360732:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130467.360749:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130467.360756:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140864:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.360781:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140864:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.360787:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130467.360798:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789130467.360805:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605140480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.360829:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605140480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.360835:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789130467.360847:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130467.360853:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.360874:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 21us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.360880:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130467.360896:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140608 00000100:00100000:2.0:1789130467.360900:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140608 00000100:00100000:0.0:1789130467.361284:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140096 00000100:00100000:0.0:1789130467.361291:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140096 00000100:00100000:0.0:1789130467.361329:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789130467.361337:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605140096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130467.361369:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605140096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130467.361376:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:2.0:1789130467.361849:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140224 00000100:00100000:2.0:1789130467.361855:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140224 00000100:00100000:2.0:1789130467.361880:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130467.361887:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.361931:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605140608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.361938:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130467.361951:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130467.361957:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605140224:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130467.361982:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605140224:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130467.361988:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00080000:2.0:1789130467.362191:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130467.362197:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130467.362199:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130467.973856:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130468.058432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130468.058685:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605140992 00000100:00100000:0.0:1789130468.058698:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605140992 00000100:00100000:0.0:1789130468.058780:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130468.058791:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:45214:x1876037605140992:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130468.058908:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:45214:x1876037605140992:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 118us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130468.058916:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130468.064809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130468.065236:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141248 00000100:00100000:0.0:1789130468.065248:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141248 00000100:00100000:0.0:1789130468.065366:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130468.065390:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:45214:x1876037605141248:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130468.065969:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:45214:x1876037605141248:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 590us (1168us total) trans 34359738415 rc 0/0 00000100:00100000:0.0:1789130468.065979:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789130468.113038:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626895232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130468.113119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130468.113367:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895232 00000100:00100000:0.0:1789130468.113375:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895232 00000100:00100000:0.0:1789130468.113447:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130468.113462:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626895232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130468.113499:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130468.113547:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626895232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130468.113563:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789130468.113674:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130468.113860:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626895232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130468.346805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130468.346924:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141376 00000100:00100000:2.0:1789130468.346934:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141376 00000100:00100000:2.0:1789130468.347000:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130468.347011:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:45779:x1876037605141376:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1789130468.347042:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130468.347065:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac784 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347128:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347142:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347158:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130468.347381:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130468.347385:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130468.347480:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347506:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 7 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347523:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 6 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130468.347532:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130468.347535:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130468.347538:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:2.0:1789130468.347661:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:45779:x1876037605141376:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 652us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130468.347668:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00010000:00010000:3.0:1789130469.001398:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130469.205231:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738370 is committed 00000001:00080000:3.0:1789130469.234480:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738415 is committed 00010000:00010000:0.0:1789130470.022793:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130470.534453:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789130470.667003:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626895488:0@lo:400:kworker.0 00000100:00100000:2.0:1789130470.667132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130470.667203:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626896000:0@lo:400:kworker.0 00000100:00100000:2.0:1789130470.667233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130470.667275:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130470.667282:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626895616:0@lo:400:kworker.0 00000100:00100000:2.0:1789130470.667305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130470.667346:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895488 00000100:00100000:2.0:1789130470.667356:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895488 00000100:00100000:2.0:1789130470.667448:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895616 00000100:00100000:2.0:1789130470.667452:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895616 00000100:00100000:2.0:1789130470.667485:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130470.667498:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626895488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130470.667511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626896128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130470.667658:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626895744:0@lo:400:kworker.0 00000100:00100000:3.0:1789130470.667740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626895360:0@lo:400:kworker.0 00000100:00100000:2.0:1789130470.669126:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626895488:12345-0@lo:400:kworker.0 Request processed in 1622us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130470.669143:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130470.669185:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130470.669202:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130470.669285:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626895616:12345-0@lo:400:kworker.0 Request processed in 92us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130470.669292:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130470.669326:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626896000 00000100:00100000:2.0:1789130470.669334:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626896000 00000100:00100000:1.0:1789130470.669950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130470.670312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130470.670375:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626896128 00000100:00100000:0.0:1789130470.670381:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626896128 00000100:00100000:0.0:1789130470.670425:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130470.670434:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626896128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130470.670482:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130470.670541:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626896128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130470.670549:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130470.670591:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895744 00000100:00100000:0.0:1789130470.670596:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895744 00000100:00100000:0.0:1789130470.670644:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130470.670651:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626896000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130470.670689:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626896000:12345-0@lo:400:kworker.0 Request processed in 39us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130470.670695:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130470.670710:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130470.670715:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626895744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130470.670750:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626895744:12345-0@lo:400:kworker.0 Request processed in 35us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130470.670756:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130470.670827:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626895744:0@lo:400:kworker.0 00000100:00100000:0.0:1789130470.670881:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738370 gen 2 00000004:00080000:0.0:1789130470.670888:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b390cef480, transno 34359738370 00000100:00100000:0.0:1789130470.670910:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626896128:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789130470.671364:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130470.671372:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130470.671375:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130470.672839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130470.679913:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626895616:0@lo:400:kworker.0 00000100:00100000:1.0:1789130470.679933:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738370 gen 2 00000004:00080000:1.0:1789130470.679939:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b486f41680, transno 34359738370 00000100:00100000:1.0:1789130470.679954:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626895488:0@lo:400:kworker.0 00000100:00100000:1.0:1789130470.679968:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626896000:0@lo:400:kworker.0 00000100:00100000:3.0:1789130470.681027:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626895872:0@lo:400:kworker.0 00000100:00100000:3.0:1789130470.681129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130470.681436:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895872 00000100:00100000:1.0:1789130470.681447:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895872 00000100:00100000:1.0:1789130470.681505:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130470.681515:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626895872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130470.681729:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626895872:12345-0@lo:400:kworker.0 Request processed in 204us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130470.681736:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789130470.681804:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130470.684086:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626895872:0@lo:400:kworker.0 00000100:00100000:0.0:1789130470.689513:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626895360 00000100:00100000:0.0:1789130470.689537:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626895360 00000100:00100000:0.0:1789130470.689767:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789130470.689782:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130470.689941:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626895360:12345-0@lo:400:kworker.0 Request processed in 163us (17109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130470.689949:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789130470.690097:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626895360:0@lo:400:kworker.0 00010000:00010000:3.0:1789130471.046036:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130472.073959:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789130472.357372:0:46003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 14: Revocation of the layout lock should detach the file automatically ========================================================== 08:41:10 (1789130470) 00000100:00100000:3.0:1789130472.505566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.505782:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142016 00000100:00100000:3.0:1789130472.505804:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142016 00000100:00100000:3.0:1789130472.505862:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141632 00000100:00100000:3.0:1789130472.505866:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141632 00000100:00100000:3.0:1789130472.505890:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130472.505900:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2367:x1876037605142016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130472.505972:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2367:x1876037605142016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130472.505980:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130472.505998:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789130472.506004:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:2367:x1876037605141632:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130472.506032:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:2367:x1876037605141632:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130472.506038:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00080000:3.0:1789130472.506055:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130472.506339:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141760 00000100:00100000:2.0:1789130472.506344:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141760 00000100:00100000:2.0:1789130472.506386:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141888 00000100:00100000:2.0:1789130472.506390:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141888 00000100:00100000:2.0:1789130472.506404:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142144 00000100:00100000:2.0:1789130472.506406:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142144 00000100:00100000:2.0:1789130472.506420:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130472.506427:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605141760:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130472.506464:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605141760:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130472.506470:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130472.506486:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130472.506492:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605141888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130472.506511:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605141888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130472.506517:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130472.506542:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130472.506549:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2366:x1876037605142144:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1789130472.506565:0:44793:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ceb7c3 00000100:00080000:2.0:1789130472.506581:0:44793:0:(import.c:65:import_set_state_nolock()) ffff90b489cb1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130472.506647:0:44793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738370 00000100:00100000:2.0:1789130472.506907:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+2:2366:x1876037605142144:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 358us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130472.506914:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00080000:3.0:1789130472.510777:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130472.510789:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130472.510801:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130472.511892:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605141504 00000100:00100000:1.0:1789130472.511904:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605141504 00000100:00100000:1.0:1789130472.511978:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789130472.511988:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605141504:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130472.512068:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605141504:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130472.512076:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:3.0:1789130472.518713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.518750:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142272 00000100:00100000:3.0:1789130472.518760:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142272 00000100:00100000:3.0:1789130472.518837:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1789130472.518848:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2366:x1876037605142272:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:3.0:1789130472.518881:0:44793:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ceb7ca 00000100:00080000:3.0:1789130472.518897:0:44793:0:(import.c:65:import_set_state_nolock()) ffff90b48574d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130472.518936:0:44793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 8, last_transno is 34359738370 00000100:00100000:3.0:1789130472.520128:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+2:2366:x1876037605142272:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 1277us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130472.520140:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00080000:3.0:1789130472.521325:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789130472.521367:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130472.794046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130472.795200:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142528 00000100:00100000:2.0:1789130472.795222:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142528 00000100:00100000:2.0:1789130472.795289:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:2.0:1789130472.795300:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:45977:x1876037605142528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130472.795322:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130472.795341:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac78b expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795412:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795428:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795440:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795452:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795457:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795471:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795862:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebccb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795869:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebccb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.795874:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebccb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130472.795881:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789130472.796038:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796047:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796054:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796060:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130472.796064:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796073:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796083:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130472.796085:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130472.796089:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796093:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebcbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796103:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796106:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796110:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796113:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130472.796115:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796118:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796121:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b48a1fd400) 00010000:00010000:2.0:1789130472.796123:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130472.796124:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796131:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebcc4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796451:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac78b expref: 14 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796462:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebccb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac78b expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.796467:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:2.0:1789130472.796469:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130472.796471:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130472.796548:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:45977:x1876037605142528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1250us (2510us total) trans 34359738416 rc 0/0 00000100:00100000:2.0:1789130472.796554:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789130472.802432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130472.802534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130472.802628:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142784 00000100:00100000:0.0:1789130472.802639:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142784 00000100:00100000:0.0:1789130472.802699:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789130472.802709:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:45977:x1876037605142784:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789130472.803132:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:45977:x1876037605142784:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 423us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130472.803141:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:1.0:1789130472.804760:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605142656 00000100:00100000:1.0:1789130472.804775:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605142656 00000100:00100000:1.0:1789130472.804889:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130472.804901:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2368:x1876037605142656:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130472.804927:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130472.804954:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebccb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac78b expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130472.804976:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:1.0:1789130472.804983:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130472.805042:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2368:x1876037605142656:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 144us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130472.805050:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789130472.951324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130472.951478:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143040 00000100:00100000:2.0:1789130472.951488:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143040 00000100:00100000:2.0:1789130472.951571:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:2.0:1789130472.951581:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:45992:x1876037605143040:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:2.0:1789130472.951665:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130472.951695:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47ceb8b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac681 expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.951714:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130472.951719:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130472.952023:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.952039:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.952047:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.952081:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.952094:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 5 pid: 43680 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130472.952108:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626896256:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130472.952328:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789130472.956220:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626896256:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130472.956254:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130472.956787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130472.957541:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143168 00000100:00100000:2.0:1789130472.957551:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143168 00010000:00010000:2.0:1789130472.957588:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 6 pid: 43680 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130472.957893:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789130472.957904:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605143168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130472.957919:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130472.957928:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 6 pid: 43680 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.957942:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 6 pid: 43680 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.957964:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebcaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac784 expref: 6 pid: 43680 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.957978:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130472.957983:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.957992:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.958000:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130472.958032:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130472.958096:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605143168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130472.958104:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00010000:00010000:0.0:1789130472.958171:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.958180:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.958203:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.958222:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.958230:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130472.959382:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 512 00010000:00010000:0.0:1789130472.959397:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959407:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959415:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959422:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130472.959426:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959434:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959447:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:0.0:1789130472.959450:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130472.959454:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130472.959461:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebcd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130472.959482:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006b2fe5ea reply state 000000000bc539b2 transno 34359738417 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130472.959490:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130472.959593:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:45992:x1876037605143040:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 8012us (8277us total) trans 34359738417 rc 0/0 00000100:00100000:0.0:1789130472.959638:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00010000:00010000:3.0:1789130472.964500:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964567:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964575:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964582:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130472.964587:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964595:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964639:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xad739384 (ffff90b497c01300) 00010000:00010000:3.0:1789130472.964643:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130472.964648:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130472.964654:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebce0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130473.011442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130473.011556:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143296 00000100:00100000:0.0:1789130473.011567:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143296 00000100:00100000:0.0:1789130473.011712:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1789130473.011725:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:45998:x1876037605143296:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130473.011750:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130473.011775:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac792 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.011856:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.011870:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.011891:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130473.011952:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130473.011956:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130473.012006:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.012034:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac792 expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.012054:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac792 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.012065:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130473.012069:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130473.012073:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130473.012142:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:45998:x1876037605143296:12345-192.168.201.39@tcp:101:bash.0 Request processed in 420us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.012150:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1789130473.017743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.017817:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143424 00000100:00100000:3.0:1789130473.017827:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143424 00000100:00100000:3.0:1789130473.017887:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130473.017898:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:45998:x1876037605143424:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130473.017920:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130473.017940:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebcf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac799 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018004:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018015:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018024:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018033:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018037:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018041:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018151:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018159:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018166:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130473.018197:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 512 00000004:00200000:3.0:1789130473.018201:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130473.018230:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018247:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018253:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018261:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018266:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130473.018271:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018278:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018290:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130473.018293:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130473.018298:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018304:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebcfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018317:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018323:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018328:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018334:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130473.018336:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018342:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018349:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xad739384 (ffff90b488939b00) 00010000:00010000:3.0:1789130473.018351:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130473.018354:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018360:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018391:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cebcf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac799 expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018404:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac799 expref: 14 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.018411:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b488939a00) 00010000:00010000:3.0:1789130473.018413:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130473.018416:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:3.0:1789130473.018479:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:45998:x1876037605143424:12345-192.168.201.39@tcp:101:bash.0 Request processed in 582us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.018487:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130473.028136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.028341:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143680 00000100:00100000:2.0:1789130473.028351:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143680 00000100:00100000:2.0:1789130473.028415:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789130473.028425:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:45998:x1876037605143680:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130473.028445:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130473.028475:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd11 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7a0 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028650:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028665:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028677:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028693:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028700:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.028707:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130473.029295:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe3:0x0], index 1: 0 00010000:00010000:2.0:1789130473.029463:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029474:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029483:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029529:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029541:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029548:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029554:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130473.029559:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029567:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029578:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b488939a00) 00010000:00010000:2.0:1789130473.029582:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130473.029587:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029594:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd18 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130473.029640:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000094af5a30 reply state 0000000057aa0230 transno 34359738418 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.029649:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130473.029679:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd11 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029694:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 16 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.029706:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130473.029709:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130473.029711:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130473.029786:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:45998:x1876037605143680:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1361us (1656us total) trans 34359738418 rc 0/0 00000100:00100000:2.0:1789130473.029794:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:3.0:1789130473.032825:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032842:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032850:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032856:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130473.032861:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032869:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032886:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b48a1fd400) 00010000:00010000:3.0:1789130473.032890:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130473.032895:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.032901:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebd1f lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130473.041269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130473.041351:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143808 00000100:00100000:0.0:1789130473.041359:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143808 00000100:00100000:0.0:1789130473.041422:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789130473.041433:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605143808:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130473.041452:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130473.041477:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7a7 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130473.041506:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789130473.041538:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=1636s v=(0 0) 00010000:00010000:0.0:1789130473.041544:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130473.041553:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 6 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.041572:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 6 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.041586:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130473.041661:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605143808:12345-192.168.201.39@tcp:101:bash.0 Request processed in 230us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.041668:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130473.050596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.050694:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605143936 00000100:00100000:3.0:1789130473.050703:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605143936 00000100:00100000:3.0:1789130473.050746:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130473.050753:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:45998:x1876037605143936:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130473.050767:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130473.050783:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7ae expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.050820:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.050829:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130473.050834:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130473.050839:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.050871:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.050885:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 1736 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130473.050899:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626896384:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130473.050971:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b382b13cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130473.057929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.058059:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626896384:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130473.058086:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.058103:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130473.058157:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:45998:x1876037605143936:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7404us (7570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.058166:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130473.058446:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605144064 00000100:00100000:2.0:1789130473.058452:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605144064 00010000:00010000:2.0:1789130473.058481:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 1736 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.058508:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130473.058524:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605144064:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130473.058539:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130473.058561:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 1736 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.058574:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 1736 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.058598:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47cebd34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a7 expref: 7 pid: 44366 timeout: 1736 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.059072:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130473.059076:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130473.059085:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.059095:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.059129:0:43666:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.059153:0:43666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626896512:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130473.059228:0:43666:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789130473.062927:0:43666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626896512:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130473.062962:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130473.063071:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605144064:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4546us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130473.063084:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789130473.067166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130473.067911:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605144320 00000100:00100000:1.0:1789130473.067921:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605144320 00000100:00100000:1.0:1789130473.068019:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789130473.068029:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:45998:x1876037605144320:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130473.073545:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:45998:x1876037605144320:12345-192.168.201.39@tcp:35:bash.0 Request processed in 5502us (6374us total) trans 34359738419 rc 0/0 00000100:00100000:1.0:1789130473.073562:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00010000:00010000:3.0:1789130473.094234:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130473.174531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.191751:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605144448 00000100:00100000:3.0:1789130473.191772:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605144448 00000100:00100000:3.0:1789130473.191851:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1789130473.191863:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:46004:x1876037605144448:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130473.191897:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130473.191925:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7b5 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192008:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192025:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192039:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130473.192099:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 512 00000004:00200000:3.0:1789130473.192103:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130473.192125:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192154:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7b5 expref: 19 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192175:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7b5 expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.192184:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b488939a00) 00010000:00010000:3.0:1789130473.192188:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130473.192193:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:3.0:1789130473.192286:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:46004:x1876037605144448:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 425us (18079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.192294:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130473.200998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.201091:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605144704 00000100:00100000:3.0:1789130473.201100:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605144704 00000100:00100000:3.0:1789130473.201159:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789130473.201170:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46004:x1876037605144704:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130473.201191:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130473.201222:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd50 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7bc expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.201342:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd57 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.201357:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd57 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.201370:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd57 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130473.201381:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00010000:00010000:3.0:1789130473.201529:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cebd50 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7bc expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.201548:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd57 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7bc expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.201562:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130473.201565:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130473.201569:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:3.0:1789130473.201687:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:46004:x1876037605144704:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 518us (701us total) trans 34359738420 rc 0/0 00000100:00100000:3.0:1789130473.201695:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130473.208413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.208633:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145088 00000100:00100000:3.0:1789130473.208647:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145088 00000100:00100000:3.0:1789130473.208782:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789130473.208794:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:2369:x1876037605145088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130473.208821:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130473.208848:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd57 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7bc expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.208866:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130473.208871:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130473.209305:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:2369:x1876037605145088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 141us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.209316:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789130473.215675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.215840:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605144960 00000100:00100000:3.0:1789130473.215851:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605144960 00000100:00100000:2.0:1789130473.218745:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130473.218766:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:46004:x1876037605144960:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130473.218796:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130473.218820:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd65 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7c3 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.220731:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.220755:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.220768:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130473.220781:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00010000:00010000:2.0:1789130473.221326:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd65 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7c3 expref: 22 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.221349:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7c3 expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.221359:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130473.221362:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130473.221366:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130473.221500:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:46004:x1876037605144960:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2741us (5833us total) trans 34359738421 rc 0/0 00000100:00100000:2.0:1789130473.221520:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130473.221712:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130473.221730:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626896640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130473.221781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130473.221866:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626896640 00000100:00100000:3.0:1789130473.221874:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626896640 00000100:00100000:3.0:1789130473.221950:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130473.221961:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626896640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130473.221994:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130473.222034:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626896640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.222041:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789130473.222058:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130473.222090:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626896640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130473.237080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130473.237173:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145216 00000100:00100000:1.0:1789130473.237184:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145216 00000100:00100000:1.0:1789130473.237255:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789130473.237267:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605145216:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789130473.237314:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.237335:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.237346:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130473.237350:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130473.237355:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.237404:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.237418:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 6 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130473.237433:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626896768:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130473.237526:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130473.249015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.249155:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145344 00000100:00100000:2.0:1789130473.249165:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145344 00002000:00100000:2.0:1789130473.249226:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe3:0x0] (0->14) req@ffff90b387aa1a40 x1876037605145344/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:189/0 lens 504/0 e 0 to 0 dl 1789130484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130473.249238:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa1a40 with x1876037605145344 ext(0->14) 00010000:00010000:2.0:1789130473.249250:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 7 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.249269:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 7 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130473.249277:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b387aa1a40 00000100:00100000:2.0:1789130473.249309:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130473.249320:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605145344:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789130473.249940:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605145344:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 618us (933us total) trans 34359738371 rc 0/0 00000100:00100000:2.0:1789130473.249950:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:2.0:1789130473.249958:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe3:0x0] (0->14) req@ffff90b387aa1a40 x1876037605145344/t34359738371(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:189/0 lens 504/448 e 0 to 0 dl 1789130484 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130473.249968:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa1a40 with x1876037605145344 ext(0->14) 00010000:00010000:2.0:1789130473.249975:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.249988:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130473.249996:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90b387aa1a40 00000100:00100000:0.0:1789130473.254398:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626896768:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130473.254435:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130473.256654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130473.256748:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145472 00000100:00100000:1.0:1789130473.256756:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145472 00010000:00010000:1.0:1789130473.256799:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130473.256924:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789130473.257390:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605145472:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130473.257407:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789130473.257432:0:43664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe3:0x0] updating lvb size from disk: 0 -> 15 00002000:00010000:1.0:1789130473.257434:0:43664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe3:0x0] updating lvb mtime from disk: 0 -> 1789130472 00002000:00010000:1.0:1789130473.257436:0:43664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe3:0x0] updating lvb atime from disk: 0 -> 1789130472 00002000:00010000:1.0:1789130473.257438:0:43664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe3:0x0] updating lvb ctime from disk: 0 -> 1789130472 00010000:00010000:1.0:1789130473.257445:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.257464:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.257488:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c030ea61/0x5c74554e47cebd3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ae expref: 9 pid: 44367 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.257505:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130473.257521:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130473.257527:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.257537:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130473.257569:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130473.257683:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605145472:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 749us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130473.257692:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:0.0:1789130473.258171:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258182:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258271:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258281:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258289:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258296:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130473.258300:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258313:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258327:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.258334:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cebd7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130473.258409:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605145216:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 21143us (21338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.258418:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130473.261903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.262023:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145728 00000100:00100000:2.0:1789130473.262034:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145728 00000100:00100000:2.0:1789130473.262088:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:2.0:1789130473.262099:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:46004:x1876037605145728:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1789130473.262165:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0xc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7c3 expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130473.263617:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738422 00000001:00080000:2.0:1789130473.263678:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738423 00000001:00080000:2.0:1789130473.272883:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738424 00010000:00010000:2.0:1789130473.272999:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.273022:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.273032:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.273074:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.273090:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 25 pid: 45555 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.273105:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626896896:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130473.273199:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130473.276787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.276960:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145856 00000100:00100000:3.0:1789130473.276978:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145856 00010000:00010000:3.0:1789130473.277045:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 26 pid: 45555 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130473.277107:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130473.277118:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605145856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130473.277147:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130473.277155:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 26 pid: 45555 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.277170:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 26 pid: 45555 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.277199:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130473.277204:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.277215:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.277224:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.277248:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130473.277334:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605145856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 217us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130473.277342:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:2.0:1789130473.278681:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebd26 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7a0 expref: 25 pid: 45555 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.278707:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626896896:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130473.278736:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.278747:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.278753:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130473.278908:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738425 00000001:00080000:2.0:1789130473.279095:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738426 00000100:00100000:2.0:1789130473.279199:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626897024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130473.279289:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130473.279324:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130473.279497:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626897024 00000100:00100000:1.0:1789130473.279521:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626897024 00000100:00100000:1.0:1789130473.279640:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130473.279654:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626897024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130473.279807:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626897024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 141us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130473.279820:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789130473.280219:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130473.280727:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626897024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130473.283074:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738427 00000100:00100000:2.0:1789130473.283173:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626897152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130473.284105:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130473.284146:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130473.284297:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626897152 00000100:00100000:1.0:1789130473.284312:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626897152 00000100:00100000:1.0:1789130473.284443:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130473.284467:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626897152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130473.284835:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626897152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 380us (731us total) trans 34359738372 rc 0/0 00000100:00100000:1.0:1789130473.284845:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130473.287024:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626897152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130473.287140:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738428 00010000:00010000:2.0:1789130473.290280:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290299:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290308:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290314:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130473.290320:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290328:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290346:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130473.290349:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130473.290353:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.290358:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebd81 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130473.290854:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130473.290963:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].3, 64 off8384 00000004:00080000:2.0:1789130473.290975:0:43683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1636388372283ns, next at 1637388369683ns, rc = 0 00000001:00080000:2.0:1789130473.290985:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738429 00010000:00010000:2.0:1789130473.291042:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130473.291045:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130473.291054:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebd6c lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7c3 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130473.291172:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:46004:x1876037605145728:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 29073us (29358us total) trans 34359738430 rc 0/0 00000100:00100000:2.0:1789130473.291182:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000020:00080000:2.0:1789130473.291187:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789130473.296132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130473.296340:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605145984 00000100:00100000:0.0:1789130473.296351:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605145984 00000100:00100000:0.0:1789130473.296421:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130473.296434:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:46004:x1876037605145984:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130473.296462:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130473.296486:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebd88 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7ca expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.296559:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebd88 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ca expref: 29 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.296574:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebd88 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ca expref: 29 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.296629:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130473.296632:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130473.296637:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130473.296703:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:46004:x1876037605145984:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 272us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.296710:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130473.306713:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130473.307037:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605146240 00000100:00100000:1.0:1789130473.307051:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605146240 00000100:00100000:1.0:1789130473.307142:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130473.307156:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:46004:x1876037605146240:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130473.307750:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:46004:x1876037605146240:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 593us (1049us total) trans 34359738431 rc 0/0 00000100:00100000:1.0:1789130473.307760:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130473.462987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130473.463102:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605146496 00000100:00100000:3.0:1789130473.463116:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605146496 00000100:00100000:3.0:1789130473.463206:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130473.463219:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+30:46014:x1876037605146496:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130473.463252:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130473.463294:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7d1 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130473.463468:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 512 00010000:00010000:3.0:1789130473.463679:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7d1 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.463696:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130473.463700:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130473.463706:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cebd8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7d1 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130473.463729:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:3.0:1789130473.464210:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46014:x1876037605146496:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 991us (1235us total) trans 34359738432 rc 301/301 00000100:00100000:3.0:1789130473.464219:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130473.470808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130473.476757:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605146624 00000100:00100000:0.0:1789130473.476782:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605146624 00000100:00100000:0.0:1789130473.476894:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1789130473.476908:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:46014:x1876037605146624:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130473.477016:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477037:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477053:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477073:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477080:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477087:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.477993:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478009:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478019:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130473.478079:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478095:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478102:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478110:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478117:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130473.478122:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478562:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478586:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b488939a00) 00010000:00010000:0.0:1789130473.478589:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130473.478597:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478727:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebd9d lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478747:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478754:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478760:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478766:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130473.478769:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478775:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478783:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b497c01800) 00010000:00010000:0.0:1789130473.478786:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130473.478953:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478962:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebda4 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478988:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.478994:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.479000:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.479005:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130473.479008:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.479014:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.479022:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130473.479024:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130473.479028:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.479034:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdab lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130473.479282:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:46014:x1876037605146624:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2370us (8491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.479295:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:1.0:1789130473.497725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.497840:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605146880 00000100:00100000:2.0:1789130473.497853:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605146880 00000100:00100000:2.0:1789130473.497933:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789130473.497948:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:46014:x1876037605146880:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130473.498970:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:46014:x1876037605146880:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1016us (1251us total) trans 34359738433 rc 0/0 00000100:00100000:2.0:1789130473.498983:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000040:00080000:2.0:1789130473.611048:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789130473.628043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.628175:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147008 00000100:00100000:2.0:1789130473.628188:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147008 00000100:00100000:2.0:1789130473.628282:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789130473.628295:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:44607:x1876037605147008:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130473.628317:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:2.0:1789130473.628349:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebcee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac792 expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628375:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130473.628398:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebd88 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ca expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628407:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130473.628418:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cebd49 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7b5 expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628431:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cebd0a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac799 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628439:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b488939a00) 00010000:00010000:2.0:1789130473.628711:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ceb817 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac650 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628730:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:2.0:1789130473.628745:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceb8f7 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac68f expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628755:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130473.628767:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebb7b lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac737 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628777:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130473.628787:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030000/0x5c74554e47ceba47 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac6ea expref: 25 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628863:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x3:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130473.628876:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ceb7fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac649 expref: 24 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.628884:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130473.628890:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130473.629009:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+23:44607:x1876037605147008:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 717us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130473.629019:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130473.735806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.735998:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147136 00000100:00100000:2.0:1789130473.736013:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147136 00000100:00100000:2.0:1789130473.736097:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130473.736110:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46027:x1876037605147136:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130473.736155:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130473.736189:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebdb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7d8 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736284:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736301:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736314:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130473.736398:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130473.736403:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130473.736464:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736578:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebdb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7d8 expref: 25 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736677:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7d8 expref: 24 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.736687:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130473.736690:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130473.736696:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130473.736848:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:46027:x1876037605147136:12345-192.168.201.39@tcp:101:cat.0 Request processed in 740us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130473.736857:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130473.743544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.743715:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147264 00000100:00100000:2.0:1789130473.743728:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147264 00000100:00100000:0.0:1789130473.743991:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789130473.744007:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+24:46027:x1876037605147264:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789130473.744035:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130473.744062:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7df expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744153:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744171:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744187:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744205:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744212:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744218:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744382:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744391:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744399:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130473.744434:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 512 00000004:00200000:0.0:1789130473.744438:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130473.744484:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744510:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744517:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744529:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744535:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130473.744540:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744549:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744562:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:0.0:1789130473.744566:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130473.744571:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744578:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebdc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744593:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744672:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744680:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744685:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130473.744690:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744699:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744707:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xad739384 (ffff90b497c01800) 00010000:00010000:0.0:1789130473.744709:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130473.744712:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744717:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744760:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebdc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7df expref: 26 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744773:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7df expref: 25 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.744780:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130473.744782:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130473.744784:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130473.745702:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:46027:x1876037605147264:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1690us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.745716:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130473.759947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.760147:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147520 00000100:00100000:2.0:1789130473.760160:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147520 00000100:00100000:2.0:1789130473.760239:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130473.760253:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:46027:x1876037605147520:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130473.760282:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130473.760311:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebddc lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7e6 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760415:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760434:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760447:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760480:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760488:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760495:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760731:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebdf1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760741:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebdf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760748:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebdf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130473.760760:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00010000:00010000:2.0:1789130473.760898:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760907:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760912:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760919:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130473.760923:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760931:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760945:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130473.760948:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130473.760955:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760960:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebde3 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760977:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760982:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760988:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.760993:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130473.760996:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761001:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761008:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b48a1fd500) 00010000:00010000:2.0:1789130473.761011:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130473.761014:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761020:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebdea lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761074:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebddc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7e6 expref: 28 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761090:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebdf1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7e6 expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.761098:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130473.761100:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130473.761103:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130473.761197:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:46027:x1876037605147520:12345-192.168.201.39@tcp:101:cat.0 Request processed in 947us (1266us total) trans 34359738434 rc 0/0 00000100:00100000:2.0:1789130473.761209:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789130473.770577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.770810:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147776 00000100:00100000:2.0:1789130473.770824:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147776 00000100:00100000:2.0:1789130473.770918:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789130473.770931:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:46027:x1876037605147776:12345-192.168.201.39@tcp:103:cat.0 00010000:00010000:2.0:1789130473.770952:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130473.770985:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebdf1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7e6 expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.771012:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130473.771026:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130473.771096:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:46027:x1876037605147776:12345-192.168.201.39@tcp:103:cat.0 Request processed in 167us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130473.771106:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789130473.774147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130473.774580:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605147904 00000100:00100000:0.0:1789130473.774595:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605147904 00000100:00100000:0.0:1789130473.774715:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130473.774728:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:46027:x1876037605147904:12345-192.168.201.39@tcp:58:cat.0 00010000:00010000:0.0:1789130473.774893:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.774917:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130473.774933:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130473.778905:0:43680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130473.778997:0:43680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].8, 64 off8704 00000040:00080000:0.0:1789130473.779105:0:43680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].1, 136 off8328 00000100:00100000:0.0:1789130473.779716:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:46027:x1876037605147904:12345-192.168.201.39@tcp:58:cat.0 Request processed in 4980us (5581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130473.779732:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789130473.790154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130473.793438:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148032 00000100:00100000:2.0:1789130473.793472:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148032 00000100:00100000:2.0:1789130473.793579:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130473.793593:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:46027:x1876037605148032:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130473.793643:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130473.793673:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7ed expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793760:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793772:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793800:0:43679:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793815:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793832:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130473.793835:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130473.793839:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130473.793848:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130473.793941:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:46027:x1876037605148032:12345-192.168.201.39@tcp:101:cat.0 Request processed in 351us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130473.793950:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:3.0:1789130474.118267:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130474.334227:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738417 is committed 00000001:00080000:2.0:1789130474.334242:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738431 is committed 00000001:00080000:2.0:1789130474.334254:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738434 is committed 00000004:00080000:2.0:1789130474.334264:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789130474.334285:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b388e2a840 refcount 2 committed 0 result 0 batchid 30064771676 00000020:00080000:2.0:1789130474.334291:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b65e1100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b388e2a600 00000020:00080000:2.0:1789130474.334295:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b65e1400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b382879000 00000020:00080000:2.0:1789130474.334863:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771676 committed batchid 25769803916 00000020:00080000:2.0:1789130474.335106:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803916 00000100:00100000:2.0:1789130474.335133:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626897280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130474.336804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130474.336925:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626897280 00000100:00100000:2.0:1789130474.336937:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626897280 00000100:00100000:2.0:1789130474.336998:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130474.337010:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626897280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789130474.337053:0:44365:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:227 count 1 00002000:00010000:2.0:1789130474.337100:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe3:0x0] initial LVB size: 15, mtime: 0x6aa3f6e8, atime: 0x6aa3f6e8, ctime: 0x6aa3f6e8, blocks: 0x1 00010000:00010000:2.0:1789130474.337110:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.337136:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=1637s v=(0 0) 00010000:00010000:2.0:1789130474.337141:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130474.337149:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.337169:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.337181:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.337189:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.337209:0:44365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130474.341004:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626897280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3982us (4195us total) trans 34359738373 rc 0/0 00000100:00100000:2.0:1789130474.341024:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789130474.341252:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130474.341262:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.341279:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130474.341285:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.341298:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.341327:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.341338:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74dd967/0x5c74554e47cebe0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.341367:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130474.341369:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130474.341371:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789130474.341577:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3828eb0c0/2, rc 0, transno 34359738373 00000100:00100000:1.0:1789130474.341586:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626897280:0@lo:6:osp-syn-1-0.0 00000001:00100000:0.0:1789130474.346405:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:0.0:1789130474.346419:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b489cb6000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:3.0:1789130474.346979:0:43229:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb6000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 for lustre-OST0000 00000020:00000080:3.0:1789130474.347130:0:43229:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b489cb1000 for lustre-OST0000 00000040:00080000:1.0:1789130474.633580:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130474.633595:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130474.633706:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 2 count 2 00000040:00080000:1.0:1789130474.633716:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130474.633891:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626897408:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130474.634034:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883e7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130474.638391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.638557:0:43690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148160 00000100:00100000:2.0:1789130474.638570:0:43690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148160 00000100:00100000:2.0:1789130474.638683:0:43690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789130474.638698:0:43690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6f164769-cccd-48c1-b7fa-967be7565442+9:46028:x1876037605148160:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789130474.638816:0:43690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6f164769-cccd-48c1-b7fa-967be7565442+9:46028:x1876037605148160:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 122us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.638825:0:43690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00080000:3.0:1789130474.638890:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130474.639729:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626897408:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130474.641270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.641381:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148288 00000100:00100000:2.0:1789130474.641392:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148288 00000100:00100000:2.0:1789130474.641469:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789130474.641480:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605148288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130474.641535:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130474.641706:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605148288:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 227us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.641715:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:0.0:1789130474.658407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.658663:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148416 00000100:00100000:2.0:1789130474.658678:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148416 00000100:00100000:2.0:1789130474.658755:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130474.658768:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605148416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789130474.658909:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.658933:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.658948:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.658963:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.658969:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.658980:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659013:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659023:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659031:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130474.659081:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00000004:00200000:2.0:1789130474.659086:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130474.659103:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659124:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659132:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659141:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659148:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.659153:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659161:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659176:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130474.659179:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130474.659185:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659192:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659211:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659217:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659223:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659229:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.659231:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659237:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659245:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadf671bc (ffff90b48a1fd500) 00010000:00010000:2.0:1789130474.659247:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130474.659250:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659257:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadf671bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659272:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659278:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659284:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659289:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.659291:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659297:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659303:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130474.659305:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130474.659308:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.659314:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe22 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130474.659424:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605148416:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 657us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.659584:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1789130474.669470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.669588:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148672 00000100:00100000:2.0:1789130474.669642:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148672 00000100:00100000:2.0:1789130474.669713:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130474.669726:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605148672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130474.669758:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130474.669795:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7f4 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.669947:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.669967:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.669980:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130474.669992:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00010000:00010000:2.0:1789130474.670162:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670171:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670178:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670184:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.670189:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670198:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670212:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130474.670216:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130474.670222:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670571:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe30 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670776:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe29 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7f4 expref: 10 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670800:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130474.670803:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130474.670807:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7f4 expref: 10 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.670825:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130474.670986:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:46028:x1876037605148672:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1263us (1534us total) trans 34359738435 rc 301/301 00000100:00100000:2.0:1789130474.670995:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1789130474.681489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.681914:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605148928 00000100:00100000:2.0:1789130474.681927:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605148928 00000100:00100000:2.0:1789130474.682005:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789130474.682016:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:46028:x1876037605148928:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130474.682364:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605148928:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 347us (898us total) trans 34359738436 rc 0/0 00000100:00100000:2.0:1789130474.682393:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130474.685748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.686054:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605149056 00000100:00100000:2.0:1789130474.686067:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605149056 00000100:00100000:2.0:1789130474.686159:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130474.686172:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605149056:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130474.686263:0:43679:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130474.686409:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605149056:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 239us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.686417:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789130474.692084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130474.693397:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605149312 00000100:00100000:0.0:1789130474.693415:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605149312 00000100:00100000:0.0:1789130474.693531:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130474.693544:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605149312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130474.693573:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130474.693661:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebe3e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac7fb expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130474.694775:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe3:0x0], index 0: 0 00010000:00010000:0.0:1789130474.695121:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebe45 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.695143:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebe45 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.695158:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebe45 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.695241:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebe3e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7fb expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.695264:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebe45 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7fb expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.695275:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130474.695278:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130474.695282:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130474.695380:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46028:x1876037605149312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1838us (3311us total) trans 34359738437 rc 0/0 00000100:00100000:0.0:1789130474.695389:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130474.701258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.701427:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605149568 00000100:00100000:2.0:1789130474.701452:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605149568 00000100:00100000:2.0:1789130474.701540:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130474.701553:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:46028:x1876037605149568:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130474.701666:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130474.701704:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cebe45 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7fb expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701730:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01700) 00010000:00010000:2.0:1789130474.701744:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130474.701778:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701797:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701809:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701827:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701835:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.701842:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702212:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702221:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702906:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702914:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.702919:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702930:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702946:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130474.702949:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130474.702954:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702961:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe53 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702977:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702984:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702990:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.702996:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130474.702999:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.703005:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.703014:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xa01376c6 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130474.703017:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130474.703020:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.703026:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe5a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xa01376c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130474.703669:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46028:x1876037605149568:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2112us (2420us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130474.703681:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789130474.706405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130474.708680:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605149696 00000100:00100000:0.0:1789130474.708702:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605149696 00000100:00100000:0.0:1789130474.708803:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1789130474.708817:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46028:x1876037605149696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130474.708846:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130474.708899:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebe61 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac802 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.708947:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.708967:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.708982:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.709135:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cebe61 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.709157:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.709167:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130474.709170:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130474.709175:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130474.709275:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46028:x1876037605149696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 461us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130474.709283:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789130474.714554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130474.714916:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605149952 00000100:00100000:0.0:1789130474.714931:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605149952 00000100:00100000:0.0:1789130474.715021:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789130474.715035:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:46028:x1876037605149952:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130474.715167:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.715192:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130474.715208:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130474.716005:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].3, 88 off8408 00000004:00080000:0.0:1789130474.716022:0:43681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1637813418668ns, next at 1638813415286ns, rc = 0 00000004:00010000:0.0:1789130474.716143:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000051e61540 reply state 000000007587b27e transno 34359738438 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130474.716156:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130474.716291:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:46028:x1876037605149952:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1256us (1750us total) trans 34359738438 rc 0/0 00000100:00100000:0.0:1789130474.716301:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:1.0:1789130474.727791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.727911:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150080 00000100:00100000:2.0:1789130474.727924:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150080 00000100:00100000:2.0:1789130474.728010:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789130474.728023:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:46028:x1876037605150080:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130474.728062:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130474.728095:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac809 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.728206:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 15 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.728225:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 15 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.728253:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130474.728256:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130474.728261:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130474.728359:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605150080:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 338us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.728367:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00010000:00010000:3.0:1789130474.731593:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731664:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731672:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731679:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130474.731685:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731694:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731716:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:3.0:1789130474.731719:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789130474.731725:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.731732:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2e00/0x5c74554e47cebe6f lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130474.731902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130474.732056:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150208 00000100:00100000:3.0:1789130474.732069:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150208 00000100:00100000:3.0:1789130474.732150:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789130474.732162:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605150208:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789130474.732818:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605150208:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 655us (919us total) trans 34359738371 rc 0/0 00000100:00100000:3.0:1789130474.732830:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00080000:0.0:1789130474.732965:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130474.747134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.747285:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150464 00000100:00100000:2.0:1789130474.747299:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150464 00000100:00100000:2.0:1789130474.747386:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130474.747399:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:46028:x1876037605150464:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130474.747574:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:46028:x1876037605150464:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 177us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.747583:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1789130474.759432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.759559:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150592 00000100:00100000:2.0:1789130474.759574:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150592 00000100:00100000:2.0:1789130474.759681:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:2.0:1789130474.759694:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:46028:x1876037605150592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130474.759724:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130474.759756:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe7d lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac810 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760058:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760078:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760093:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130474.760145:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130474.760170:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760202:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebe7d lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac810 expref: 16 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760238:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac810 expref: 15 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.760249:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130474.760253:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789130474.760258:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130474.760344:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605150592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 653us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.760354:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:2.0:1789130474.764065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130474.764297:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150720 00000100:00100000:3.0:1789130474.764310:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150720 00000100:00100000:3.0:1789130474.764385:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789130474.764398:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605150720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130474.764424:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130474.764465:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac817 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130474.764519:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f6ea, blocks: 0x1 00010000:00010000:3.0:1789130474.764549:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=1637s v=(0 0) 00010000:00010000:3.0:1789130474.764554:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130474.764567:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 7 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.764596:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 7 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.764641:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:3.0:1789130474.764722:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605150720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 326us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130474.764731:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130474.774290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.774397:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605150976 00000100:00100000:2.0:1789130474.774411:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605150976 00000100:00100000:2.0:1789130474.774502:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130474.774513:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605150976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130474.774709:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605150976:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 198us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.774718:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789130474.781461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130474.781588:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151104 00000100:00100000:3.0:1789130474.781654:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151104 00000100:00100000:3.0:1789130474.781729:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130474.781742:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:46028:x1876037605151104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130474.781768:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130474.781796:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac81e expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.781838:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.781856:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130474.781862:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130474.781868:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.781913:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130474.781929:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 1737 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130474.781946:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38947c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626897536:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130474.782082:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b382b13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130474.795690:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38947c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626897536:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130474.795743:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.795769:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:2.0:1789130474.795904:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:46028:x1876037605151104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 14164us (14469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.795915:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130474.796129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130474.796369:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151232 00000100:00100000:2.0:1789130474.796378:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151232 00010000:00010000:2.0:1789130474.796426:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 1737 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130474.796460:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789130474.796471:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605151232:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130474.796503:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130474.796541:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 1737 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.796556:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 1737 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.796586:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc70495/0x5c74554e47cebe8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac817 expref: 8 pid: 44365 timeout: 1737 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.796629:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130474.796634:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130474.796643:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.796655:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130474.796699:0:43664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130474.796716:0:43664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:43664:1876037626897664:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130474.799883:0:43664:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130474.803782:0:43664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:43664:1876037626897664:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130474.803827:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130474.803894:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605151232:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 7424us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130474.803908:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130474.806026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130474.806279:0:44372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151360 00000100:00100000:0.0:1789130474.806293:0:44372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151360 00002000:00100000:0.0:1789130474.806547:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe3:0x0] (0->14) req@ffff90b387aa1e00 x1876037605151360/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:190/0 lens 504/0 e 0 to 0 dl 1789130485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130474.806561:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa1e00 with x1876037605151360 ext(0->14) 00002000:00010000:0.0:1789130474.806569:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387aa1e00 00000100:00100000:0.0:1789130474.806693:0:44372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1789130474.806706:0:44372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605151360:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130474.807701:0:44372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605151360:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 992us (1683us total) trans 34359738372 rc 0/0 00000100:00100000:0.0:1789130474.807715:0:44372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:0.0:1789130474.807724:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe3:0x0] (0->14) req@ffff90b387aa1e00 x1876037605151360/t34359738372(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:190/0 lens 504/448 e 0 to 0 dl 1789130485 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130474.807733:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa1e00 with x1876037605151360 ext(0->14) 00002000:00010000:0.0:1789130474.807739:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387aa1e00 00000100:00100000:0.0:1789130474.813867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130474.813982:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151488 00000100:00100000:3.0:1789130474.813997:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151488 00000100:00100000:3.0:1789130474.814079:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789130474.814091:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605151488:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789130474.902365:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738438 is committed 00000004:00080000:0.0:1789130474.902387:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789130474.902427:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771676 batchid updated 00000020:00080000:0.0:1789130474.902469:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771676 00000020:00080000:0.0:1789130474.902495:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771676 00000100:00100000:0.0:1789130474.903038:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626897792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789130474.903314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130474.903555:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626897792 00000100:00100000:2.0:1789130474.903564:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626897792 00000100:00100000:2.0:1789130474.903662:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130474.903675:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626897792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130474.903930:0:44365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb size from disk: 0 -> 15 00002000:00010000:2.0:1789130474.903935:0:44365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb mtime from disk: 0 -> 1789130474 00002000:00010000:2.0:1789130474.903937:0:44365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130474.903940:0:44365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb ctime from disk: 1789130474 -> 1789130474 00002000:00010000:2.0:1789130474.903942:0:44365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789130474.904005:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626897792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 331us (691us total) trans 34359738373 rc 0/0 00000100:00100000:2.0:1789130474.904015:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1789130474.904766:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b387aa30c0/2, rc 0, transno 34359738373 00000100:00100000:0.0:1789130474.904778:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626897792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789130474.908687:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46028:x1876037605151488:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 94579us (94819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130474.908709:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789130474.915659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130474.916009:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151616 00000100:00100000:1.0:1789130474.916024:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151616 00000100:00100000:1.0:1789130474.916110:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789130474.916122:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605151616:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789130475.042978:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738372 is committed 00000001:00080000:0.0:1789130475.043030:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738373 is committed 00000100:00100000:3.0:1789130475.043411:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605151616:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 127281us (127803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130475.043430:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130475.052059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.052199:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605151872 00000100:00100000:2.0:1789130475.052216:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605151872 00000100:00100000:2.0:1789130475.052318:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:2.0:1789130475.052332:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46028:x1876037605151872:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130475.052417:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130475.052459:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebe84 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac810 expref: 11 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.052496:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130475.052503:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130475.052545:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.052562:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.052574:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130475.053034:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063b8639c reply state 0000000018fca4ef transno 34359738439 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.053047:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130475.053457:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:46028:x1876037605151872:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1125us (1412us total) trans 34359738439 rc 0/0 00000100:00100000:2.0:1789130475.053466:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:2.0:1789130475.071488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130475.071641:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071658:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071667:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071674:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130475.071680:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071689:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071714:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:3.0:1789130475.071718:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130475.071733:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.071741:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebe99 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.071893:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152000 00000100:00100000:0.0:1789130475.071909:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152000 00000100:00100000:0.0:1789130475.071990:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130475.072003:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605152000:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789130475.072359:0:44365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb size from disk: 15 -> 15 00002000:00010000:0.0:1789130475.072364:0:44365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb mtime from disk: 1789130474 -> 1789130472 00002000:00010000:0.0:1789130475.072366:0:44365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb atime from disk: 0 -> 1789130472 00002000:00010000:0.0:1789130475.072368:0:44365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb ctime from disk: 1789130474 -> 1789130472 00002000:00010000:0.0:1789130475.072370:0:44365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789130475.072455:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605152000:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 455us (993us total) trans 34359738374 rc 0/0 00000100:00100000:0.0:1789130475.072464:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130475.077197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.077313:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152256 00000100:00100000:2.0:1789130475.077328:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152256 00000100:00100000:2.0:1789130475.077412:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789130475.077424:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:46028:x1876037605152256:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130475.077541:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.077564:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.077575:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.077665:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.077683:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 11 pid: 43680 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.077702:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626897920:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130475.077834:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130475.086298:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626897920:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130475.086341:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130475.088516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.088665:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152384 00000100:00100000:2.0:1789130475.088681:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152384 00010000:00010000:2.0:1789130475.088896:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 12 pid: 43680 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.089011:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130475.089024:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605152384:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130475.089047:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130475.089058:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 12 pid: 43680 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089076:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 12 pid: 43680 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089112:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebe68 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac802 expref: 12 pid: 43680 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089139:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:2.0:1789130475.089146:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089161:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089171:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.089219:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130475.089310:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605152384:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 288us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.089319:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00010000:00010000:0.0:1789130475.095907:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.095932:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.095977:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.095985:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.095993:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.095999:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130475.096004:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.096013:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.096036:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130475.096041:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789130475.096049:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.096056:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebea0 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.096218:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605152256:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 18789us (19029us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789130475.096232:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789130475.099705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.101346:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152512 00000100:00100000:0.0:1789130475.101365:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152512 00000100:00100000:0.0:1789130475.101452:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789130475.101466:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605152512:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789130475.101549:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.101577:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.101589:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789130475.101595:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130475.101622:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.101676:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.101694:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 7 pid: 44793 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.101715:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626898048:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130475.101850:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48a1859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130475.106540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.106754:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626898048:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130475.106793:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.106989:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152640 00000100:00100000:2.0:1789130475.106999:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152640 00010000:00010000:2.0:1789130475.107055:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.107108:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789130475.107121:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605152640:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130475.107142:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130475.107175:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.107191:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.107225:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe9f3dee/0x5c74554e47cebe92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac81e expref: 8 pid: 44793 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.107248:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130475.107253:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130475.107259:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.107276:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.107302:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130475.107376:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605152640:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 256us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.107383:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:0.0:1789130475.107857:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107868:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107903:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107913:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107922:0:44793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107931:0:44793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130475.107936:0:44793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107951:0:44793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107966:0:44793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.107975:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015196ce7/0x5c74554e47cebea7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.108049:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605152512:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 6585us (8356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.108058:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130475.123906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.124057:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605152896 00000100:00100000:0.0:1789130475.124073:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605152896 00000100:00100000:0.0:1789130475.124165:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130475.124178:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:46028:x1876037605152896:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130475.124305:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124330:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124345:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124712:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124726:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 11 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124735:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124783:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 11 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.124800:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 11 pid: 45555 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.124819:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626898176:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130475.124936:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490434240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130475.129388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130475.129598:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153024 00000100:00100000:1.0:1789130475.129663:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153024 00010000:00010000:1.0:1789130475.129722:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 12 pid: 45555 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130475.129780:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130475.129793:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605153024:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130475.129813:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130475.129822:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 12 pid: 45555 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.129843:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 12 pid: 45555 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.129871:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:1.0:1789130475.129877:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.129888:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.129896:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.129919:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130475.129995:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605153024:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 205us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130475.130004:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:0.0:1789130475.130820:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebe76 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac809 expref: 11 pid: 45555 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.130845:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626898176:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130475.130878:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.130888:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.130894:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130475.131143:0:43681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738440 00000001:00080000:0.0:1789130475.131325:0:43681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738441 00000001:00080000:0.0:1789130475.131374:0:43681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738442 00000100:00100000:0.0:1789130475.131489:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:43681:1876037626898304:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789130475.131596:0:43681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.131888:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130475.132007:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626898304 00000100:00100000:1.0:1789130475.132016:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626898304 00000100:00100000:1.0:1789130475.132091:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130475.132101:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43681:x1876037626898304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789130475.132198:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43681:x1876037626898304:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130475.132206:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789130475.132282:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130475.132582:0:43681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738373 gen 2 00000004:00080000:0.0:1789130475.132589:0:43681:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b387aa30c0, transno 34359738373 00000100:00100000:0.0:1789130475.132638:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:43681:1876037626898304:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789130475.133233:0:43681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738443 00000100:00100000:0.0:1789130475.133329:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fe580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:43681:1876037626898432:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789130475.133385:0:43681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.133413:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130475.133581:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626898432 00000100:00100000:2.0:1789130475.133589:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626898432 00000100:00100000:2.0:1789130475.133666:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130475.133676:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43681:x1876037626898432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789130475.133909:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43681:x1876037626898432:12345-0@lo:1000:mdt00_002.0 Request processed in 234us (522us total) trans 34359738375 rc 0/0 00000100:00100000:2.0:1789130475.133916:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130475.134056:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fe580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:43681:1876037626898432:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789130475.134149:0:43681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738444 00010000:00010000:0.0:1789130475.134182:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134194:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134202:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134208:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130475.134214:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134222:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134246:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b497c01a00) 00010000:00010000:0.0:1789130475.134249:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130475.134255:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134262:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebeb5 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134305:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134311:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134317:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134322:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130475.134325:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134331:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134339:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130475.134341:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130475.134349:0:43681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134362:0:43681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134373:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.134400:0:43681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.134411:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fe940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626898560:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130475.134489:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130475.138493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.138675:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153152 00000100:00100000:2.0:1789130475.138692:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153152 00000100:00100000:2.0:1789130475.138792:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789130475.138807:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:46027:x1876037605153152:12345-192.168.201.39@tcp:49:cat.0 00000100:00100000:2.0:1789130475.139016:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:46027:x1876037605153152:12345-192.168.201.39@tcp:49:cat.0 Request processed in 211us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.139024:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130475.139512:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fe940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626898560:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130475.139547:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139560:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cebdff lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139623:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139641:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139654:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139666:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139673:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139681:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139687:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130475.139692:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139700:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.139714:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130475.139717:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130475.139721:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140529:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebebc lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140552:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140559:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140564:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140570:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130475.140574:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140585:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140599:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130475.140650:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130475.140654:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.140660:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebeae lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.144027:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605152896:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 19833us (20118us total) trans 34359738445 rc 0/0 00000100:00100000:0.0:1789130475.144049:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000020:00080000:0.0:1789130475.144061:0:43681:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00010000:00010000:3.0:1789130475.148190:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130475.151370:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130475.151385:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130475.151834:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 2 count 2 00000040:00080000:1.0:1789130475.151846:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130475.152539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.152654:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153408 00000100:00100000:2.0:1789130475.152671:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153408 00000100:00100000:2.0:1789130475.152758:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789130475.152772:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:46028:x1876037605153408:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789130475.153683:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0xe:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130475.153809:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738446 00010000:00010000:2.0:1789130475.153872:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153895:0:43683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153911:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153921:0:43683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153928:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153935:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.153974:0:43683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130475.154127:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46028:x1876037605153408:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1355us (1594us total) trans 34359738447 rc 0/0 00000100:00100000:2.0:1789130475.154139:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000020:00080000:2.0:1789130475.154146:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130475.154963:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130475.154976:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.154986:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130475.154990:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.155000:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.155019:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xe:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130475.155023:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130475.155028:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.155035:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebec3 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.155059:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130475.155061:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130475.155063:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130475.160898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.161122:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153536 00000100:00100000:0.0:1789130475.161138:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153536 00000100:00100000:0.0:1789130475.161223:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789130475.161236:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:46027:x1876037605153536:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789130475.161262:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130475.161293:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac825 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130475.161334:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe3:0x0] initial LVB size: 15, mtime: 0x6aa3f6e8, atime: 0x6aa3f6e8, ctime: 0x6aa3f6e8, blocks: 0xb 00010000:00010000:0.0:1789130475.161365:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=1638s v=(0 0) 00010000:00010000:0.0:1789130475.161371:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130475.161384:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.161404:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.161431:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130475.161531:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:46027:x1876037605153536:12345-192.168.201.39@tcp:101:cat.0 Request processed in 298us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.161539:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789130475.168589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.168962:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153664 00000100:00100000:2.0:1789130475.168976:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153664 00002000:00100000:2.0:1789130475.169045:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe3:0x0] (0->4095) req@ffff90b387aa30c0 x1876037605153664/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 488/0 e 0 to 0 dl 1789130486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130475.169066:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa30c0 with x1876037605153664 ext(0->4095) 00002000:00010000:2.0:1789130475.169074:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387aa30c0 00000100:00100000:2.0:1789130475.169111:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789130475.169121:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605153664:12345-192.168.201.39@tcp:3:cat.0 00000100:00100000:2.0:1789130475.169414:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605153664:12345-192.168.201.39@tcp:3:cat.0 Request processed in 294us (838us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789130475.169424:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:2.0:1789130475.169431:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe3:0x0] (0->4095) req@ffff90b387aa30c0 x1876037605153664/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 488/4536 e 0 to 0 dl 1789130486 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130475.169440:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b387aa30c0 with x1876037605153664 ext(0->4095) 00002000:00010000:2.0:1789130475.169444:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b387aa30c0 00000100:00100000:1.0:1789130475.185694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.185845:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605153920 00000100:00100000:2.0:1789130475.185860:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605153920 00000100:00100000:2.0:1789130475.185946:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1789130475.185958:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46027:x1876037605153920:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1789130475.186344:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46027:x1876037605153920:12345-192.168.201.39@tcp:35:cat.0 Request processed in 386us (664us total) trans 34359738448 rc 0/0 00000100:00100000:2.0:1789130475.186354:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789130475.361378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130475.361984:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605154176 00000100:00100000:3.0:1789130475.362000:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605154176 00000100:00100000:3.0:1789130475.362139:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1789130475.362152:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46039:x1876037605154176:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130475.362185:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130475.362215:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cebed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac82c expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130475.363176:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 7680 00010000:00010000:3.0:1789130475.363414:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cebed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac82c expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.363941:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:3.0:1789130475.363945:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130475.363953:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cebed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac82c expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.363973:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:3.0:1789130475.364158:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46039:x1876037605154176:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2008us (2794us total) trans 34359738449 rc 301/301 00000100:00100000:3.0:1789130475.364170:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:0.0:1789130475.371807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.372108:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605154304 00000100:00100000:2.0:1789130475.372134:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605154304 00000100:00100000:2.0:1789130475.372222:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:2.0:1789130475.372237:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:46039:x1876037605154304:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130475.372354:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.372378:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.372394:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.372415:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.372423:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.372430:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373345:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373360:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373369:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130475.373426:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373442:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373450:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373463:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373489:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.373494:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373504:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373946:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130475.373951:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130475.373959:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373968:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebedf lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373988:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.373995:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374001:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374007:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.374010:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374022:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374032:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b48a1fd500) 00010000:00010000:2.0:1789130475.374035:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130475.374037:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374043:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebee6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374061:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374069:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374075:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374080:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.374084:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374090:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374098:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130475.374100:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130475.374103:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.374114:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebeed lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.374395:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:46039:x1876037605154304:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2158us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.374407:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789130475.377287:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.377408:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605154560 00000100:00100000:2.0:1789130475.377424:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605154560 00000100:00100000:2.0:1789130475.377919:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130475.377934:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46039:x1876037605154560:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130475.378942:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:46039:x1876037605154560:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1004us (1661us total) trans 34359738450 rc 0/0 00000100:00100000:2.0:1789130475.378954:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789130475.437720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.438332:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605154688 00000100:00100000:2.0:1789130475.438348:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605154688 00000100:00100000:2.0:1789130475.438509:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789130475.438532:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:46040:x1876037605154688:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:2.0:1789130475.438565:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130475.438592:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebef4 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac833 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438710:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438728:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438746:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438763:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438770:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.438777:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.439187:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.439198:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.439205:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130475.440351:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 15 00000004:00200000:2.0:1789130475.440363:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130475.440402:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440596:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440631:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440643:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440651:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440658:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.440664:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440673:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440691:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130475.440694:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130475.440701:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440708:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebefb lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440728:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440733:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440739:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440744:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.440748:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440754:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440761:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b48a1fd500) 00010000:00010000:2.0:1789130475.440764:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130475.440767:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440772:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf02 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440824:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebef4 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac833 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440842:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac833 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.440850:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130475.440852:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130475.440855:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:2.0:1789130475.440967:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:46040:x1876037605154688:12345-192.168.201.39@tcp:101:rm.0 Request processed in 2446us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.440979:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130475.449900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.449999:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605154944 00000100:00100000:0.0:1789130475.450015:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605154944 00000100:00100000:0.0:1789130475.450918:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130475.450935:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:46040:x1876037605154944:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789130475.451006:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789130475.451044:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cebf09 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac833 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.451074:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebe06 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7ed expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.451087:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130475.451347:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130475.451805:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.451823:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.451836:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.451853:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.451861:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.451867:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.452954:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.452969:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.452980:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130475.456054:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].4, 64 off8472 00010000:00010000:1.0:1789130475.456387:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.456409:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.456984:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.456999:0:43681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457007:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457014:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457043:0:43681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130475.457075:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457082:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457089:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457104:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ea00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130475.457109:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457186:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457204:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:1.0:1789130475.457207:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130475.457212:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457219:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cebf1e lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457320:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457327:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457334:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457339:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130475.457343:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457349:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457358:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130475.457361:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130475.457364:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130475.457370:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cebf10 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130475.457386:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008f6fd021 reply state 00000000f3e25170 transno 34359738451 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130475.457396:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130475.457554:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:46040:x1876037605154944:12345-192.168.201.39@tcp:36:rm.0 Request processed in 6619us (7663us total) trans 34359738451 rc 0/0 00000100:00100000:1.0:1789130475.457565:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00010000:00010000:3.0:1789130475.457707:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130475.457716:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.457723:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130475.457726:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.457733:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.457743:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:3.0:1789130475.457745:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130475.457748:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.457754:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cebf25 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.457774:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130475.457776:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130475.457777:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130475.460780:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460804:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460813:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460820:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130475.460826:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460835:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460857:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b4909bd200) 00010000:00010000:3.0:1789130475.460861:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130475.460867:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.460874:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cebf17 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130475.551066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130475.551238:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155200 00000100:00100000:3.0:1789130475.551252:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155200 00000100:00100000:3.0:1789130475.551334:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1789130475.551347:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:46046:x1876037605155200:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130475.551381:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130475.551409:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cebf2c lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac83a expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551652:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551669:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551684:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551702:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551709:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.551717:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130475.553029:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe4:0x0], index 1: 0 00010000:00010000:3.0:1789130475.554994:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cebf41 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555023:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cebf41 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555043:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cebf41 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555101:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555108:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555926:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555935:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130475.555940:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555950:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555969:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130475.555973:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130475.555979:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.555987:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cebf33 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130475.556010:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002638e1d9 reply state 000000004e69cced transno 34359738452 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130475.556021:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130475.558059:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cebf2c lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac83a expref: 23 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.558095:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cebf41 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac83a expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.558105:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b488939800) 00010000:00010000:2.0:1789130475.558108:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130475.558112:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:2.0:1789130475.558277:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+23:46046:x1876037605155200:12345-192.168.201.39@tcp:101:bash.0 Request processed in 6931us (7225us total) trans 34359738452 rc 0/0 00000100:00100000:2.0:1789130475.558287:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00010000:00010000:3.0:1789130475.579967:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.579995:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.580003:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.580010:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130475.580016:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.580025:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.580048:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b488939c00) 00010000:00010000:3.0:1789130475.580051:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130475.580057:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.580064:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cebf3a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130475.589220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130475.589647:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155328 00000100:00100000:3.0:1789130475.589662:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155328 00000100:00100000:3.0:1789130475.589824:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789130475.589836:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605155328:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130475.589859:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130475.589887:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac841 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130475.589925:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130475.589953:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=1638s v=(0 0) 00010000:00010000:3.0:1789130475.589958:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130475.589970:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 8 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.589993:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 8 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.590011:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:3.0:1789130475.593541:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605155328:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3680us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130475.593560:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00080000:2.0:1789130475.595825:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130475.600260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.600380:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155456 00000100:00100000:0.0:1789130475.600393:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155456 00000100:00100000:0.0:1789130475.600481:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130475.600492:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:46046:x1876037605155456:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130475.600516:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130475.600789:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac848 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.600835:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.600845:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130475.600851:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130475.600857:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac848 expref: 9 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.600903:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.600920:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 1738 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130475.600936:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626898688:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130475.601062:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130475.615666:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626898688:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130475.615827:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac848 expref: 9 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.615861:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2e00, rc 0) 00000100:00100000:2.0:1789130475.615956:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:46046:x1876037605155456:12345-192.168.201.39@tcp:101:bash.0 Request processed in 15465us (15711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.615970:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1789130475.616194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.616541:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155584 00000100:00100000:2.0:1789130475.616553:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155584 00010000:00010000:2.0:1789130475.616632:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 1738 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.617195:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130475.617210:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605155584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130475.617230:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130475.617261:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 1738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.617279:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 1738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.617308:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b17021b/0x5c74554e47cebf4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac841 expref: 9 pid: 44366 timeout: 1738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.617328:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130475.617334:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130475.617343:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac848 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.617356:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac848 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.617403:0:43666:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000054b38a11/0x5c74554e47cebf56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac848 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130475.617418:0:43666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626898816:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130475.617981:0:43666:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130475.622795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130475.622882:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155840 00000100:00100000:1.0:1789130475.622899:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155840 00000100:00100000:1.0:1789130475.622989:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789130475.623003:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:46046:x1876037605155840:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789130475.623294:0:43666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626898816:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130475.623327:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130475.623408:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605155584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6201us (7222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.623419:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789130475.623979:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46046:x1876037605155840:12345-192.168.201.39@tcp:35:bash.0 Request processed in 978us (1194us total) trans 34359738453 rc 0/0 00000100:00100000:1.0:1789130475.623988:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130475.752843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.753141:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605155968 00000100:00100000:2.0:1789130475.753151:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605155968 00000100:00100000:2.0:1789130475.753218:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130475.753228:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46052:x1876037605155968:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130475.753254:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130475.753275:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac84f expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753343:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753357:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753368:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130475.753425:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 7680 00000004:00200000:2.0:1789130475.753429:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130475.753453:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753490:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cebf5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac84f expref: 25 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753511:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac84f expref: 24 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.753520:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130475.753523:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130475.753527:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130475.753592:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:46052:x1876037605155968:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 366us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130475.753651:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1789130475.765811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.765911:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605156224 00000100:00100000:0.0:1789130475.765922:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605156224 00000100:00100000:0.0:1789130475.765984:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130475.765996:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:46052:x1876037605156224:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130475.766018:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130475.766040:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebf6b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac856 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.766153:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebf72 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.766168:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebf72 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.766180:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebf72 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130475.766190:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xf:0x0]: returning size 18 00010000:00010000:0.0:1789130475.777663:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebf6b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac856 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.779128:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebf72 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac856 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130475.779140:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b488939800) 00010000:00010000:0.0:1789130475.779143:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130475.779146:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130475.779277:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:46052:x1876037605156224:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 13283us (13476us total) trans 34359738454 rc 0/0 00000100:00100000:0.0:1789130475.779286:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130475.783589:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626898944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130475.783718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130475.789394:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626898944 00000100:00100000:3.0:1789130475.789409:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626898944 00000100:00100000:3.0:1789130475.789505:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130475.789519:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626898944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130475.789568:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 1703936 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130475.789700:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626898944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130475.789708:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130475.789776:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626898944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130475.789807:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130475.795941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.798262:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626899072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.798399:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130475.798405:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626899200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.798483:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899072 00000100:00100000:0.0:1789130475.798491:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899072 00000100:00100000:0.0:1789130475.798539:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789130475.798549:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798624:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b483c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626899072:12345-0@lo:400:kworker.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.798631:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789130475.798692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626899072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798714:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626899456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.798758:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130475.798763:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626899328:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130475.798809:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899200 00000100:00100000:0.0:1789130475.798813:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899200 00000100:00100000:0.0:1789130475.798840:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899456 00000100:00100000:0.0:1789130475.798843:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899456 00000100:00100000:0.0:1789130475.798863:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899328 00000100:00100000:0.0:1789130475.798866:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899328 00000100:00100000:0.0:1789130475.798880:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130475.798885:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626899200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798922:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626899200:12345-0@lo:400:kworker.0 Request processed in 37us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.798930:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130475.798954:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626899200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.798971:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130475.798978:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626899456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.799009:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626899456:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.799015:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130475.799036:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626899456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.799052:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130475.799058:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626899328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130475.799089:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626899328:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130475.799094:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130475.799113:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626899328:0@lo:400:kworker.0 00000100:00080000:3.0:1789130475.802950:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130475.803067:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605156352 00000100:00100000:3.0:1789130475.803079:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605156352 00000100:00100000:3.0:1789130475.803160:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130475.803171:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605156352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130475.803188:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130475.803217:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cebf72 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac856 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130475.803238:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b488939800) 00010000:00010000:3.0:1789130475.803255:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130475.803319:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:2370:x1876037605156352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 149us (7386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130475.803326:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789130475.803450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.804488:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605156608 00000100:00100000:2.0:1789130475.804500:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605156608 00000100:00100000:2.0:1789130475.804548:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130475.804556:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:46052:x1876037605156608:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130475.804580:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130475.804583:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130475.804625:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cebf41 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac83a expref: 25 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.804641:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b488939800) 00010000:00010000:2.0:1789130475.804652:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130475.804668:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebf80 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac85d expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805302:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805316:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805329:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805351:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805359:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805365:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805371:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130475.805375:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805383:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805391:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130475.805394:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130475.805397:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.805404:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cebf87 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.807035:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.807051:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.807061:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.809167:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac85d expref: 27 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.809182:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130475.809185:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130475.809203:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebf80 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac85d expref: 27 pid: 43680 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.809219:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac85d expref: 26 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130475.809275:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130475.809278:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789130475.809281:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130475.809363:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:46052:x1876037605156608:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 4806us (5911us total) trans 34359738455 rc 0/0 00000100:00100000:2.0:1789130475.809372:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130475.820446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.820551:0:44372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605156736 00000100:00100000:0.0:1789130475.820566:0:44372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605156736 00002000:00100000:0.0:1789130475.820641:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe4:0x0] (0->17) req@ffff90b3828e9a40 x1876037605156736/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 512/0 e 0 to 0 dl 1789130486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130475.820655:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828e9a40 with x1876037605156736 ext(0->17) 00002000:00010000:0.0:1789130475.820662:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3828e9a40 00000100:00100000:0.0:1789130475.820697:0:44372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789130475.820708:0:44372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605156736:12345-192.168.201.39@tcp:4:bash.0 00000100:00100000:0.0:1789130475.821246:0:44372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605156736:12345-192.168.201.39@tcp:4:bash.0 Request processed in 537us (824us total) trans 34359738374 rc 0/0 00000100:00100000:0.0:1789130475.821255:0:44372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:0.0:1789130475.821264:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe4:0x0] (0->17) req@ffff90b3828e9a40 x1876037605156736/t34359738374(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 512/448 e 0 to 0 dl 1789130486 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130475.821273:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828e9a40 with x1876037605156736 ext(0->17) 00002000:00010000:0.0:1789130475.821278:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3828e9a40 00000100:00100000:2.0:1789130475.831620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130475.831687:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605156864 00000100:00100000:2.0:1789130475.831702:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605156864 00002000:00100000:2.0:1789130475.831770:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe4:0x0] (0->4095) req@ffff90b3828e8b40 x1876037605156864/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 488/0 e 0 to 0 dl 1789130486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130475.831784:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828e8b40 with x1876037605156864 ext(0->4095) 00002000:00010000:2.0:1789130475.831798:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3828e8b40 00000100:00100000:2.0:1789130475.831832:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1789130475.831843:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605156864:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130475.832388:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605156864:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 544us (794us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789130475.832399:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:2.0:1789130475.832407:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe4:0x0] (0->4095) req@ffff90b3828e8b40 x1876037605156864/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:191/0 lens 488/4536 e 0 to 0 dl 1789130486 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130475.832415:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828e8b40 with x1876037605156864 ext(0->4095) 00002000:00010000:2.0:1789130475.832419:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3828e8b40 00000100:00100000:0.0:1789130475.843134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130475.843185:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605157120 00000100:00100000:0.0:1789130475.843198:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605157120 00000100:00100000:0.0:1789130475.843266:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130475.843280:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:46052:x1876037605157120:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130475.844451:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:46052:x1876037605157120:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1167us (1324us total) trans 34359738456 rc 0/0 00000100:00100000:0.0:1789130475.844473:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000001:00080000:0.0:1789130475.884001:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738372 is committed 00000001:00080000:0.0:1789130475.884914:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738373 is committed 00000001:00080000:0.0:1789130475.884928:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738371 is committed 00000001:00100000:0.0:1789130475.885218:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:0.0:1789130475.885224:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b48574a000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:3.0:1789130475.885320:0:43229:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48574a000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 for lustre-OST0001 00000020:00000080:3.0:1789130475.885726:0:43229:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b48574d800 for lustre-OST0001 00000100:00100000:1.0:1789130476.043849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130476.044632:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605157376 00000100:00100000:2.0:1789130476.044648:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605157376 00000100:00100000:2.0:1789130476.044869:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:2.0:1789130476.044884:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:46062:x1876037605157376:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130476.044917:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130476.045579:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebf95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac864 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130476.045785:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 7680 00010000:00010000:2.0:1789130476.045969:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebf95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac864 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.045987:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130476.045990:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130476.045997:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cebf95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac864 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.046016:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130476.046120:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:46062:x1876037605157376:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1240us (2286us total) trans 34359738457 rc 301/301 00000100:00100000:2.0:1789130476.046129:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00080000:3.0:1789130476.048375:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130476.051570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.051802:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605157504 00000100:00100000:0.0:1789130476.051816:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605157504 00000100:00100000:0.0:1789130476.051894:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130476.051905:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:46062:x1876037605157504:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130476.052022:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052047:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052063:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052080:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052088:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052095:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052249:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052259:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052268:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130476.052318:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052334:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052341:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052353:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052359:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130476.052364:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052372:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052386:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130476.052389:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130476.052395:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052402:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfa3 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052417:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052423:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052428:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052433:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130476.052436:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052446:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052454:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b497c01a00) 00010000:00010000:0.0:1789130476.052465:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130476.052469:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052475:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfaa lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052491:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052499:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052504:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052793:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130476.052797:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052805:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052815:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:0.0:1789130476.052817:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130476.052821:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.052831:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfb1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130476.052933:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:46062:x1876037605157504:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1027us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130476.052943:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:1.0:1789130476.058473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.062287:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605157760 00000100:00100000:0.0:1789130476.062307:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605157760 00000100:00100000:0.0:1789130476.062394:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1789130476.062407:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:46062:x1876037605157760:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130476.063792:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:46062:x1876037605157760:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1380us (5338us total) trans 34359738458 rc 0/0 00000100:00100000:0.0:1789130476.063805:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00010000:00010000:3.0:1789130476.165985:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130476.239134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130476.239401:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605157888 00000100:00100000:2.0:1789130476.239415:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605157888 00000100:00100000:2.0:1789130476.239528:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130476.239541:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:44607:x1876037605157888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130476.239565:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789130476.239634:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebdb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7d8 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.239661:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130476.239683:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebf8e lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac85d expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.239693:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130476.239706:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cebf64 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac84f expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.239720:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebdd5 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac7df expref: 26 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.239731:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130476.239743:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130476.240037:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:44607:x1876037605157888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 496us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130476.240047:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130476.389951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130476.390119:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605158016 00000100:00100000:1.0:1789130476.390132:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605158016 00000100:00100000:1.0:1789130476.390204:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789130476.390215:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+25:46075:x1876037605158016:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130476.390245:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130476.390273:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cebfb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac86b expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390350:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390367:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390381:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130476.390698:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130476.390702:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130476.390791:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390821:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cebfb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac86b expref: 27 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390840:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac86b expref: 26 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130476.390850:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130476.390853:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130476.390858:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130476.390943:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+26:46075:x1876037605158016:12345-192.168.201.39@tcp:101:cat.0 Request processed in 730us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130476.390950:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789130476.398376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.406592:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605158144 00000100:00100000:0.0:1789130476.406795:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605158144 00000100:00100000:0.0:1789130476.406919:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:0.0:1789130476.406932:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:46075:x1876037605158144:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789130476.406962:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130476.406993:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac872 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407102:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407123:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407143:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407164:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407172:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407179:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407680:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407691:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407699:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130476.407742:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 7680 00000004:00200000:0.0:1789130476.407748:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130476.407778:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407793:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407800:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407813:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407821:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130476.407827:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407836:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407852:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:0.0:1789130476.407856:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130476.407862:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407869:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cebfcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407883:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407890:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407896:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407901:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130476.407904:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407915:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407922:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xad739384 (ffff90b497c01a00) 00010000:00010000:0.0:1789130476.407924:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130476.407927:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407931:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cebfd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xad739384 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407967:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cebfc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac872 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407982:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac872 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.407990:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130476.407992:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130476.407995:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130476.408118:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:46075:x1876037605158144:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1187us (9771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130476.408128:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789130476.413119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130476.422781:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605158400 00000100:00100000:2.0:1789130476.422803:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605158400 00000100:00100000:2.0:1789130476.422904:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789130476.422917:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:46075:x1876037605158400:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130476.422946:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130476.422976:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebfe2 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac879 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423075:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423091:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423105:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423122:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423130:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423136:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423303:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebff7 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423312:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebff7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.423319:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebff7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130476.423330:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xf:0x0]: returning size 18 00010000:00010000:2.0:1789130476.424982:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425002:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425011:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425018:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130476.425023:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425032:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425053:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130476.425057:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130476.425063:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425070:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cebfe9 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425090:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425097:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425109:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425114:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130476.425118:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425124:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425132:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0xfff97a3d (ffff90b48a1fd200) 00010000:00010000:2.0:1789130476.425134:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130476.425138:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425144:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cebff0 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0xfff97a3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425223:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cebfe2 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac879 expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425241:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebff7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac879 expref: 29 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130476.425250:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:2.0:1789130476.425253:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130476.425256:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130476.427658:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:46075:x1876037605158400:12345-192.168.201.39@tcp:101:cat.0 Request processed in 4723us (14534us total) trans 34359738459 rc 0/0 00000100:00100000:2.0:1789130476.427679:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130476.448833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.449074:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605158656 00000100:00100000:0.0:1789130476.449087:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605158656 00000100:00100000:0.0:1789130476.449145:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130476.449156:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:46075:x1876037605158656:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789130476.449484:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:46075:x1876037605158656:12345-192.168.201.39@tcp:35:cat.0 Request processed in 328us (664us total) trans 34359738460 rc 0/0 00000100:00100000:0.0:1789130476.449493:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789130476.581353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.581506:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605158912 00000100:00100000:0.0:1789130476.581519:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605158912 00000100:00100000:0.0:1789130476.581643:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:0.0:1789130476.581656:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:46085:x1876037605158912:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130476.581698:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130476.581727:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac880 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130476.581888:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 7680 00010000:00010000:0.0:1789130476.582049:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec005 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac880 expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.582067:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:0.0:1789130476.582071:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130476.582078:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac880 expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130476.582095:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130476.582185:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:46085:x1876037605158912:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 532us (848us total) trans 34359738461 rc 301/301 00000100:00100000:0.0:1789130476.582194:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130476.589473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130476.589594:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159168 00000100:00100000:0.0:1789130476.589644:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159168 00000100:00100000:0.0:1789130476.589705:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789130476.589717:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:46085:x1876037605159168:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130476.590051:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:46085:x1876037605159168:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 335us (604us total) trans 34359738462 rc 0/0 00000100:00100000:0.0:1789130476.590061:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00010000:00010000:3.0:1789130477.190262:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130477.601092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130477.601135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130477.601182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130477.601211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130477.601235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130477.601264:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159680 00000100:00100000:3.0:1789130477.601273:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159680 00000100:00100000:3.0:1789130477.601325:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159552 00000100:00100000:3.0:1789130477.601328:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159552 00000100:00100000:3.0:1789130477.601350:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789130477.601360:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605159680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130477.601454:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605159680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130477.601461:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789130477.601479:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130477.601487:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605159552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130477.601511:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605159552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130477.601517:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130477.601539:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159424 00000100:00100000:3.0:1789130477.601542:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159424 00000100:00100000:3.0:1789130477.601566:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159808 00000100:00100000:3.0:1789130477.601569:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159808 00000100:00100000:3.0:1789130477.601589:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130477.601595:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:2367:x1876037605159424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130477.601657:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:2367:x1876037605159424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 61us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130477.601663:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789130477.601676:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789130477.601682:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605159808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130477.601703:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605159808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130477.601708:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130477.601927:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159296 00000100:00100000:2.0:1789130477.601932:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159296 00000100:00100000:2.0:1789130477.601966:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130477.601974:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605159296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130477.602000:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605159296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130477.602007:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00080000:2.0:1789130477.602034:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130477.602040:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130477.602042:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789130478.213941:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130478.341967:0:43702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1641439362292ns, next at 1642439359382ns, rc = 0 00000100:00100000:3.0:1789130478.341990:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130478.342011:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626899584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130478.342252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130478.342351:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899584 00000100:00100000:1.0:1789130478.342359:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899584 00000100:00100000:1.0:1789130478.342438:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130478.342449:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626899584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130478.342481:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130478.342527:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626899584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130478.342534:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789130478.342709:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130478.342746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626899584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130479.239042:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130479.998205:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738462 is committed 00000020:00080000:3.0:1789130479.998248:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b490434780 refcount 2 committed 0 result 0 batchid 30064771677 00000020:00080000:3.0:1789130479.998255:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b49013b0c0 00000020:00080000:3.0:1789130479.998258:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386c5bc00 00000020:00080000:0.0:1789130479.998566:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771677 committed batchid 30064771676 00000020:00080000:0.0:1789130479.998857:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771676 00000004:00080000:3.0:1789130480.001552:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789130480.002423:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130480.002454:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626899712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789130480.002551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130480.002672:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899712 00000100:00100000:1.0:1789130480.002682:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899712 00000100:00100000:1.0:1789130480.002754:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789130480.002764:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626899712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789130480.002801:0:44793:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:227 count 1 00010000:00010000:1.0:1789130480.002836:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.002864:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.002875:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789130480.002880:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130480.002885:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.002919:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.002937:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 6 pid: 44365 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130480.002950:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626899840:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130480.006161:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306300 going to sleep for 11 seconds 00000100:00080000:1.0:1789130480.006204:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130480.016366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130480.016426:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605159936 00000100:00100000:0.0:1789130480.016438:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605159936 00010000:00010000:0.0:1789130480.016509:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 7 pid: 44365 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130480.016553:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130480.016566:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605159936:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130480.016585:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130480.016592:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 7 pid: 44365 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.016640:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 7 pid: 44365 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.016677:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130480.016682:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130480.016689:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.016703:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.016729:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130480.016808:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605159936:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 243us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130480.016816:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00080000:0.0:1789130480.016919:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130480.017758:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cebeca lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac825 expref: 6 pid: 44365 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130480.017780:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626899840:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130480.017817:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.017829:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.017837:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.017849:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.017857:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130480.017888:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130480.018536:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626899712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15770us (15982us total) trans 34359738376 rc 0/0 00000100:00100000:1.0:1789130480.018550:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:1.0:1789130480.018652:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b381fdbc00/2, rc 0, transno 34359738376 00000100:00100000:1.0:1789130480.018659:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626899712:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789130480.020537:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130480.020555:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.020572:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130480.020578:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.020591:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.020639:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.020649:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec013 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130480.020691:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130480.020693:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130480.020695:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130480.262060:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130480.265563:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130480.265577:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130480.265704:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 2 count 2 00000040:00080000:1.0:1789130480.265715:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000001:00080000:1.0:1789130480.537661:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738374 is committed 00000001:00080000:1.0:1789130480.537689:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738376 is committed 00000100:00100000:2.0:1789130480.902720:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626900224:0@lo:400:kworker.0 00000100:00100000:1.0:1789130480.903006:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900096:0@lo:400:kworker.0 00000100:00100000:3.0:1789130480.903161:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626899968:0@lo:400:kworker.0 00000100:00100000:0.0:1789130480.910562:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b390cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626900352:0@lo:400:kworker.0 00000100:00100000:1.0:1789130480.911340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130480.911439:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130480.911474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130480.911520:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900096 00000100:00100000:1.0:1789130480.911529:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900096 00000100:00100000:1.0:1789130480.911618:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130480.911632:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130480.911701:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900096:12345-0@lo:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130480.911711:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130480.911735:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900608 00000100:00100000:1.0:1789130480.911740:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900608 00000100:00100000:1.0:1789130480.911766:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130480.911774:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130480.911821:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3767533568 avail 3765436416 00000100:00100000:1.0:1789130480.911856:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130480.911864:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789130480.911884:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130480.911924:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738373 gen 2 00000004:00080000:1.0:1789130480.911931:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738372 committed transno 34359738373 00000004:00080000:1.0:1789130480.911964:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3828eb0c0, transno 34359738373 00000100:00100000:1.0:1789130480.911985:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130480.911999:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900096:0@lo:400:kworker.0 00000100:00100000:2.0:1789130480.927079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130480.927210:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900224 00000100:00100000:2.0:1789130480.927220:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900224 00000100:00100000:2.0:1789130480.927290:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130480.927303:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130480.927492:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626900224:12345-0@lo:400:kworker.0 Request processed in 191us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130480.927502:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789130480.927596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130480.927597:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626900224:0@lo:400:kworker.0 00000100:00100000:3.0:1789130480.927661:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626899968 00000100:00100000:3.0:1789130480.927665:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626899968 00000100:00100000:3.0:1789130480.927697:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789130480.927705:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626899968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130480.927741:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626899968:12345-0@lo:400:kworker.0 Request processed in 37us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130480.927750:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130480.927786:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626899968:0@lo:400:kworker.0 00000100:00100000:2.0:1789130480.927911:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626900480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130480.927951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130480.930208:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900480 00000100:00100000:3.0:1789130480.930229:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900480 00000100:00100000:3.0:1789130480.930323:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789130480.930345:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626900480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130480.930501:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626900480:12345-0@lo:400:kworker.0 Request processed in 168us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130480.930511:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789130480.930566:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130480.931077:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130480.934132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130480.934948:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900352 00000100:00100000:3.0:1789130480.934961:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900352 00000100:00100000:3.0:1789130480.935896:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130480.935913:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626900352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130480.936443:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626900352:12345-0@lo:400:kworker.0 Request processed in 533us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130480.936453:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130480.937907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b390cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626900352:0@lo:400:kworker.0 00000100:00080000:1.0:1789130480.940711:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789130480.990887:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738374 is committed 00010000:00010000:3.0:1789130481.289125:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130482.316163:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130482.714364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130482.714425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130482.714456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130482.714517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130482.714555:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160320 00000100:00100000:1.0:1789130482.714569:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160320 00000100:00100000:1.0:1789130482.714697:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789130482.714709:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605160320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130482.714829:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605160320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 120us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130482.714839:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00080000:1.0:1789130482.714868:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130482.715141:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160192 00000100:00100000:3.0:1789130482.715146:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160192 00000100:00100000:3.0:1789130482.715204:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160576 00000100:00100000:3.0:1789130482.715207:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160576 00000100:00100000:3.0:1789130482.715231:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130482.715239:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605160192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130482.715292:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605160192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130482.715300:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130482.715333:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130482.715349:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605160576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130482.715376:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605160576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130482.715382:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789130482.715630:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160064 00000100:00100000:0.0:1789130482.715635:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160064 00000100:00100000:0.0:1789130482.715673:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:0.0:1789130482.715681:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605160064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130482.715715:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605160064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130482.715721:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00080000:1.0:1789130482.715986:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130482.721689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130482.721808:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160448 00000100:00100000:0.0:1789130482.721822:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160448 00000100:00100000:0.0:1789130482.721926:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130482.721940:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605160448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130482.722047:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605160448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130482.722057:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00080000:2.0:1789130482.722366:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130483.074965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130483.075138:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160704 00000100:00100000:3.0:1789130483.075152:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160704 00000100:00100000:3.0:1789130483.075235:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:3.0:1789130483.075247:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:45977:x1876037605160704:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789130483.075404:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:45977:x1876037605160704:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 159us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130483.075413:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:3.0:1789130483.081225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130483.081746:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605160960 00000100:00100000:0.0:1789130483.081763:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605160960 00000100:00100000:0.0:1789130483.081863:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1789130483.081877:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:45977:x1876037605160960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130483.082923:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:45977:x1876037605160960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1041us (1705us total) trans 34359738463 rc 0/0 00000100:00100000:0.0:1789130483.082938:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:3.0:1789130483.333912:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130483.464420:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130483.464466:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626900736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130483.464573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130483.464748:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900736 00000100:00100000:1.0:1789130483.464759:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900736 00000100:00100000:1.0:1789130483.464858:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130483.464870:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626900736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130483.464922:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130483.465000:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626900736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130483.465007:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789130483.465192:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130483.465502:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738376 gen 2 00000004:00080000:0.0:1789130483.465510:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738375 committed transno 34359738376 00000004:00080000:0.0:1789130483.465536:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b381fdbc00, transno 34359738376 00000100:00100000:0.0:1789130483.465563:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626900736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130484.359340:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130485.112079:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738463 is committed 00000020:00080000:3.0:1789130485.112097:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771677 batchid updated 00000020:00080000:3.0:1789130485.112119:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771677 00000020:00080000:3.0:1789130485.112130:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771677 00000001:02000400:1.0:1789130485.198081:0:46209:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 15: Test auto attach at open when file is still valid cached ========================================================== 08:41:23 (1789130483) 00010000:00010000:3.0:1789130485.390441:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130486.027078:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130486.027100:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626900864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130486.027259:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900864 00000100:00100000:1.0:1789130486.027267:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900864 00000100:00100000:1.0:1789130486.027325:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789130486.027335:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626900864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027388:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626900864:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130486.027396:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789130486.027445:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626900864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027485:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130486.027493:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130486.027568:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626900992 00000100:00100000:1.0:1789130486.027572:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626900992 00000100:00100000:1.0:1789130486.027631:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130486.027640:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027678:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626900992:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130486.027685:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789130486.027702:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130486.027727:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626900992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027756:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626901120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027780:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130486.027806:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626901120 00000100:00100000:1.0:1789130486.027809:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626901120 00000100:00100000:1.0:1789130486.027849:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130486.027856:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626901120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027893:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626901120:12345-0@lo:400:kworker.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130486.027899:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789130486.027912:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130486.027929:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626901120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027959:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626901248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.027986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130486.028024:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130486.028030:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626901376:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.028053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130486.028088:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130486.028095:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626901504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.028117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130486.030043:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130486.030067:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626901632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130486.030139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130486.030209:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626901248 00000100:00100000:3.0:1789130486.030216:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626901248 00000100:00100000:3.0:1789130486.030277:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626901376 00000100:00100000:3.0:1789130486.030290:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626901376 00000100:00100000:3.0:1789130486.030314:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626901504 00000100:00100000:3.0:1789130486.030317:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626901504 00000100:00100000:3.0:1789130486.030331:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789130486.030338:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626901248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130486.030388:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626901248:12345-0@lo:400:kworker.0 Request processed in 50us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130486.030395:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789130486.030410:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130486.030415:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626901376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130486.030443:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626901376:12345-0@lo:400:kworker.0 Request processed in 27us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130486.030449:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130486.030460:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130486.030467:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626901504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130486.030493:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626901504:12345-0@lo:400:kworker.0 Request processed in 28us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130486.030498:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789130486.030723:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130486.034163:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626901504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.034213:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626901376:0@lo:400:kworker.0 00000100:00100000:1.0:1789130486.034225:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626901248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130486.034933:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626901632 00000100:00100000:0.0:1789130486.034942:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626901632 00000100:00100000:0.0:1789130486.035008:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130486.035019:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626901632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130486.035057:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130486.035150:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626901632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130486.035156:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130486.036667:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626901632:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130486.405851:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130487.431801:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130487.588765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.588850:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161088 00000100:00100000:3.0:1789130487.588860:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161088 00000100:00100000:3.0:1789130487.588940:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789130487.588952:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:46758:x1876037605161088:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130487.588976:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130487.588998:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac887 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589056:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589069:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589081:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589096:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589103:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589109:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589448:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589458:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589465:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130487.589535:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789130487.589539:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130487.589644:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589657:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589663:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589670:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589676:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.589680:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589687:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589699:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:3.0:1789130487.589702:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.589707:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589713:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589724:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589730:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589741:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589746:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.589749:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589756:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589763:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b488939600) 00010000:00010000:3.0:1789130487.589765:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.589768:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589772:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589799:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac887 expref: 10 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589811:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac887 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.589819:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130487.589821:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130487.589823:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:3.0:1789130487.589876:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:46758:x1876037605161088:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 927us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130487.589888:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00080000:1.0:1789130487.590519:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130487.594889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.594971:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161344 00000100:00100000:3.0:1789130487.594980:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161344 00000100:00100000:3.0:1789130487.595032:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:3.0:1789130487.595041:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:46758:x1876037605161344:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130487.595061:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130487.595081:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec036 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac88e expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595150:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595164:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595175:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595189:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595197:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595213:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595638:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec04b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595652:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec04b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595660:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec04b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130487.595668:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789130487.595834:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595843:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595849:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595854:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.595859:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595866:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595877:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130487.595881:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.595885:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595892:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec03d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595902:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595909:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595915:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595921:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.595923:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595929:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595935:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b488939400) 00010000:00010000:3.0:1789130487.595937:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.595940:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.595945:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec044 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.596296:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec036 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac88e expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.596310:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec04b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac88e expref: 11 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.596317:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130487.596320:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.596323:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:3.0:1789130487.596379:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605161344:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1338us (1498us total) trans 34359738464 rc 0/0 00000100:00100000:3.0:1789130487.596387:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:2.0:1789130487.607484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.607955:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161472 00000100:00100000:3.0:1789130487.607968:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161472 00000100:00100000:3.0:1789130487.608022:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789130487.608032:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605161472:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789130487.608165:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605161472:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 134us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130487.608174:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130487.776907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.777006:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161600 00000100:00100000:3.0:1789130487.777016:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161600 00000100:00100000:3.0:1789130487.777085:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789130487.777108:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46767:x1876037605161600:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130487.777130:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130487.777151:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac895 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777227:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777241:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777464:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777482:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777490:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.777497:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777926:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777935:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777941:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777947:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.777951:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777958:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777971:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:2.0:1789130487.777974:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.777979:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777985:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.777997:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778002:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778009:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778013:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.778015:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778021:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778027:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b488939600) 00010000:00010000:2.0:1789130487.778030:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.778032:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778037:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec067 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778068:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec059 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac895 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778078:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:2.0:1789130487.778080:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.778084:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac895 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.778093:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:2.0:1789130487.778331:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46767:x1876037605161600:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1236us (1432us total) trans 0 rc 301/301 00000100:00100000:2.0:1789130487.778343:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789130487.802060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.803274:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161856 00000100:00100000:3.0:1789130487.803286:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161856 00000100:00100000:3.0:1789130487.803352:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1789130487.803363:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46767:x1876037605161856:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:3.0:1789130487.803426:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130487.803456:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cebfbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac86b expref: 11 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803479:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bdb00) 00010000:00010000:3.0:1789130487.803490:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130487.803838:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803853:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803863:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803876:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803884:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.803891:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130487.808593:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:3.0:1789130487.808631:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808643:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808650:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808656:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.808662:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808670:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808688:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130487.808691:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130487.808696:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.808703:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec06e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130487.808724:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000659119d9 reply state 00000000922e3a12 transno 34359738465 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130487.808737:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130487.808839:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:46767:x1876037605161856:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 5475us (6785us total) trans 34359738465 rc 0/0 00000100:00100000:3.0:1789130487.808848:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00010000:00010000:2.0:1789130487.819081:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819101:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819118:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819125:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.819130:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819138:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819156:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b488939800) 00010000:00010000:2.0:1789130487.819159:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.819164:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.819171:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec075 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130487.820590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130487.820704:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605161984 00000100:00100000:0.0:1789130487.820715:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605161984 00000100:00100000:0.0:1789130487.820776:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:0.0:1789130487.820787:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:46768:x1876037605161984:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:0.0:1789130487.820814:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130487.820836:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec07c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac89c expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.820906:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.820917:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.820928:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130487.821002:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130487.821006:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130487.821032:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.821057:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec07c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac89c expref: 13 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.821072:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac89c expref: 12 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.821080:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130487.821082:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130487.821085:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130487.821148:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46768:x1876037605161984:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 362us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130487.821155:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:3.0:1789130487.836983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.837038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130487.837078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130487.837229:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162496 00000100:00100000:2.0:1789130487.837238:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162496 00000100:00100000:2.0:1789130487.837307:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130487.837318:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605162496:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130487.837392:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605162496:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130487.837395:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162240 00000100:00100000:1.0:1789130487.837399:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162240 00000100:00100000:2.0:1789130487.837400:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789130487.837426:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130487.837432:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605162240:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130487.837459:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605162240:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130487.837465:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00080000:1.0:1789130487.837494:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130487.837801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130487.837846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130487.837911:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162368 00000100:00100000:0.0:1789130487.837911:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162112 00000100:00100000:2.0:1789130487.837915:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162368 00000100:00100000:0.0:1789130487.837915:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162112 00000100:00100000:0.0:1789130487.837950:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162624 00000100:00100000:2.0:1789130487.837954:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130487.837954:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162624 00000100:00100000:2.0:1789130487.837966:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605162368:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130487.837990:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1789130487.838000:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605162624:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130487.838014:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:2.0:1789130487.838015:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605162368:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130487.838028:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605162624:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130487.838029:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130487.838035:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130487.838048:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:46768:x1876037605162112:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:0.0:1789130487.838349:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130487.838382:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec08a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8a3 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838480:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838498:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838512:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838528:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838535:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838541:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838696:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130487.838707:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130487.838711:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838722:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130487.838724:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00200000:0.0:1789130487.838774:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000004:00200000:0.0:1789130487.838779:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130487.838819:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838834:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838842:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838849:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838857:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130487.838861:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838869:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838884:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130487.838887:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130487.838893:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.838904:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839280:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839288:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839294:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839300:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130487.839303:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839310:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839318:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b497c01600) 00010000:00010000:0.0:1789130487.839321:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130487.839324:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839331:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec098 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839371:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec08a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8a3 expref: 14 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839535:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8a3 expref: 13 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.839544:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130487.839546:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130487.839549:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130487.840471:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:46768:x1876037605162112:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 2431us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130487.840482:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789130487.854501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130487.854628:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605162880 00000100:00100000:0.0:1789130487.854641:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605162880 00000100:00100000:0.0:1789130487.854726:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:0.0:1789130487.854739:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:46768:x1876037605162880:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:0.0:1789130487.854810:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130487.854846:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec09f lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8a3 expref: 13 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.854867:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130487.854890:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130487.854935:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.854950:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.854960:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130487.855291:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005a8dc8e2 reply state 00000000c8dca12b transno 34359738466 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130487.855302:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789130487.855318:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000100:00100000:0.0:1789130487.855424:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:46768:x1876037605162880:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 685us (935us total) trans 34359738466 rc 0/0 00000100:00100000:0.0:1789130487.855433:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00010000:00010000:3.0:1789130487.859050:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859075:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859083:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859090:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130487.859095:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859105:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859127:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01600) 00010000:00010000:3.0:1789130487.859130:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789130487.859136:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130487.859144:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec0a6 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130487.971326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130487.971446:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605163008 00000100:00100000:2.0:1789130487.971461:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605163008 00000100:00100000:2.0:1789130487.971546:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130487.971559:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:46774:x1876037605163008:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:2.0:1789130487.971643:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130487.971673:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec0ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8aa expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971763:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971780:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971815:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971841:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971849:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.971856:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972232:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972242:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972260:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130487.972292:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000004:00200000:2.0:1789130487.972296:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130487.972326:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972340:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972348:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972355:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972366:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.972371:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972378:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972393:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130487.972396:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.972404:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972410:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972427:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972433:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972440:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972445:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.972448:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972455:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972467:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b48a1fd200) 00010000:00010000:2.0:1789130487.972469:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.972471:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972477:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972517:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec0ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8aa expref: 15 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972531:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8aa expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.972538:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130487.972541:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130487.972543:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130487.972697:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:46774:x1876037605163008:12345-192.168.201.39@tcp:101:dd.500 Request processed in 1140us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130487.972706:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789130487.983962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130487.984132:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605163264 00000100:00100000:0.0:1789130487.984146:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605163264 00000100:00100000:0.0:1789130487.984235:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:0.0:1789130487.984259:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:46774:x1876037605163264:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:0.0:1789130487.984290:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130487.984319:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec0c9 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8b1 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.984536:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.984556:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.984572:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.985072:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.985083:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.985092:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130487.987048:0:43681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe4:0x0], index 0: 0 00010000:00010000:0.0:1789130487.987384:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987405:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987418:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987466:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987475:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987483:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987489:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130487.987495:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987502:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987517:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130487.987521:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130487.987527:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.987534:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec0d0 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130487.987552:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000042ab52b6 reply state 00000000f517214c transno 34359738467 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130487.987562:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130487.988349:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec0c9 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.988374:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130487.988383:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130487.988386:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130487.988388:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130487.988507:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:46774:x1876037605163264:12345-192.168.201.39@tcp:101:dd.500 Request processed in 4260us (4560us total) trans 34359738467 rc 0/0 00000100:00100000:0.0:1789130487.988518:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00010000:00010000:2.0:1789130487.993072:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993095:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993103:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993111:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130487.993117:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993126:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993147:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01d00) 00010000:00010000:2.0:1789130487.993151:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130487.993156:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130487.993164:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec0d7 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130488.002808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.003477:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605163392 00000100:00100000:1.0:1789130488.003493:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605163392 00000100:00100000:1.0:1789130488.003578:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130488.003634:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:46774:x1876037605163392:12345-192.168.201.39@tcp:101:dd.500 00010000:00010000:1.0:1789130488.003660:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130488.003693:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8b8 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130488.003729:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130488.003757:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=1651s v=(0 0) 00010000:00010000:1.0:1789130488.003763:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130488.003775:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.003797:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.003814:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130488.003914:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:46774:x1876037605163392:12345-192.168.201.39@tcp:101:dd.500 Request processed in 313us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130488.003928:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789130488.006919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.007747:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605163648 00000100:00100000:1.0:1789130488.007764:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605163648 00000100:00100000:1.0:1789130488.007851:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130488.007862:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:46774:x1876037605163648:12345-192.168.201.39@tcp:35:dd.500 00000100:00100000:1.0:1789130488.008813:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46774:x1876037605163648:12345-192.168.201.39@tcp:35:dd.500 Request processed in 945us (1903us total) trans 34359738468 rc 0/0 00000100:00100000:1.0:1789130488.008826:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789130488.142853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130488.143356:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605163776 00000100:00100000:2.0:1789130488.143366:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605163776 00000100:00100000:2.0:1789130488.143490:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1789130488.143502:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46780:x1876037605163776:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:2.0:1789130488.143526:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130488.143547:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8bf expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.143662:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.143677:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.143696:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130488.144040:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000004:00200000:2.0:1789130488.144045:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130488.144089:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.144117:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec0f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8bf expref: 19 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.144136:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8bf expref: 18 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.144145:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130488.144148:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130488.144152:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130488.144217:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46780:x1876037605163776:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 718us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130488.144225:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:3.0:1789130488.149058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.149213:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164032 00000100:00100000:0.0:1789130488.149222:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164032 00000100:00100000:0.0:1789130488.149289:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1789130488.149300:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:46780:x1876037605164032:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130488.149322:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130488.149343:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec101 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8c6 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.149447:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec108 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.149461:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec108 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.149484:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec108 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130488.149496:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:0.0:1789130488.149902:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec101 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8c6 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.149976:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec108 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8c6 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.149986:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130488.149990:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130488.149993:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130488.150057:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:46780:x1876037605164032:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 759us (1009us total) trans 34359738469 rc 0/0 00000100:00100000:0.0:1789130488.150065:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789130488.154207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130488.154263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.154696:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164288 00000100:00100000:0.0:1789130488.154706:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164288 00000100:00100000:0.0:1789130488.154769:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:0.0:1789130488.154780:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:46780:x1876037605164288:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130488.154803:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130488.154823:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec116 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8cd expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.154928:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.154943:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.154955:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130488.154967:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:0.0:1789130488.155095:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec116 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8cd expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.155113:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8cd expref: 22 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.155122:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130488.155125:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130488.155129:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130488.155189:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:46780:x1876037605164288:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 411us (991us total) trans 34359738470 rc 0/0 00000100:00100000:0.0:1789130488.155197:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789130488.164181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130488.164835:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164544 00000100:00100000:3.0:1789130488.164846:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164544 00000100:00100000:3.0:1789130488.164999:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789130488.165015:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605164544:12345-192.168.201.39@tcp:1:lfs.500 00010000:00010000:3.0:1789130488.165061:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.165082:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.165091:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130488.165095:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130488.165099:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.165133:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.165152:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 6 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130488.165167:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626901760:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130488.165283:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130488.168084:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164416 00000100:00100000:2.0:1789130488.168095:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164416 00000100:00100000:1.0:1789130488.168497:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626901760:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130488.168525:0:44367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130488.169484:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789130488.169496:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+22:2367:x1876037605164416:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130488.169513:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130488.169537:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec108 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8c6 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.169555:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:3.0:1789130488.169560:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130488.169996:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:2367:x1876037605164416:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 500us (15729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130488.170005:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789130488.170591:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130488.171077:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164672 00000100:00100000:2.0:1789130488.171085:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164672 00002000:00100000:2.0:1789130488.171125:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe4:0x0] (0->1023) req@ffff90b3828eb0c0 x1876037605164672/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:204/0 lens 1512/0 e 0 to 0 dl 1789130499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130488.171136:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828eb0c0 with x1876037605164672 ext(0->1023) 00010000:00010000:2.0:1789130488.171145:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 7 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.171161:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 7 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130488.171170:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b3828eb0c0 00000100:00100000:2.0:1789130488.171203:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789130488.171212:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605164672:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789130488.174162:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605164672:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 2940us (3561us total) trans 34359738377 rc 0/0 00000100:00100000:2.0:1789130488.174177:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:2.0:1789130488.174447:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe4:0x0] (0->1023) req@ffff90b3828eb0c0 x1876037605164672/t34359738377(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:204/0 lens 1512/448 e 0 to 0 dl 1789130499 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130488.174460:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3828eb0c0 with x1876037605164672 ext(0->1023) 00010000:00010000:2.0:1789130488.174531:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.174549:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130488.174558:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b3828eb0c0 00000100:00100000:1.0:1789130488.178402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.178571:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605164800 00000100:00100000:0.0:1789130488.178581:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605164800 00010000:00010000:0.0:1789130488.179024:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130488.179068:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789130488.179078:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605164800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130488.179093:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130488.179110:0:45795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe4:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1789130488.179113:0:45795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe4:0x0] updating lvb mtime from disk: 0 -> 1789130487 00002000:00010000:0.0:1789130488.179115:0:45795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe4:0x0] updating lvb atime from disk: 0 -> 1789130487 00002000:00010000:0.0:1789130488.179118:0:45795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe4:0x0] updating lvb ctime from disk: 0 -> 1789130487 00010000:00010000:0.0:1789130488.179123:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.179139:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.179162:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3b04c3/0x5c74554e47cec0ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b8 expref: 9 pid: 44366 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.179178:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130488.179182:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130488.179188:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.179209:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.179254:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130488.179302:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605164800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 226us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130488.179310:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00010000:00010000:3.0:1789130488.181368:0:44367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181385:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181418:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181431:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181439:0:44367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181446:0:44367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130488.181451:0:44367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181471:0:44367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181489:0:44367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.181496:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b17021b/0x5c74554e47cec12b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130488.181636:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605164544:12345-192.168.201.39@tcp:1:lfs.500 Request processed in 16591us (17429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130488.181646:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130488.193501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.196092:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165056 00000100:00100000:0.0:1789130488.196107:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165056 00000100:00100000:0.0:1789130488.196182:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130488.196200:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:46780:x1876037605165056:12345-192.168.201.39@tcp:35:lfs.500 00000004:00010000:0.0:1789130488.196286:0:43682:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8cd expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130488.196582:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738471 00000001:00080000:0.0:1789130488.197069:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738472 00000001:00080000:1.0:1789130488.198855:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738473 00010000:00010000:1.0:1789130488.199139:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.199159:0:43682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.199169:0:43682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.200025:0:43682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.200044:0:43682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 25 pid: 43681 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130488.200060:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626901888:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130488.200293:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130488.207351:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.208320:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626901888:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130488.208348:0:43682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130488.213113:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165184 00000100:00100000:0.0:1789130488.213128:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165184 00010000:00010000:0.0:1789130488.213200:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 26 pid: 43681 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130488.213257:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789130488.213268:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605165184:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130488.213285:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130488.213294:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 26 pid: 43681 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213308:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 26 pid: 43681 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213330:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec0de lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8b1 expref: 26 pid: 43681 timeout: 1751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213345:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:0.0:1789130488.213351:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213361:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213368:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.213404:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130488.213475:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:2370:x1876037605165184:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 210us (6133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130488.213483:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00010000:00010000:1.0:1789130488.213689:0:43682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.213698:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130488.214898:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738474 00000001:00080000:1.0:1789130488.215166:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738475 00000100:00100000:1.0:1789130488.215286:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626902016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789130488.215345:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130488.215416:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130488.219848:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626902016 00000100:00100000:0.0:1789130488.219864:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626902016 00000100:00080000:2.0:1789130488.221911:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130488.222017:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130488.222030:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626902016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789130488.222155:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626902016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130488.222163:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130488.222417:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626902016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130488.223053:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738476 00000100:00100000:2.0:1789130488.223157:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626902144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130488.223211:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130488.223248:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130488.223271:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626902144 00000100:00100000:1.0:1789130488.223277:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626902144 00000100:00100000:1.0:1789130488.223365:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130488.223374:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626902144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789130488.223542:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43682:x1876037626902144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (330us total) trans 34359738378 rc 0/0 00000100:00100000:1.0:1789130488.223548:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130488.223652:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3868a12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626902144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130488.223715:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738477 00010000:00010000:2.0:1789130488.223758:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.223768:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.223776:0:43682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.223786:0:43682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130488.223791:0:43682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.223798:0:43682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.223814:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:2.0:1789130488.227326:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130488.227341:0:43682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130488.227353:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec132 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130488.227774:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130488.227891:0:43682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].5, 64 off8536 00000004:00080000:2.0:1789130488.227904:0:43682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1651325300957ns, next at 1652325296837ns, rc = 0 00000001:00080000:2.0:1789130488.227912:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738478 00010000:00010000:2.0:1789130488.227968:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01f00) 00010000:00010000:2.0:1789130488.227971:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130488.227980:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec11d lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8cd expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130488.228114:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:46780:x1876037605165056:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 31922us (34621us total) trans 34359738479 rc 0/0 00000100:00100000:2.0:1789130488.228125:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000020:00080000:2.0:1789130488.228131:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789130488.232685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130488.233568:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165312 00000100:00100000:3.0:1789130488.233579:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165312 00000100:00100000:3.0:1789130488.233656:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:3.0:1789130488.233667:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:46780:x1876037605165312:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130488.233691:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130488.233714:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec139 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8d4 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.233785:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec139 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8d4 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.233800:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec139 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8d4 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.233820:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130488.233823:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130488.233828:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:3.0:1789130488.233898:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:46780:x1876037605165312:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 233us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130488.233906:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:3.0:1789130488.242052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.243562:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165568 00000100:00100000:1.0:1789130488.243575:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165568 00000100:00100000:1.0:1789130488.244329:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130488.244342:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:46780:x1876037605165568:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:1.0:1789130488.244598:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:46780:x1876037605165568:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 259us (2555us total) trans 34359738480 rc 0/0 00000100:00100000:1.0:1789130488.244800:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789130488.383308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.383420:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165824 00000100:00100000:0.0:1789130488.383431:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165824 00000100:00100000:0.0:1789130488.383508:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:0.0:1789130488.383520:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:46786:x1876037605165824:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130488.383545:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130488.383567:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8db expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130488.383715:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:0.0:1789130488.383856:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec140 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8db expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.383872:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130488.383875:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130488.383881:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8db expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.383895:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130488.383962:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:46786:x1876037605165824:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 445us (663us total) trans 34359738481 rc 301/301 00000100:00100000:0.0:1789130488.383969:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:3.0:1789130488.401969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.402110:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605165952 00000100:00100000:0.0:1789130488.402119:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605165952 00000100:00100000:0.0:1789130488.402181:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:0.0:1789130488.402201:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46786:x1876037605165952:12345-192.168.201.39@tcp:34:lfs.500 00010000:00010000:0.0:1789130488.402285:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402302:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402314:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402329:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402335:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402341:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402450:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402470:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402477:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130488.402512:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402524:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402530:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402537:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402542:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.402547:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402555:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402567:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130488.402571:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.402578:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402584:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec14e lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402596:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402656:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402662:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402667:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.402669:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402675:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402681:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01200) 00010000:00010000:0.0:1789130488.402684:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.402686:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402691:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec155 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402704:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402709:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402715:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402719:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.402722:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402726:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402732:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130488.402734:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.402737:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.402743:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec15c lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130488.402830:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46786:x1876037605165952:12345-192.168.201.39@tcp:34:lfs.500 Request processed in 639us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130488.402839:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1789130488.405112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.405205:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605166208 00000100:00100000:1.0:1789130488.405214:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605166208 00000100:00100000:1.0:1789130488.405272:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789130488.405281:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:46786:x1876037605166208:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:1.0:1789130488.405523:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:46786:x1876037605166208:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 242us (415us total) trans 34359738482 rc 0/0 00000100:00100000:1.0:1789130488.405532:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000040:00080000:3.0:1789130488.453881:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130488.453892:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130488.453933:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 2 count 2 00000040:00080000:3.0:1789130488.453940:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:2.0:1789130488.454263:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130488.566498:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.566731:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605166464 00000100:00100000:0.0:1789130488.566747:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605166464 00000100:00100000:0.0:1789130488.566852:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789130488.567058:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:46796:x1876037605166464:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130488.567099:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130488.567130:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8e2 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130488.567311:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:0.0:1789130488.567491:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec163 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8e2 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.567511:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130488.567514:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130488.567520:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8e2 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.567539:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130488.568310:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:46796:x1876037605166464:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1442us (1821us total) trans 34359738483 rc 301/301 00000100:00100000:0.0:1789130488.568322:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789130488.572856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.573053:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605166592 00000100:00100000:0.0:1789130488.573068:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605166592 00000100:00100000:0.0:1789130488.573154:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:0.0:1789130488.573167:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:46796:x1876037605166592:12345-192.168.201.39@tcp:34:lfs.500 00010000:00010000:0.0:1789130488.573296:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573317:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573329:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573351:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573357:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573363:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573510:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573519:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573527:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130488.573576:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573636:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573643:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573652:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573659:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.573665:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573675:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573689:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130488.573692:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.573698:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573705:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec171 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573722:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573728:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573734:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573738:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.573741:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573747:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573753:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01200) 00010000:00010000:0.0:1789130488.573756:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.573759:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573764:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec178 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573779:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573786:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573791:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573796:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.573799:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573805:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573812:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130488.573815:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.573817:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.573823:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec17f lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130488.573920:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:46796:x1876037605166592:12345-192.168.201.39@tcp:34:lfs.500 Request processed in 754us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130488.573929:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789130488.576937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.578410:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605166848 00000100:00100000:0.0:1789130488.578429:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605166848 00000100:00100000:0.0:1789130488.578525:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789130488.578537:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:46796:x1876037605166848:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130488.578941:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:46796:x1876037605166848:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 405us (2017us total) trans 34359738484 rc 0/0 00000100:00100000:0.0:1789130488.578951:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130488.587520:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626902272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130488.587662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130488.588643:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626902272 00000100:00100000:3.0:1789130488.588657:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626902272 00000100:00100000:3.0:1789130488.588730:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789130488.588743:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626902272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130488.588775:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130488.589001:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626902272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130488.589010:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130488.592688:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626902272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130488.712059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.712559:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605166976 00000100:00100000:0.0:1789130488.712579:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605166976 00000100:00100000:0.0:1789130488.712762:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789130488.712777:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:44606:x1876037605166976:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130488.712819:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00010000:00010000:0.0:1789130488.712874:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac89c expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.712906:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130488.712932:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec139 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8d4 expref: 33 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.712945:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130488.712962:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec0fa lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8bf expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.712977:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec0c2 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8aa expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.712989:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130488.713004:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec04b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac88e expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.713014:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130488.713025:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec02f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac887 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.713035:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939200) 00010000:00010000:0.0:1789130488.713047:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cebff7 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac879 expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.713057:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xf:0x0].0x0 (ffff90b48a1fd900) 00010000:00010000:0.0:1789130488.713070:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cebfdb lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac872 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.713081:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130488.713088:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130488.713897:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:44606:x1876037605166976:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1116us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130488.713911:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789130488.868103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130488.868297:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605167104 00000100:00100000:1.0:1789130488.868311:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605167104 00000100:00100000:1.0:1789130488.868393:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:1.0:1789130488.868406:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:46812:x1876037605167104:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130488.868439:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130488.868467:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8e9 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868552:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868570:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868584:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130488.868735:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130488.868740:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130488.868768:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868813:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8e9 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868836:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8e9 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130488.868846:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130488.868850:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130488.869483:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130488.869592:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:46812:x1876037605167104:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 1186us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130488.869644:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789130488.872429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.872597:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605167360 00000100:00100000:0.0:1789130488.872651:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605167360 00000100:00100000:0.0:1789130488.872721:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130488.872732:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:46812:x1876037605167360:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130488.872758:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130488.872783:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8f0 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872898:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872916:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872931:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872949:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872956:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.872964:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130488.873147:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:0.0:1789130488.873308:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873317:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873324:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873330:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.873334:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873346:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873361:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:0.0:1789130488.873364:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.873370:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873377:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec19b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873394:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873400:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873405:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873410:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130488.873413:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873420:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873427:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b497c01800) 00010000:00010000:0.0:1789130488.873429:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130488.873432:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873441:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873490:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8f0 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873502:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:0.0:1789130488.873505:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130488.873508:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8f0 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130488.873518:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130488.873639:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:46812:x1876037605167360:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 909us (1226us total) trans 34359738485 rc 301/301 00000100:00100000:0.0:1789130488.873648:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789130488.878047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130488.878569:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605167488 00000100:00100000:3.0:1789130488.878585:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605167488 00000100:00100000:3.0:1789130488.878705:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130488.878717:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:46812:x1876037605167488:12345-192.168.201.39@tcp:34:lfs.500 00010000:00010000:3.0:1789130488.879331:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879357:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879373:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879390:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879398:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879411:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879558:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.879566:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881032:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130488.881141:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881158:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881164:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881172:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881178:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130488.881183:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881191:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881210:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b488939300) 00010000:00010000:3.0:1789130488.881214:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130488.881219:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881224:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec1b0 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881267:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881273:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881279:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881284:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130488.881287:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881293:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881301:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939b00) 00010000:00010000:3.0:1789130488.881304:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130488.881306:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881312:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec1b7 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881325:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881332:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881338:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881343:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130488.881346:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881352:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881361:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939a00) 00010000:00010000:3.0:1789130488.881363:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130488.881366:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130488.881371:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec1be lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130488.881506:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:46812:x1876037605167488:12345-192.168.201.39@tcp:34:lfs.500 Request processed in 2784us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130488.881518:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130488.885458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130488.885559:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605167744 00000100:00100000:0.0:1789130488.885572:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605167744 00000100:00100000:0.0:1789130488.885681:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:0.0:1789130488.885694:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:46812:x1876037605167744:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:0.0:1789130488.886069:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:46812:x1876037605167744:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 377us (624us total) trans 34359738486 rc 0/0 00000100:00100000:0.0:1789130488.886078:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130489.007804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.007976:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605167872 00000100:00100000:0.0:1789130489.007988:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605167872 00000100:00100000:0.0:1789130489.008090:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:0.0:1789130489.008118:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:46818:x1876037605167872:12345-192.168.201.39@tcp:101:multiop.500 00010000:00010000:0.0:1789130489.008154:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130489.008193:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec1c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8f7 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008292:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008311:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008327:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008346:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008353:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008359:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008533:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008541:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008548:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130489.008584:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000004:00200000:0.0:1789130489.008588:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130489.008702:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008717:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008725:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008732:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008739:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130489.008743:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008752:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008768:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:0.0:1789130489.008771:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130489.008777:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008783:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008798:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008808:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008814:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008820:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130489.008823:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008829:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008836:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b497c01800) 00010000:00010000:0.0:1789130489.008838:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130489.008841:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.008847:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.009115:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec1c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8f7 expref: 31 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.009133:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8f7 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.009141:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130489.009143:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130489.009146:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130489.009247:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+30:46818:x1876037605167872:12345-192.168.201.39@tcp:101:multiop.500 Request processed in 1145us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130489.009257:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00080000:2.0:1789130489.010055:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130489.029046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.029403:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605168128 00000100:00100000:0.0:1789130489.029417:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605168128 00000100:00100000:0.0:1789130489.029496:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:0.0:1789130489.029509:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+30:46818:x1876037605168128:12345-192.168.201.39@tcp:101:multiop.500 00010000:00010000:0.0:1789130489.029537:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130489.029564:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec1e1 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac8fe expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029709:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029727:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029740:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029757:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029764:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.029771:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.030040:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.030051:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.030058:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130489.030070:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:0.0:1789130489.031352:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031370:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031377:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031384:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130489.031389:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031398:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031416:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130489.031420:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130489.031425:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031431:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec1e8 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031450:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031456:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031461:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031467:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130489.031469:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031475:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031483:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01800) 00010000:00010000:0.0:1789130489.031485:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130489.031488:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031494:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec1ef lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031563:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec1e1 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031578:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 32 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.031591:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130489.031593:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130489.031595:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130489.033551:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:46818:x1876037605168128:12345-192.168.201.39@tcp:101:multiop.500 Request processed in 4028us (4507us total) trans 34359738487 rc 0/0 00000100:00100000:0.0:1789130489.033568:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789130489.039921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.040077:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605168384 00000100:00100000:0.0:1789130489.040090:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605168384 00000100:00100000:0.0:1789130489.040176:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1789130489.040198:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:46818:x1876037605168384:12345-192.168.201.39@tcp:35:multiop.500 00000100:00100000:0.0:1789130489.040536:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:46818:x1876037605168384:12345-192.168.201.39@tcp:35:multiop.500 Request processed in 340us (628us total) trans 34359738488 rc 0/0 00000100:00100000:0.0:1789130489.040546:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130489.183354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.183493:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605168640 00000100:00100000:1.0:1789130489.183508:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605168640 00000100:00100000:1.0:1789130489.183648:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:1.0:1789130489.183662:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:46828:x1876037605168640:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130489.183705:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130489.183732:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac905 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130489.183920:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:1.0:1789130489.184100:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec204 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac905 expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.184119:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130489.184122:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130489.184128:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac905 expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.184144:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ee00, rc 0) 00000100:00100000:1.0:1789130489.184247:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:46828:x1876037605168640:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 588us (909us total) trans 34359738489 rc 301/301 00000100:00100000:1.0:1789130489.184255:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:0.0:1789130489.201520:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.201660:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605168896 00000100:00100000:1.0:1789130489.201675:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605168896 00000100:00100000:1.0:1789130489.201752:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789130489.201774:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:46828:x1876037605168896:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:1.0:1789130489.202188:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:46828:x1876037605168896:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 412us (671us total) trans 34359738490 rc 0/0 00000100:00100000:1.0:1789130489.202197:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789130489.341046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.342332:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605169024 00000100:00100000:0.0:1789130489.342349:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605169024 00000100:00100000:0.0:1789130489.342508:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789130489.342523:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:46834:x1876037605169024:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130489.342559:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130489.342593:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac90c expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.342748:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.342782:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.343929:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130489.344030:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00000004:00200000:0.0:1789130489.344035:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130489.344069:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.344114:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac90c expref: 37 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.344583:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac90c expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.344596:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130489.344600:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130489.344666:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130489.344768:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+36:46834:x1876037605169024:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 2248us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130489.344779:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1789130489.356863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.357075:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605169280 00000100:00100000:1.0:1789130489.357088:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605169280 00000100:00100000:1.0:1789130489.357162:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:1.0:1789130489.357185:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:46834:x1876037605169280:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130489.357215:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130489.357254:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec220 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac913 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.357389:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec227 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.357408:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec227 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.357423:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec227 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130489.357437:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:1.0:1789130489.357670:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec220 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac913 expref: 39 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.357693:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec227 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac913 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.357703:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130489.357706:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130489.357711:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130489.357783:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:46834:x1876037605169280:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 611us (940us total) trans 34359738491 rc 0/0 00000100:00100000:1.0:1789130489.357792:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:2.0:1789130489.372077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.372438:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605169408 00000100:00100000:0.0:1789130489.372451:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605169408 00000100:00100000:0.0:1789130489.372548:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789130489.372561:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:2367:x1876037605169408:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130489.372584:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130489.372681:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec227 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac913 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.372707:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130489.372714:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130489.372801:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:2367:x1876037605169408:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 242us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130489.372819:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789130489.384738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.384981:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605169664 00000100:00100000:1.0:1789130489.384994:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605169664 00000100:00100000:1.0:1789130489.385071:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130489.385083:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:46834:x1876037605169664:12345-192.168.201.39@tcp:35:lfs.500 00000100:00100000:1.0:1789130489.385434:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:46834:x1876037605169664:12345-192.168.201.39@tcp:35:lfs.500 Request processed in 353us (712us total) trans 34359738492 rc 0/0 00000100:00100000:1.0:1789130489.385443:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00010000:00010000:3.0:1789130489.478314:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130489.541807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.541956:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605169920 00000100:00100000:1.0:1789130489.541967:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605169920 00000100:00100000:1.0:1789130489.542031:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:1.0:1789130489.542042:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+38:46844:x1876037605169920:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:1.0:1789130489.542066:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130489.542086:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac91a expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.542226:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec23c lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.542242:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec23c lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.542255:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec23c lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130489.542267:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 512 00010000:00010000:1.0:1789130489.542392:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac91a expref: 41 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.542411:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec23c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac91a expref: 40 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.542420:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130489.542424:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130489.542428:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130489.542877:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:46844:x1876037605169920:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 836us (1080us total) trans 34359738493 rc 0/0 00000100:00100000:1.0:1789130489.542889:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:0.0:1789130489.698962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.699045:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605170176 00000100:00100000:1.0:1789130489.699056:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605170176 00000100:00100000:1.0:1789130489.699113:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:1.0:1789130489.699123:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+40:46850:x1876037605170176:12345-192.168.201.39@tcp:101:multiop.500 00010000:00010000:1.0:1789130489.699147:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130489.699168:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec24a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac921 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.699279:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec251 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.699293:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec251 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.699305:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec251 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130489.699316:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:1.0:1789130489.699443:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec24a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac921 expref: 43 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.699461:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec251 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac921 expref: 42 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.699469:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130489.699471:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130489.699474:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130489.699538:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+42:46850:x1876037605170176:12345-192.168.201.39@tcp:101:multiop.500 Request processed in 416us (594us total) trans 34359738494 rc 0/0 00000100:00100000:1.0:1789130489.699545:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:3.0:1789130489.962006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.962106:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605170432 00000100:00100000:0.0:1789130489.962115:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605170432 00000100:00100000:0.0:1789130489.962238:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1789130489.962249:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+42:46866:x1876037605170432:12345-192.168.201.39@tcp:101:lfs.500 00010000:00010000:0.0:1789130489.962274:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130489.962296:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec25f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac928 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.962431:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.962446:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 43 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.962455:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.962489:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 43 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.962507:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 43 pid: 45555 timeout: 1753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130489.962521:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626902400:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130489.962656:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130489.969512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.969678:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626902400:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130489.969711:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130489.969785:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605170560 00000100:00100000:1.0:1789130489.969792:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605170560 00010000:00010000:1.0:1789130489.969830:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 44 pid: 45555 timeout: 1753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130489.969868:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130489.969878:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:2370:x1876037605170560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130489.969893:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130489.969899:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 44 pid: 45555 timeout: 1753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.969919:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 44 pid: 45555 timeout: 1753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.969942:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec1f6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8fe expref: 44 pid: 45555 timeout: 1753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.969957:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130489.969962:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.969971:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.969979:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.970009:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130489.970118:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130489.970126:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130489.970145:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:3.0:1789130489.970314:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec25f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 45 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130489.970330:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 44 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130489.970338:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130489.970340:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130489.970343:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:1.0:1789130489.970481:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:2370:x1876037605170560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 604us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130489.970489:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789130489.973065:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605170432:12345-192.168.201.39@tcp:101:lfs.500 Request processed in 10810us (11060us total) trans 34359738495 rc 0/0 00000100:00100000:3.0:1789130489.973077:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:2.0:1789130489.984241:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.984337:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605170944 00000100:00100000:1.0:1789130489.984347:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605170944 00000100:00100000:1.0:1789130489.984417:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130489.984428:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605170944:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130489.984688:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:46866:x1876037605170944:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 262us (457us total) trans 34359738496 rc 0/0 00000100:00100000:1.0:1789130489.984696:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1789130489.994082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130489.994189:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171072 00000100:00100000:0.0:1789130489.994198:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171072 00000100:00100000:0.0:1789130489.994279:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1789130489.994290:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+44:46866:x1876037605171072:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:0.0:1789130489.994306:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130489.994331:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec251 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac921 expref: 44 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130489.994350:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130489.994355:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130489.994422:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605171072:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130489.994430:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789130489.996729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.996812:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171200 00000100:00100000:1.0:1789130489.996821:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171200 00000100:00100000:1.0:1789130489.996867:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:1.0:1789130489.996877:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605171200:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1789130489.996980:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.996996:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.997007:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130489.997330:0:43680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].2, 136 off8464 00000100:00100000:1.0:1789130489.997425:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605171200:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 549us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130489.997437:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1789130489.999710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130489.999791:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171328 00000100:00100000:1.0:1789130489.999800:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171328 00000100:00100000:1.0:1789130489.999859:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:1.0:1789130489.999869:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+43:46866:x1876037605171328:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130489.999892:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130489.999923:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac92f expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.999977:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130489.999989:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.000008:0:45555:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.000021:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.000036:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130490.000040:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130490.000044:0:45555:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.000054:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130490.000105:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+44:46866:x1876037605171328:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 238us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.000112:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000001:00080000:0.0:1789130490.224482:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738488 is committed 00000001:00080000:0.0:1789130490.224526:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738496 is committed 00000004:00080000:0.0:1789130490.224556:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789130490.224583:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4bac29600 refcount 2 committed 0 result 0 batchid 30064771678 00000020:00080000:0.0:1789130490.224588:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486431300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bac29a80 00000020:00080000:0.0:1789130490.224591:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486431900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b390cb8c00 00000020:00080000:2.0:1789130490.224687:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771678 committed batchid 30064771677 00000020:00080000:2.0:1789130490.224873:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771677 00000100:00100000:2.0:1789130490.225275:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626902528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789130490.225348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130490.225445:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626902528 00000100:00100000:0.0:1789130490.225452:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626902528 00000100:00100000:0.0:1789130490.225511:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130490.225522:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626902528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789130490.225546:0:44366:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:228 count 1 00002000:00010000:0.0:1789130490.225577:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe4:0x0] initial LVB size: 1024, mtime: 0x6aa3f6f7, atime: 0x6aa3f6f7, ctime: 0x6aa3f6f7, blocks: 0x1 00010000:00010000:0.0:1789130490.225586:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.225622:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=1653s v=(0 0) 00010000:00010000:0.0:1789130490.225628:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130490.225635:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.225652:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.225663:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.225671:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.225694:0:44366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130490.226567:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626902528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1045us (1215us total) trans 34359738379 rc 0/0 00000100:00100000:0.0:1789130490.226578:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789130490.226631:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130490.226646:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130490.226653:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.226663:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130490.226667:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.226678:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.226696:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.226705:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f25dfd16/0x5c74554e47cec282 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.226726:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130490.226728:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130490.226730:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130490.226820:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4a217ed00/2, rc 0, transno 34359738379 00000100:00100000:2.0:1789130490.226827:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626902528:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1789130490.505598:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130490.505635:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130490.505688:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 3 count 3 00000040:00080000:3.0:1789130490.505695:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130490.505829:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626902656:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130490.505938:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28f00 going to sleep for 11 seconds 00010000:00010000:3.0:1789130490.506550:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130490.510262:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626902656:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130490.540661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130490.540937:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171456 00000100:00100000:3.0:1789130490.540948:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171456 00000100:00100000:3.0:1789130490.541002:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:3.0:1789130490.541012:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46867:x1876037605171456:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130490.541043:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130490.541180:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46867:x1876037605171456:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 169us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130490.541189:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:2.0:1789130490.547348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.547448:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171584 00000100:00100000:1.0:1789130490.547458:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171584 00000100:00100000:1.0:1789130490.547516:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:1.0:1789130490.547526:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:46867:x1876037605171584:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.547631:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547648:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547661:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547675:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547682:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547689:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547712:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547719:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547725:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130490.547770:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00000004:00200000:1.0:1789130490.547775:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130490.547793:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547804:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547809:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547816:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547821:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130490.547825:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547832:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547843:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789130490.547846:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130490.547850:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547855:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547871:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547881:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547886:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547891:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130490.547906:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547914:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547922:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc742b176 (ffff90b4909bd600) 00010000:00010000:1.0:1789130490.547925:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130490.547928:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547934:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec290 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc742b176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547946:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547953:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547959:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547964:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ea00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130490.547968:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547974:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547981:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130490.547983:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130490.547986:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.547991:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec297 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130490.548060:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:46867:x1876037605171584:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 535us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.548069:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:2.0:1789130490.569008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130490.569151:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171840 00000100:00100000:3.0:1789130490.569170:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171840 00000100:00100000:3.0:1789130490.569245:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:3.0:1789130490.569255:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46867:x1876037605171840:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130490.569276:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130490.569301:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec29e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac936 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569398:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569414:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569426:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130490.569436:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00010000:00010000:3.0:1789130490.569585:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569593:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569633:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569640:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130490.569645:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569653:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569665:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130490.569668:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789130490.569672:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569679:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2a5 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569718:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec29e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac936 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569728:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130490.569731:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130490.569735:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec29e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac936 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.569755:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789130490.569815:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605171840:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 562us (816us total) trans 34359738497 rc 301/301 00000100:00100000:3.0:1789130490.569823:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:2.0:1789130490.586244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.586387:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605171968 00000100:00100000:1.0:1789130490.586397:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605171968 00000100:00100000:1.0:1789130490.586455:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130490.586466:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605171968:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130490.586506:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130490.586638:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605171968:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 172us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.586646:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:2.0:1789130490.599808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130490.600033:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605172224 00000100:00100000:3.0:1789130490.600043:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605172224 00000100:00100000:3.0:1789130490.600104:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:3.0:1789130490.600115:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605172224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130490.600134:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130490.600138:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789130490.600175:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec219 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac90c expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.600195:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130490.600210:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130490.600224:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec2b3 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac93d expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130490.601254:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe5:0x0], index 1: 0 00010000:00010000:3.0:1789130490.601503:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2ba lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.601518:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2ba lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.601530:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2ba lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.601585:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec2b3 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac93d expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.601637:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2ba lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac93d expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.601646:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130490.601649:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130490.601652:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130490.601711:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605172224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1598us (1913us total) trans 34359738498 rc 0/0 00000100:00100000:3.0:1789130490.601720:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:2.0:1789130490.612042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.612248:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605172480 00000100:00100000:1.0:1789130490.612259:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605172480 00000100:00100000:1.0:1789130490.612317:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:1.0:1789130490.612328:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605172480:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.612488:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130490.612515:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec2ba lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac93d expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.612533:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130490.612546:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130490.612566:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.612580:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.612590:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617023:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617050:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617063:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617405:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617413:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617419:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617426:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ea00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130490.617431:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617438:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617450:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130490.617452:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130490.617457:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617463:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2c8 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617473:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617479:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617484:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617488:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130490.617491:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617496:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617506:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x36440ecb (ffff90b4909bd600) 00010000:00010000:1.0:1789130490.617509:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130490.617512:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.617517:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2cf lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x36440ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130490.617642:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605172480:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 5312us (5606us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130490.617651:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:2.0:1789130490.632991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.635056:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605172608 00000100:00100000:1.0:1789130490.635070:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605172608 00000100:00100000:1.0:1789130490.635697:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:1.0:1789130490.635711:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605172608:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.635733:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130490.635771:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2d6 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac944 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635808:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635822:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635847:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635952:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2d6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635970:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.635979:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130490.635981:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130490.635984:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130490.636056:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605172608:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 349us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.636064:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:3.0:1789130490.646730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130490.687864:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605172864 00000100:00100000:0.0:1789130490.687882:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605172864 00000100:00100000:0.0:1789130490.687979:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130490.687990:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605172864:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130490.688082:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.688100:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130490.688111:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130490.688563:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].4, 88 off8472 00000004:00080000:0.0:1789130490.688573:0:43681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1653785970084ns, next at 1654785967704ns, rc = 0 00000004:00010000:0.0:1789130490.688686:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009c03aa39 reply state 00000000975dbaa0 transno 34359738499 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130490.688695:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130490.688795:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:46867:x1876037605172864:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 807us (42073us total) trans 34359738499 rc 0/0 00000100:00100000:0.0:1789130490.688803:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130490.711381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130490.712051:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712065:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712072:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712078:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130490.712083:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712091:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712112:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:3.0:1789130490.712115:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789130490.712121:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.712127:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec2e4 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130490.712273:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605172992 00000100:00100000:1.0:1789130490.712284:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605172992 00000100:00100000:1.0:1789130490.712339:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:1.0:1789130490.712348:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:46867:x1876037605172992:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.712372:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130490.712391:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac94b expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.712443:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.712457:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.712474:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130490.712477:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130490.712480:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f800, rc 0) 00000100:00100000:1.0:1789130490.712532:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:46867:x1876037605172992:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 185us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.712539:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:0.0:1789130490.716510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130490.716624:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605173120 00000100:00100000:2.0:1789130490.716634:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605173120 00000100:00100000:2.0:1789130490.716705:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1789130490.716715:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605173120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789130490.718333:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130490.719048:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605173120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 2327us (2541us total) trans 34359738375 rc 0/0 00000100:00100000:2.0:1789130490.719060:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000001:00080000:0.0:1789130490.724990:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738379 is committed 00000001:00080000:0.0:1789130490.725015:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738377 is committed 00000100:00100000:0.0:1789130490.732531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.732756:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605173376 00000100:00100000:1.0:1789130490.732767:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605173376 00000100:00100000:1.0:1789130490.732815:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130490.732826:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:46867:x1876037605173376:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789130490.733213:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:46867:x1876037605173376:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 388us (690us total) trans 34359738500 rc 0/0 00000100:00100000:1.0:1789130490.733222:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1789130490.742045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.744029:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605173632 00000100:00100000:1.0:1789130490.744044:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605173632 00000100:00100000:1.0:1789130490.744118:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:1.0:1789130490.744129:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:46867:x1876037605173632:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130490.744265:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:46867:x1876037605173632:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 137us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.744274:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:0.0:1789130490.758721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.758881:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605173760 00000100:00100000:1.0:1789130490.758899:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605173760 00000100:00100000:1.0:1789130490.758963:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:1.0:1789130490.758974:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:46867:x1876037605173760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.758995:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130490.759017:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2f2 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac952 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759093:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759107:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759119:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130490.759157:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130490.759176:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759217:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec2f2 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac952 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759234:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac952 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.759242:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130490.759245:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130490.759249:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ea00, rc 0) 00000100:00100000:1.0:1789130490.759299:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605173760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 326us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.759306:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:0.0:1789130490.768544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.768645:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605173888 00000100:00100000:1.0:1789130490.768654:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605173888 00000100:00100000:1.0:1789130490.768708:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130490.768718:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605173888:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130490.768735:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130490.768767:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac959 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130490.768795:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f6fa, blocks: 0x1 00010000:00010000:1.0:1789130490.768814:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=1653s v=(0 0) 00010000:00010000:1.0:1789130490.768820:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130490.768829:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 8 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.768845:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 8 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130490.768859:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130490.768923:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605173888:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 207us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.768930:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130490.789890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.790039:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174144 00000100:00100000:1.0:1789130490.790054:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174144 00000100:00100000:1.0:1789130490.790135:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789130490.790145:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605174144:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130490.790283:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605174144:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130490.790292:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:2.0:1789130490.800541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130490.800754:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174272 00000100:00100000:3.0:1789130490.800774:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174272 00000100:00100000:3.0:1789130490.800855:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1789130490.800865:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:46867:x1876037605174272:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130490.800889:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130490.800913:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac960 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.800961:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.800972:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130490.800978:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130490.800984:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.801025:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.801046:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130490.801063:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626902784:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130490.801422:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130490.806289:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626902784:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130490.806348:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130490.806378:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789130490.806539:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:46867:x1876037605174272:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5673us (6010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130490.806551:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1789130490.825378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130490.825508:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174400 00000100:00100000:2.0:1789130490.825522:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174400 00010000:00010000:2.0:1789130490.825584:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130490.825677:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789130490.825689:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605174400:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130490.825711:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130490.825754:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130490.826326:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130490.826365:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cec300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac959 expref: 9 pid: 44366 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130490.826390:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130490.826396:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130490.826408:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130490.826420:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130490.826481:0:45795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130490.826500:0:45795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45795:1876037626902912:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130490.827261:0:45795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130490.839304:0:45795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f29680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45795:1876037626902912:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130490.839359:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130490.839460:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605174400:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 13771us (14096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130490.839474:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130490.841063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130490.843188:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174528 00000100:00100000:2.0:1789130490.843218:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174528 00002000:00100000:2.0:1789130490.843308:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe5:0x0] (0->1023) req@ffff90b4a217c780 x1876037605174528/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:206/0 lens 1512/0 e 0 to 0 dl 1789130501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130490.843329:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4a217c780 with x1876037605174528 ext(0->1023) 00002000:00010000:2.0:1789130490.843337:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4a217c780 00000100:00100000:2.0:1789130490.843378:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1789130490.843389:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605174528:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130490.844351:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605174528:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 957us (3293us total) trans 34359738376 rc 0/0 00000100:00100000:2.0:1789130490.844365:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:2.0:1789130490.844376:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe5:0x0] (0->1023) req@ffff90b4a217c780 x1876037605174528/t34359738376(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:206/0 lens 1512/448 e 0 to 0 dl 1789130501 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130490.844386:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4a217c780 with x1876037605174528 ext(0->1023) 00002000:00010000:2.0:1789130490.844392:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4a217c780 00000100:00100000:0.0:1789130490.849031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130490.849382:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174656 00000100:00100000:1.0:1789130490.849397:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174656 00000100:00100000:1.0:1789130490.849494:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:1.0:1789130490.849506:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605174656:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789130490.943016:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738499 is committed 00000004:00080000:3.0:1789130490.943033:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789130490.943287:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130490.943314:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626903040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130490.943407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130490.943501:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903040 00000100:00100000:1.0:1789130490.943510:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903040 00000100:00100000:1.0:1789130490.943582:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789130490.943593:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626903040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789130490.943852:0:44366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1789130490.943857:0:44366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb mtime from disk: 0 -> 1789130490 00002000:00010000:1.0:1789130490.943859:0:44366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130490.943862:0:44366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb ctime from disk: 1789130490 -> 1789130490 00002000:00010000:1.0:1789130490.943864:0:44366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130490.943913:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626903040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 321us (505us total) trans 34359738377 rc 0/0 00000100:00100000:1.0:1789130490.943921:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1789130490.943970:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b3895b2580/2, rc 0, transno 34359738377 00000100:00100000:1.0:1789130490.943976:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626903040:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789130490.944640:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789130490.944965:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738500 is committed 00000020:00080000:3.0:1789130490.945068:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771678 batchid updated 00000020:00080000:2.0:1789130490.945133:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771678 00000020:00080000:2.0:1789130490.945159:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771678 00000100:00100000:2.0:1789130490.945504:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:46867:x1876037605174656:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 95994us (96483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130490.945516:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:0.0:1789130490.949570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130490.949730:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605174784 00000100:00100000:2.0:1789130490.949752:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605174784 00000100:00100000:2.0:1789130490.949848:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130490.949860:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605174784:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789130491.065358:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738377 is committed 00000001:00080000:2.0:1789130491.065389:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738376 is committed 00000100:00100000:0.0:1789130491.065642:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605174784:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 115741us (116045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.065658:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789130491.072074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.072375:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175040 00000100:00100000:0.0:1789130491.072389:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175040 00000100:00100000:0.0:1789130491.072488:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:0.0:1789130491.072501:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605175040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130491.072580:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130491.072651:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec2f9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac952 expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.072676:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130491.072682:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130491.072724:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.073360:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.073376:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130491.073722:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c52be6d7 reply state 00000000d4dd1849 transno 34359738501 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.073746:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1789130491.074076:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130491.074400:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:46867:x1876037605175040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1896us (2335us total) trans 34359738501 rc 0/0 00000100:00100000:0.0:1789130491.074411:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00010000:00010000:0.0:1789130491.078586:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078629:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078638:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078645:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.078652:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078660:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078683:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130491.078686:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130491.078692:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.078703:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec30e lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.096923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.097949:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175168 00000100:00100000:2.0:1789130491.097966:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175168 00000100:00100000:2.0:1789130491.098052:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1789130491.098065:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605175168:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130491.098430:0:44366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:2.0:1789130491.098435:0:44366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb mtime from disk: 1789130490 -> 1789130487 00002000:00010000:2.0:1789130491.098438:0:44366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb atime from disk: 0 -> 1789130487 00002000:00010000:2.0:1789130491.098440:0:44366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb ctime from disk: 1789130490 -> 1789130487 00002000:00010000:2.0:1789130491.098454:0:44366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789130491.098552:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605175168:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 488us (1643us total) trans 34359738378 rc 0/0 00000100:00100000:2.0:1789130491.098561:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789130491.112801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.117096:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175424 00000100:00100000:2.0:1789130491.117114:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175424 00000100:00100000:2.0:1789130491.117236:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:2.0:1789130491.117249:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:46867:x1876037605175424:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789130491.117344:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.117366:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.117377:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.117424:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.117453:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 13 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.117473:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626903168:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130491.118017:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130491.128024:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626903168:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130491.128074:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.137142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.139725:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175552 00000100:00100000:0.0:1789130491.139746:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175552 00010000:00010000:0.0:1789130491.139844:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 14 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.139900:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130491.139912:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605175552:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130491.139936:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130491.139944:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 14 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.139960:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 14 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.139989:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec2dd lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac944 expref: 14 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.140011:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130491.140017:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.140028:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.140037:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.140309:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130491.140402:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605175552:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 491us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.140413:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130491.144966:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626903296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130491.145067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130491.145163:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903296 00000100:00100000:0.0:1789130491.145173:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903296 00000100:00100000:0.0:1789130491.145252:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130491.145262:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626903296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130491.145295:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3767533568 avail 3764387840 00000100:00100000:0.0:1789130491.145343:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626903296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.145352:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130491.145400:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738377 gen 2 00000004:00080000:0.0:1789130491.145407:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b3895b2580, transno 34359738377 00000100:00100000:0.0:1789130491.145429:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626903296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130491.147704:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626903680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.147802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130491.147859:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130491.147864:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626903808:0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.147884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130491.147916:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903680 00000100:00100000:3.0:1789130491.147923:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903680 00000100:00100000:3.0:1789130491.147977:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903808 00000100:00100000:3.0:1789130491.147981:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903808 00000100:00100000:3.0:1789130491.148013:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130491.148023:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626903680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.148086:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626903680:12345-0@lo:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.148095:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130491.148116:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130491.148123:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626903808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.148153:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626903808:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.148160:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789130491.148177:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130491.148232:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626903808:0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.148244:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626903680:0@lo:400:kworker.0 00000100:00100000:1.0:1789130491.148938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626903552:0@lo:400:kworker.0 00000100:00100000:1.0:1789130491.148999:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130491.149044:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789130491.149051:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626903424:0@lo:400:kworker.0 00000100:00100000:1.0:1789130491.149084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130491.149119:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626903936:0@lo:400:kworker.0 00000100:00100000:1.0:1789130491.149147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130491.149181:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903424 00000100:00100000:1.0:1789130491.149204:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903424 00000100:00100000:1.0:1789130491.149249:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789130491.149258:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626903424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130491.149303:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626903424:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.149311:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789130491.149382:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626903424:0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.149722:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903552 00000100:00100000:3.0:1789130491.149728:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903552 00000100:00100000:3.0:1789130491.150143:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130491.150154:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626903552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.150231:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626903552:12345-0@lo:400:kworker.0 Request processed in 79us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.150242:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130491.151535:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626903936 00000100:00100000:3.0:1789130491.151551:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626903936 00000100:00080000:0.0:1789130491.151873:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130491.151988:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130491.152002:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626903936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.152123:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626903936:12345-0@lo:400:kworker.0 Request processed in 115us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.152131:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130491.152196:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626903936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130491.152212:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738379 gen 2 00000004:00080000:3.0:1789130491.152220:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738378 committed transno 34359738379 00000004:00080000:3.0:1789130491.152249:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4a217ed00, transno 34359738379 00000100:00100000:3.0:1789130491.152270:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626903552:0@lo:400:kworker.0 00010000:00010000:2.0:1789130491.152976:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.152991:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153104:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153113:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153122:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153128:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130491.153134:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153142:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153167:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:3.0:1789130491.153170:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130491.153175:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.153182:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec315 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.153334:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605175424:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 36083us (40544us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130491.153345:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:3.0:1789130491.161888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.164148:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175680 00000100:00100000:2.0:1789130491.164170:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175680 00000100:00100000:2.0:1789130491.164272:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789130491.164286:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605175680:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130491.164358:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.164385:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.164396:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130491.164401:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130491.164408:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.164976:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.165000:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 8 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.165021:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626904064:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130491.165213:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130491.177402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.177567:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626904064:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130491.177661:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.177769:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605175808 00000100:00100000:1.0:1789130491.177778:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605175808 00010000:00010000:1.0:1789130491.177837:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.177874:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789130491.177885:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605175808:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130491.177906:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130491.177936:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.177951:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.177993:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47cec307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac960 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.178014:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130491.178019:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130491.178025:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.178036:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.178072:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130491.178145:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605175808:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 261us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.178154:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00010000:00010000:2.0:1789130491.178249:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178259:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178290:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178300:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178313:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178321:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130491.178327:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178336:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178349:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.178357:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000805612dd/0x5c74554e47cec31c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.178412:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605175680:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 14130us (16544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130491.178421:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130491.196044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.198716:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176064 00000100:00100000:0.0:1789130491.198739:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176064 00000100:00100000:0.0:1789130491.198855:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:0.0:1789130491.198869:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46867:x1876037605176064:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789130491.198990:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199019:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199035:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199343:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199356:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199364:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199414:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.199432:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 13 pid: 43681 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.199461:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626904192:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130491.199593:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130491.212445:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626904192:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130491.212498:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.213594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.214413:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176192 00000100:00100000:0.0:1789130491.214429:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176192 00010000:00010000:0.0:1789130491.214495:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 14 pid: 43681 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.214554:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130491.214567:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:2369:x1876037605176192:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130491.214589:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130491.214597:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 14 pid: 43681 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214792:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 14 pid: 43681 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214822:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec2eb lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac94b expref: 14 pid: 43681 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214844:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130491.214851:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214863:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214872:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.214912:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130491.214984:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:2369:x1876037605176192:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 419us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.214998:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00010000:00010000:3.0:1789130491.216529:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.216548:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130491.220793:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738502 00000001:00080000:2.0:1789130491.221038:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738503 00000001:00080000:2.0:1789130491.221091:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738504 00000100:00100000:2.0:1789130491.221220:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626904320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130491.221318:0:43680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130491.221358:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130491.224110:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626904320 00000100:00100000:3.0:1789130491.224134:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626904320 00000100:00100000:3.0:1789130491.224247:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130491.224262:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626904320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789130491.224439:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626904320:12345-0@lo:1000:mdt00_001.0 Request processed in 180us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.224447:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130491.225360:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626904320:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789130491.226661:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738505 00000100:00100000:2.0:1789130491.226811:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626904448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130491.230291:0:43680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130491.230370:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130491.230403:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626904448 00000100:00100000:1.0:1789130491.230416:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626904448 00000100:00100000:1.0:1789130491.230504:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130491.230517:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626904448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130491.230946:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43680:x1876037626904448:12345-0@lo:1000:mdt00_001.0 Request processed in 430us (3527us total) trans 34359738379 rc 0/0 00000100:00100000:1.0:1789130491.230955:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130491.231050:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f2ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626904448:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789130491.231198:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738506 00010000:00010000:0.0:1789130491.231249:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231261:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231269:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231276:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.231281:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231290:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231311:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130491.231314:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130491.231322:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231329:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec32a lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231367:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231374:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231380:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231386:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.231389:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231395:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231403:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130491.231405:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130491.231413:0:43680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231440:0:43680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231452:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.231500:0:43680:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.231518:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626904576:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130491.245155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130491.245649:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176320 00000100:00100000:1.0:1789130491.245665:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176320 00000100:00100000:0.0:1789130491.245719:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130491.245736:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130491.245746:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46866:x1876037605176320:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:0.0:1789130491.245763:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b486f412c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626904576:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130491.245814:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245834:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec274 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245876:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245893:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245905:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.245914:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:46866:x1876037605176320:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 169us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.245924:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00010000:00010000:0.0:1789130491.245927:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245933:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245940:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245946:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.245950:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245958:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245971:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130491.245974:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130491.245978:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245983:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec331 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245992:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.245998:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.246004:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.246009:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.246011:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.246017:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.246023:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130491.246026:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130491.246028:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.246034:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec323 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.246294:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605176064:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 47428us (50264us total) trans 34359738507 rc 0/0 00000100:00100000:0.0:1789130491.246309:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000020:00080000:0.0:1789130491.246313:0:43680:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1789130491.247308:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130491.247318:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130491.247351:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 3 count 3 00000040:00080000:1.0:1789130491.247360:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130491.251860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130491.257704:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176576 00000100:00100000:1.0:1789130491.257727:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176576 00000100:00100000:1.0:1789130491.257852:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130491.257866:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46867:x1876037605176576:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130491.261028:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130491.261234:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738508 00000100:00100000:2.0:1789130491.262450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.264067:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176832 00000100:00100000:3.0:1789130491.264084:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176832 00000100:00100000:3.0:1789130491.264208:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:3.0:1789130491.264221:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:46866:x1876037605176832:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:3.0:1789130491.264785:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].3, 136 off8600 00000100:00100000:3.0:1789130491.264936:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:46866:x1876037605176832:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 716us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.264946:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00010000:00010000:1.0:1789130491.269306:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269349:0:43683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269365:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269376:0:43683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269383:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269390:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.269421:0:43683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130491.269588:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46867:x1876037605176576:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 11717us (17736us total) trans 34359738509 rc 0/0 00000100:00100000:1.0:1789130491.269620:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000020:00080000:1.0:1789130491.269638:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130491.270639:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130491.270653:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.270664:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130491.270668:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.270678:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.270697:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x13:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789130491.270700:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130491.270706:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.270713:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec338 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.270786:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130491.270790:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130491.270792:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130491.312202:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.312423:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605176960 00000100:00100000:3.0:1789130491.312435:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605176960 00000100:00100000:3.0:1789130491.312507:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:3.0:1789130491.312519:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:46868:x1876037605176960:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:3.0:1789130491.312552:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.312584:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec33f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac967 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312715:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312734:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312747:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312765:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312773:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.312780:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.313209:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.313221:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.313231:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 4/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.313277:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.313295:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 20 pid: 43679 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.313313:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626904704:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130491.313431:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490434780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130491.317875:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626904704:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130491.317921:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.319470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.321499:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605177216 00000100:00100000:3.0:1789130491.321518:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605177216 00000100:00100000:3.0:1789130491.321663:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130491.321677:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:44607:x1876037605177216:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130491.323924:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:44607:x1876037605177216:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 2237us (4449us total) trans 34359738510 rc 0/0 00000100:00100000:3.0:1789130491.323943:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130491.331221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130491.331396:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605177344 00000100:00100000:1.0:1789130491.331408:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605177344 00010000:00010000:1.0:1789130491.331480:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 22 pid: 43679 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.331531:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130491.331542:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:2369:x1876037605177344:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130491.331563:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130491.331571:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 22 pid: 43679 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331586:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 22 pid: 43679 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331656:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec266 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac928 expref: 22 pid: 43679 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331678:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130491.331685:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331696:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331706:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 4/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.331746:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130491.331817:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:2369:x1876037605177344:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 276us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.331826:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:3.0:1789130491.332266:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332276:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130491.332334:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x11:0x0]: returning size 1024 00000004:00200000:3.0:1789130491.332340:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130491.332365:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332380:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332390:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332397:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332404:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332410:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130491.332415:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332423:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332446:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130491.332450:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130491.332455:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332462:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec346 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332477:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332483:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332489:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332495:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130491.332498:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332505:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332512:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939200) 00010000:00010000:3.0:1789130491.332515:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130491.332519:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332525:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec34d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332573:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec33f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac967 expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332594:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac967 expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.332661:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130491.332664:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130491.332667:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5a00, rc 0) 00000100:00100000:3.0:1789130491.332713:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:46868:x1876037605176960:12345-192.168.201.39@tcp:101:rm.0 Request processed in 20195us (20538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.332722:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1789130491.366279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.366585:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605177472 00000100:00100000:3.0:1789130491.366599:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605177472 00000100:00100000:3.0:1789130491.366724:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789130491.366736:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605177472:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:3.0:1789130491.366760:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.366789:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac96e expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130491.366831:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe5:0x0] initial LVB size: 1024, mtime: 0x6aa3f6f7, atime: 0x6aa3f6f7, ctime: 0x6aa3f6f7, blocks: 0xb 00010000:00010000:3.0:1789130491.366857:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=1654s v=(0 0) 00010000:00010000:3.0:1789130491.366863:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130491.366874:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 8 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.366895:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 8 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.366920:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:3.0:1789130491.366999:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605177472:12345-192.168.201.39@tcp:101:rm.0 Request processed in 265us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.367007:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130491.371212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.372045:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605177728 00000100:00100000:3.0:1789130491.372060:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605177728 00000100:00100000:3.0:1789130491.372152:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:3.0:1789130491.372164:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:46868:x1876037605177728:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:3.0:1789130491.372255:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130491.372293:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec354 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac967 expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372321:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec27b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac92f expref: 19 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372334:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130491.372360:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130491.372388:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372405:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372417:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372434:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372453:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.372460:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.373991:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.374008:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.374020:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130491.380880:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].5, 64 off8536 00010000:00010000:2.0:1789130491.381010:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381035:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381050:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381062:0:43681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381069:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381075:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381115:0:43681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130491.381147:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381153:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381159:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381164:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.381170:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381177:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381204:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939b00) 00010000:00010000:2.0:1789130491.381208:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789130491.381214:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381222:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec370 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381247:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381253:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381263:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381269:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.381272:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381278:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381286:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130491.381289:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130491.381292:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.381298:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec362 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130491.381310:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004fb57d22 reply state 0000000040bb864a transno 34359738511 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.381320:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130491.381444:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:46868:x1876037605177728:12345-192.168.201.39@tcp:36:rm.0 Request processed in 9275us (10251us total) trans 34359738511 rc 0/0 00000100:00100000:2.0:1789130491.381456:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00010000:00010000:0.0:1789130491.382152:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130491.382165:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.382179:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130491.382193:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.382202:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.382220:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939b00) 00010000:00010000:0.0:1789130491.382222:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130491.382226:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.382231:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec377 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.382255:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130491.382257:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130491.382258:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130491.407650:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407678:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407687:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407695:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130491.407701:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407711:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407739:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939300) 00010000:00010000:3.0:1789130491.407742:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130491.407749:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.407756:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec369 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.460733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.461179:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605177984 00000100:00100000:0.0:1789130491.461204:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605177984 00000100:00100000:0.0:1789130491.461300:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:0.0:1789130491.461314:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46874:x1876037605177984:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130491.461352:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130491.461389:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec37e lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac975 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461599:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461683:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461698:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461718:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461726:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.461733:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130491.462683:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe5:0x0], index 0: 0 00010000:00010000:0.0:1789130491.462933:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.462948:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.462958:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463010:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463018:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463025:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463032:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.463038:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463047:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463064:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:0.0:1789130491.463068:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130491.463076:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463082:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec385 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130491.463099:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bd00fffa reply state 0000000031010796 transno 34359738512 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.463110:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130491.463157:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec37e lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463177:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.463202:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130491.463206:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130491.463209:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130491.463329:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+22:46874:x1876037605177984:12345-192.168.201.39@tcp:101:bash.0 Request processed in 2017us (2614us total) trans 34359738512 rc 0/0 00000100:00100000:0.0:1789130491.463341:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:0.0:1789130491.476235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.476514:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605178112 00000100:00100000:3.0:1789130491.476528:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605178112 00000100:00100000:3.0:1789130491.476647:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789130491.476660:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605178112:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130491.476686:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.476715:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac97c expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130491.476755:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130491.476787:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.476793:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=1654s v=(0 0) 00010000:00010000:3.0:1789130491.476799:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130491.476806:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.476816:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.476819:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.476824:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.476830:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.476839:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.476844:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.476860:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01800) 00010000:00010000:3.0:1789130491.476861:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00010000:00010000:2.0:1789130491.476863:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130491.476868:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.476874:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec38c lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.477796:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605178112:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1133us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130491.477969:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00080000:0.0:1789130491.483594:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130491.490031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.490304:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605178240 00000100:00100000:3.0:1789130491.490319:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605178240 00000100:00100000:3.0:1789130491.490399:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130491.490413:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:46874:x1876037605178240:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130491.490562:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.490594:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac983 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.490799:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.490874:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130491.490881:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130491.490889:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.490941:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.490959:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 7 pid: 44793 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.490979:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626904832:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130491.491192:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130491.506459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.507151:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605178368 00000100:00100000:2.0:1789130491.507163:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605178368 00010000:00010000:2.0:1789130491.507239:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 8 pid: 44793 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.507294:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130491.507305:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605178368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130491.507328:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130491.507361:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 8 pid: 44793 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.507378:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 8 pid: 44793 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.507413:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130491.507418:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130491.507429:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.507516:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.507568:0:43665:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 8 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.507586:0:43665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:43665:1876037626904960:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789130491.507802:0:43665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55600 going to sleep for 11 seconds 00010000:00010000:3.0:1789130491.520071:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e92982/0x5c74554e47cec3a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac97c expref: 8 pid: 44793 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.520118:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626904832:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130491.520175:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.520205:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5a00, rc 0) 00000100:00100000:3.0:1789130491.520300:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:46874:x1876037605178240:12345-192.168.201.39@tcp:101:bash.0 Request processed in 29890us (30285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.520312:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789130491.521310:0:43665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:43665:1876037626904960:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130491.521345:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130491.521419:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605178368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 14114us (14982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.521431:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00010000:00010000:2.0:1789130491.526415:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130491.532249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.532656:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605178624 00000100:00100000:3.0:1789130491.532670:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605178624 00000100:00100000:3.0:1789130491.532745:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1789130491.532757:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:46874:x1876037605178624:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789130491.533276:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:46874:x1876037605178624:12345-192.168.201.39@tcp:35:bash.0 Request processed in 518us (1040us total) trans 34359738513 rc 0/0 00000100:00100000:3.0:1789130491.533288:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1789130491.643981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.644110:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605178752 00000100:00100000:3.0:1789130491.644126:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605178752 00000100:00100000:3.0:1789130491.644226:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:3.0:1789130491.644238:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+22:46880:x1876037605178752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130491.644270:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.644299:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec3af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac98a expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.644383:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.644403:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.644417:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130491.644510:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:3.0:1789130491.644516:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130491.644546:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.644578:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec3af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac98a expref: 24 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.644986:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac98a expref: 23 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.645003:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:3.0:1789130491.645006:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130491.645011:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4c00, rc 0) 00000100:00100000:3.0:1789130491.645103:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+23:46880:x1876037605178752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 865us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.645112:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:2.0:1789130491.652090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.653084:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179008 00000100:00100000:0.0:1789130491.653100:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179008 00000100:00100000:0.0:1789130491.653225:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:0.0:1789130491.653238:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+23:46880:x1876037605179008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130491.653268:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130491.653301:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec3bd lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac991 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.653459:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec3c4 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.653476:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec3c4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.653491:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec3c4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130491.653506:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:0.0:1789130491.653820:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec3bd lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac991 expref: 26 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.653851:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec3c4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac991 expref: 25 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.653861:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130491.653864:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130491.653868:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130491.653957:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:46880:x1876037605179008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 721us (1882us total) trans 34359738514 rc 0/0 00000100:00100000:0.0:1789130491.653965:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:0.0:1789130491.665766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.666864:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179264 00000100:00100000:3.0:1789130491.666889:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179264 00000100:00100000:3.0:1789130491.666989:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:3.0:1789130491.667007:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+25:46880:x1876037605179264:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130491.667052:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130491.667095:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec3d2 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac998 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.667296:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.667322:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.667341:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130491.667360:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130491.667552:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec3d2 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac998 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.667579:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac998 expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.667589:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:3.0:1789130491.667593:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789130491.667597:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5600, rc 0) 00000100:00100000:3.0:1789130491.667815:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:46880:x1876037605179264:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 813us (2068us total) trans 34359738515 rc 0/0 00000100:00100000:3.0:1789130491.667824:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:3.0:1789130491.667910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.668041:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179392 00000100:00100000:3.0:1789130491.668048:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179392 00000100:00100000:3.0:1789130491.668094:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130491.668104:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:2370:x1876037605179392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130491.668117:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130491.668135:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec3c4 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac991 expref: 27 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.668148:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:3.0:1789130491.668151:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130491.668191:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605179392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130491.668199:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789130491.689957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.690166:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179520 00000100:00100000:2.0:1789130491.690190:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179520 00000100:00100000:2.0:1789130491.690285:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789130491.690298:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605179520:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130491.690375:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.690401:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.690411:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130491.690416:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130491.690421:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.690467:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.690483:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 6 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.690499:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626905088:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130491.690688:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130491.708080:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626905088:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130491.708128:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.716579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.717066:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179648 00000100:00100000:2.0:1789130491.717081:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179648 00002000:00100000:2.0:1789130491.717160:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe5:0x0] (0->14) req@ffff90b386d09a40 x1876037605179648/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:207/0 lens 504/0 e 0 to 0 dl 1789130502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130491.717174:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386d09a40 with x1876037605179648 ext(0->14) 00010000:00010000:2.0:1789130491.717196:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 7 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.717214:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 7 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130491.717224:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386d09a40 00000100:00100000:2.0:1789130491.717262:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789130491.717274:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605179648:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789130491.718413:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605179648:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 1133us (1841us total) trans 34359738380 rc 0/0 00000100:00100000:2.0:1789130491.718426:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:2.0:1789130491.718437:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe5:0x0] (0->14) req@ffff90b386d09a40 x1876037605179648/t34359738380(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:207/0 lens 504/448 e 0 to 0 dl 1789130502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130491.718447:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386d09a40 with x1876037605179648 ext(0->14) 00010000:00010000:2.0:1789130491.718457:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.718473:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130491.718480:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386d09a40 00000100:00100000:2.0:1789130491.743986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.744110:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605179776 00000100:00100000:0.0:1789130491.744124:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605179776 00010000:00010000:0.0:1789130491.744207:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.744263:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789130491.744275:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605179776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130491.744297:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130491.744324:0:43666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe5:0x0] updating lvb size from disk: 0 -> 15 00002000:00010000:0.0:1789130491.744327:0:43666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe5:0x0] updating lvb mtime from disk: 0 -> 1789130491 00002000:00010000:0.0:1789130491.744331:0:43666:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe5:0x0] updating lvb atime from disk: 0 -> 1789130491 00002000:00010000:0.0:1789130491.744334:0:43666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe5:0x0] updating lvb ctime from disk: 0 -> 1789130491 00010000:00010000:0.0:1789130491.744341:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.744358:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.744389:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000214ff5ae/0x5c74554e47cec3a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac983 expref: 9 pid: 44367 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.744412:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130491.744418:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130491.744425:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.744567:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.744742:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130491.744815:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605179776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 541us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.744825:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00010000:00010000:1.0:1789130491.767332:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767370:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767428:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767449:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767458:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767466:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130491.767472:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767483:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767509:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.767518:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa718a4/0x5c74554e47cec3e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.767703:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605179520:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 77400us (77756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.767717:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789130491.777212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130491.778047:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180032 00000100:00100000:3.0:1789130491.778063:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180032 00000100:00100000:3.0:1789130491.778141:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789130491.778153:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:46880:x1876037605180032:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:3.0:1789130491.778258:0:43682:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x14:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac998 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130491.778833:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738516 00000001:00080000:3.0:1789130491.778893:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738517 00000001:00080000:3.0:1789130491.779321:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738518 00010000:00010000:3.0:1789130491.779391:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.779412:0:43682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.779424:0:43682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.779485:0:43682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.779504:0:43682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 30 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.779522:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626905216:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130491.781340:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130491.794047:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626905216:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130491.794095:0:43682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130491.800119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130491.801878:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180160 00000100:00100000:1.0:1789130491.801899:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180160 00010000:00010000:1.0:1789130491.801970:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 31 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130491.802026:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789130491.802038:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:2370:x1876037605180160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130491.802058:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130491.802066:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 31 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802082:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 31 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802116:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec393 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac975 expref: 31 pid: 43680 timeout: 1754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802456:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:1.0:1789130491.802464:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802477:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802487:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130491.802526:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130491.802829:0:43682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130491.802839:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130491.803017:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738519 00000001:00080000:3.0:1789130491.803301:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738520 00000100:00100000:3.0:1789130491.803463:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626905344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130491.803546:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130491.803596:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130491.803945:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:2370:x1876037605180160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1903us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.803957:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789130491.804058:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626905344 00000100:00100000:1.0:1789130491.804066:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626905344 00000100:00100000:1.0:1789130491.804111:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130491.804120:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626905344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789130491.804238:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626905344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130491.804246:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130491.804471:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626905344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789130491.805076:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738521 00000100:00100000:3.0:1789130491.805162:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626905472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130491.805225:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130491.805256:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130491.806451:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626905472 00000100:00100000:1.0:1789130491.806467:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626905472 00000100:00100000:1.0:1789130491.806535:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130491.806548:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626905472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130491.808001:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43682:x1876037626905472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1446us (2766us total) trans 34359738381 rc 0/0 00000100:00100000:0.0:1789130491.808017:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130491.808042:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d09e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626905472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789130491.808169:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738522 00010000:00010000:0.0:1789130491.808231:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808241:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808247:0:43682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808252:0:43682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130491.808256:0:43682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808265:0:43682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808285:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130491.808289:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130491.808295:0:43682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.808302:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec3ee lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130491.808746:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130491.808865:0:43682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].6, 64 off8600 00000004:00080000:0.0:1789130491.808882:0:43682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1654906278893ns, next at 1655906275217ns, rc = 0 00000001:00080000:0.0:1789130491.808889:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738523 00010000:00010000:0.0:1789130491.808931:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130491.808934:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130491.808943:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec3d9 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac998 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130491.809065:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:46880:x1876037605180032:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 30914us (31869us total) trans 34359738524 rc 0/0 00000100:00100000:0.0:1789130491.809076:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000020:00080000:0.0:1789130491.809081:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789130491.811877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.812010:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180288 00000100:00100000:0.0:1789130491.812023:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180288 00000100:00100000:0.0:1789130491.812103:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:0.0:1789130491.812115:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:46880:x1876037605180288:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130491.812155:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130491.812197:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec3f5 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac99f expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.812277:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec3f5 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac99f expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.812292:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec3f5 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac99f expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130491.812313:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130491.812316:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130491.812320:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130491.812394:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:46880:x1876037605180288:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 281us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130491.812402:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789130491.817236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130491.817381:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180544 00000100:00100000:0.0:1789130491.817395:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180544 00000100:00100000:0.0:1789130491.817490:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789130491.817503:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:46880:x1876037605180544:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130491.817878:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:46880:x1876037605180544:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 376us (656us total) trans 34359738525 rc 0/0 00000100:00100000:0.0:1789130491.817891:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130491.964165:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130491.967141:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180672 00000100:00100000:2.0:1789130491.967165:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180672 00000100:00100000:2.0:1789130491.967297:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:2.0:1789130491.967310:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:46890:x1876037605180672:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130491.967422:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967447:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967464:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967484:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967492:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967498:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967689:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967699:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.967706:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130491.967775:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968188:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968198:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968206:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968213:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.968218:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968227:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968243:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:2.0:1789130491.968247:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130491.968252:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968258:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec3fc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968276:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968282:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968288:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968294:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.968297:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968303:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968310:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130491.968313:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130491.968315:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968321:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec403 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968338:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968344:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968350:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968355:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130491.968357:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968363:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968373:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01400) 00010000:00010000:2.0:1789130491.968375:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130491.968379:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130491.968385:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0e00/0x5c74554e47cec40a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130491.968768:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:46890:x1876037605180672:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1455us (4612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130491.968781:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:1.0:1789130492.168421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130492.170326:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605180928 00000100:00100000:0.0:1789130492.170347:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605180928 00000100:00100000:0.0:1789130492.170447:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130492.170460:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:44607:x1876037605180928:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789130492.181546:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:44607:x1876037605180928:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 11068us (13130us total) trans 34359738526 rc 0/0 00000100:00100000:0.0:1789130492.181796:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130492.190208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130492.190383:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181056 00000100:00100000:1.0:1789130492.190398:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181056 00000100:00100000:1.0:1789130492.190495:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789130492.190507:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:44607:x1876037605181056:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130492.190529:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1789130492.190565:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec18d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8e9 expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.190595:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130492.190663:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec23c lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac91a expref: 35 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.190677:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130492.190687:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec3f5 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac99f expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.190697:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01400) 00010000:00010000:1.0:1789130492.190708:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec3b6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac98a expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.190723:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec1da lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac8f7 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.190732:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b497c01100) 00010000:00010000:1.0:1789130492.190742:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130492.191064:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:44607:x1876037605181056:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 558us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130492.191073:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000040:00080000:1.0:1789130492.300585:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130492.300629:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130492.300696:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 4 count 4 00000040:00080000:1.0:1789130492.300708:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130492.300995:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626905600:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130492.301136:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130492.317679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.318091:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181184 00000100:00100000:3.0:1789130492.318106:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181184 00000100:00100000:3.0:1789130492.318208:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789130492.318221:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:46904:x1876037605181184:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130492.318311:0:43679:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x11:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1789130492.318419:0:43679:0:(mdt_handler.c:8027:mdt_fid2path()) nonlocal object [0x200003ab1:0x11:0x0]: rc = -2 00000100:00100000:3.0:1789130492.318505:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:46904:x1876037605181184:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 286us (843us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130492.318514:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:1.0:1789130492.319587:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626905600:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130492.321772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130492.321897:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181440 00000100:00100000:0.0:1789130492.321909:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181440 00000100:00100000:0.0:1789130492.322003:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789130492.322016:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46904:x1876037605181440:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130492.322048:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130492.322083:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec411 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9a6 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130492.322312:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec411 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9a6 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130492.322336:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130492.322339:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130492.322345:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec411 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9a6 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130492.322368:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130492.322450:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46904:x1876037605181440:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 436us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1789130492.322458:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:2.0:1789130492.343487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.344036:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181696 00000100:00100000:3.0:1789130492.344050:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181696 00000100:00100000:3.0:1789130492.344152:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:3.0:1789130492.344176:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:46904:x1876037605181696:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789130492.344425:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344447:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344463:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344482:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344489:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344496:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344503:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130492.344508:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344517:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344530:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x11:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130492.344534:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130492.344540:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.344546:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec418 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130492.345429:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:46904:x1876037605181696:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 1259us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130492.345443:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:0.0:1789130492.349954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.350096:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181824 00000100:00100000:2.0:1789130492.350112:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181824 00000100:00100000:2.0:1789130492.350213:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:2.0:1789130492.350227:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:46903:x1876037605181824:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130492.350263:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130492.350302:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec41f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9ad expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.350405:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.350428:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.350444:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130492.350837:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130492.350844:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130492.350940:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.350975:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec41f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ad expref: 33 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.350998:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ad expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.351008:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130492.351012:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130492.351016:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130492.351113:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:46903:x1876037605181824:12345-192.168.201.39@tcp:101:cat.0 Request processed in 889us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130492.351122:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:0.0:1789130492.360703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.363560:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605181952 00000100:00100000:2.0:1789130492.363585:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605181952 00000100:00100000:2.0:1789130492.363710:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:2.0:1789130492.363723:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:46903:x1876037605181952:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130492.363752:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130492.363780:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec42d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9b4 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363868:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363890:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363904:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363921:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363940:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.363947:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364389:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364400:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364409:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130492.364454:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:2.0:1789130492.364459:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130492.364491:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364505:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364516:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364523:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364530:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130492.364535:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364544:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364561:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130492.364564:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130492.364570:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364577:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364593:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364598:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364635:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364641:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130492.364644:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364650:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364657:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b48a1fd100) 00010000:00010000:2.0:1789130492.364660:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130492.364663:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364669:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec43b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364709:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9b4 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364726:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9b4 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.364733:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:2.0:1789130492.364735:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130492.364738:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130492.364837:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b390cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:46903:x1876037605181952:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1115us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130492.364847:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000040:00080000:2.0:1789130492.366404:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130492.366415:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130492.366455:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 4 count 4 00000040:00080000:2.0:1789130492.366464:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130492.371228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.371441:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605182208 00000100:00100000:3.0:1789130492.371455:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605182208 00000100:00100000:3.0:1789130492.371536:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1789130492.371549:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:46903:x1876037605182208:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789130492.371579:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130492.371660:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec449 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9bb expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371763:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371781:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371795:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371810:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371816:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.371823:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372083:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec45e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372093:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec45e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372101:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec45e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130492.372118:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130492.372258:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372267:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372275:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372282:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130492.372288:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372297:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372312:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:3.0:1789130492.372315:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130492.372321:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372327:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec450 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372342:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372349:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372361:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372367:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130492.372370:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372377:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372386:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939400) 00010000:00010000:3.0:1789130492.372388:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130492.372391:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372398:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec457 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372456:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec449 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9bb expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372472:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec45e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9bb expref: 35 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.372480:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:3.0:1789130492.372483:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130492.372486:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130492.377749:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:46903:x1876037605182208:12345-192.168.201.39@tcp:101:cat.0 Request processed in 6175us (6509us total) trans 34359738527 rc 0/0 00000100:00100000:3.0:1789130492.377775:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:0.0:1789130492.392868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.393040:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605182464 00000100:00100000:3.0:1789130492.393059:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605182464 00000100:00100000:3.0:1789130492.393153:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1789130492.393177:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:46903:x1876037605182464:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:3.0:1789130492.393568:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+36:46903:x1876037605182464:12345-192.168.201.39@tcp:35:cat.0 Request processed in 401us (716us total) trans 34359738528 rc 0/0 00000100:00100000:3.0:1789130492.393579:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130492.518021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.518132:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605182720 00000100:00100000:2.0:1789130492.518147:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605182720 00000100:00100000:2.0:1789130492.518251:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:2.0:1789130492.518264:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:46914:x1876037605182720:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130492.518300:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130492.518331:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec46c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9c2 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.518522:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec473 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.518542:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec473 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.518558:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec473 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130492.518572:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00010000:00010000:2.0:1789130492.518807:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec46c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c2 expref: 39 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.518832:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec473 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c2 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.518842:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:2.0:1789130492.518845:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130492.518850:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130492.522439:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:46914:x1876037605182720:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 4158us (4416us total) trans 34359738529 rc 0/0 00000100:00100000:2.0:1789130492.522460:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00010000:00010000:0.0:1789130492.550809:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130492.622203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.622300:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605182848 00000100:00100000:3.0:1789130492.622313:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605182848 00000100:00100000:3.0:1789130492.622409:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:3.0:1789130492.622429:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+38:46920:x1876037605182848:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130492.622468:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130492.622497:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9c9 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.622678:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.622696:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.622710:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130492.623052:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:3.0:1789130492.623058:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130492.623095:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.623233:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c9 expref: 40 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.623261:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c9 expref: 39 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130492.623272:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:3.0:1789130492.623275:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130492.623281:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789130492.623376:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+39:46920:x1876037605182848:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 956us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130492.623385:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1789130492.637085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.637292:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605183104 00000100:00100000:2.0:1789130492.637306:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605183104 00000100:00100000:2.0:1789130492.637393:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:2.0:1789130492.637405:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:46920:x1876037605183104:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130492.637434:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130492.637465:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec48f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9d0 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.637866:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec496 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.637885:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec496 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.637899:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec496 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130492.637913:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:2.0:1789130492.638097:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec48f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d0 expref: 42 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.638123:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec496 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d0 expref: 41 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130492.640371:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:2.0:1789130492.640379:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130492.640386:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:3.0:1789130492.642042:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+41:46920:x1876037605183104:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 4617us (4958us total) trans 34359738530 rc 0/0 00000100:00100000:3.0:1789130492.642060:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:0.0:1789130492.652461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130492.652519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130492.653322:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605183360 00000100:00100000:3.0:1789130492.653338:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605183360 00000100:00100000:3.0:1789130492.653423:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789130492.653435:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+41:46920:x1876037605183360:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130492.653838:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+42:46920:x1876037605183360:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 402us (1394us total) trans 34359738531 rc 0/0 00000100:00100000:3.0:1789130492.653849:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:1.0:1789130492.659347:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605183488 00000100:00100000:1.0:1789130492.659375:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605183488 00000100:00100000:1.0:1789130492.659515:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789130492.659528:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+42:2367:x1876037605183488:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130492.659549:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130492.659598:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec496 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d0 expref: 42 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.659672:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:1.0:1789130492.659680:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130492.659784:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+41:2367:x1876037605183488:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 258us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130492.659794:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789130492.909802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130492.910066:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605183744 00000100:00100000:1.0:1789130492.910080:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605183744 00000100:00100000:1.0:1789130492.910184:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789130492.910197:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+41:46936:x1876037605183744:12345-192.168.201.39@tcp:101:multiop.0 00010000:00010000:1.0:1789130492.910236:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130492.910270:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4a4 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9d7 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.910409:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec4ab lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.910428:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec4ab lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.910447:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec4ab lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130492.910461:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:1.0:1789130492.910694:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4a4 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d7 expref: 44 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.910719:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec4ab lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d7 expref: 43 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130492.910729:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:1.0:1789130492.910733:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789130492.910738:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f800, rc 0) 00000100:00100000:1.0:1789130492.911098:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+43:46936:x1876037605183744:12345-192.168.201.39@tcp:101:multiop.0 Request processed in 901us (1329us total) trans 34359738532 rc 0/0 00000100:00100000:1.0:1789130492.911115:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:2.0:1789130492.963799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.963861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.963904:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.963971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130492.964025:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184256 00000100:00100000:2.0:1789130492.964036:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184256 00000100:00100000:0.0:1789130492.964232:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184128 00000100:00100000:0.0:1789130492.964238:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184128 00000100:00100000:0.0:1789130492.967295:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184000 00000100:00100000:0.0:1789130492.967317:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184000 00000100:00100000:0.0:1789130492.967406:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130492.967420:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605184128:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130492.967544:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605184128:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 127us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130492.967552:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789130492.967577:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789130492.967585:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605184000:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130492.967631:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605184000:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 47us (3726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130492.967637:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00080000:0.0:1789130492.967865:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130492.967873:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130492.970716:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789130492.970743:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605184256:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130492.970907:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605184256:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 176us (6935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130492.970918:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:1.0:1789130492.971530:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605183872 00000100:00100000:1.0:1789130492.971544:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605183872 00000100:00100000:1.0:1789130492.971661:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1789130492.971674:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605183872:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130492.971734:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605183872:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 63us (7953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130492.971742:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:0.0:1789130493.123066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.123947:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184384 00000100:00100000:3.0:1789130493.123966:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184384 00000100:00080000:0.0:1789130493.124056:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130493.124088:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:3.0:1789130493.124114:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+43:46949:x1876037605184384:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789130493.124233:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124259:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124278:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124322:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124330:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124339:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124347:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130493.124353:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124363:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124377:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:3.0:1789130493.124510:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130493.124588:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.124646:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4b9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130493.126702:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+43:46949:x1876037605184384:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 678us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.126732:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:3.0:1789130493.323929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.324072:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184768 00000100:00100000:0.0:1789130493.324085:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184768 00000100:00100000:0.0:1789130493.324186:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789130493.324199:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+43:46961:x1876037605184768:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130493.324595:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:46961:x1876037605184768:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 396us (680us total) trans 34359738533 rc 0/0 00000100:00100000:0.0:1789130493.324648:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789130493.326909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130493.327147:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605184896 00000100:00100000:2.0:1789130493.327166:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605184896 00000100:00100000:2.0:1789130493.327241:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789130493.327253:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+44:46961:x1876037605184896:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1789130493.327272:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130493.327304:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec4ab lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9d7 expref: 44 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.327329:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec45e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9bb expref: 43 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.327341:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939800) 00010000:00010000:2.0:1789130493.327354:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130493.327415:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+42:46961:x1876037605184896:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 164us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130493.327427:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789130493.329831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.329908:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185024 00000100:00100000:3.0:1789130493.329917:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185024 00000100:00100000:3.0:1789130493.329972:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:3.0:1789130493.329982:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+42:46961:x1876037605185024:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:3.0:1789130493.330098:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.330126:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.330139:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130493.330702:0:43679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].4, 136 off8736 00000100:00100000:3.0:1789130493.330784:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+42:46961:x1876037605185024:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 803us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.330793:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:3.0:1789130493.358087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.358286:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185152 00000100:00100000:1.0:1789130493.358295:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185152 00000100:00100000:1.0:1789130493.358348:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:1.0:1789130493.358356:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+42:46963:x1876037605185152:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130493.358378:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130493.358396:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4c7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9de expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358462:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358474:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358484:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358494:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358498:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358506:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358597:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358635:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358640:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130493.358670:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00000004:00200000:1.0:1789130493.358674:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130493.358688:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358697:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358704:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358710:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358717:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358723:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.358727:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358736:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358749:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:1.0:1789130493.358752:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130493.358757:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358761:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4ce lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358772:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358775:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358779:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358782:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.358784:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358787:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358791:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b4909bd900) 00010000:00010000:1.0:1789130493.358792:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130493.358794:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358798:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4d5 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358820:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4c7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 44 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358828:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 43 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.358833:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130493.358834:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130493.358836:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130493.358895:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+43:46963:x1876037605185152:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 540us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130493.358900:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000040:00080000:2.0:1789130493.382460:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130493.382470:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130493.382513:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 5 count 5 00000040:00080000:2.0:1789130493.382520:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130493.382877:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0f0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626905728:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130493.382991:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130493.391323:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0f0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626905728:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130493.400647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.401298:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185280 00000100:00100000:0.0:1789130493.401308:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185280 00000100:00100000:0.0:1789130493.402253:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:0.0:1789130493.402271:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:46967:x1876037605185280:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130493.402313:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x14:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130493.402433:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+43:46967:x1876037605185280:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 168us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130493.402441:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:3.0:1789130493.426488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.426630:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185408 00000100:00100000:1.0:1789130493.426642:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185408 00000100:00100000:1.0:1789130493.426708:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1789130493.426721:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+43:46967:x1876037605185408:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130493.426811:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426829:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426842:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426863:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426870:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426877:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426908:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426918:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.426924:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130493.426999:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00000004:00200000:1.0:1789130493.427005:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130493.427020:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427032:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427038:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427045:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427056:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.427060:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427067:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427079:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:1.0:1789130493.427082:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130493.427100:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427107:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec4e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427127:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427133:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427139:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427144:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.427158:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427165:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427176:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9753f962 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130493.427179:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130493.427181:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427188:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec4ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9753f962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427199:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427205:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427211:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427221:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.427224:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427230:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427238:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130493.427240:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130493.427243:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.427249:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec4f1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.427352:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+43:46967:x1876037605185408:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 632us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130493.427362:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:2.0:1789130493.435747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.435834:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185664 00000100:00100000:3.0:1789130493.435846:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185664 00000100:00100000:3.0:1789130493.435915:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:3.0:1789130493.435926:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+43:46967:x1876037605185664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130493.435949:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130493.435972:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec4f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9e5 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436081:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436097:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436109:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130493.436120:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130493.436248:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436256:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436263:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436271:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130493.436276:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436284:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436303:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130493.436307:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130493.436322:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436329:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec4ff lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436377:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec4f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9e5 expref: 45 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436389:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130493.436392:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130493.436395:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec4f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9e5 expref: 45 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.436411:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:3.0:1789130493.436491:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605185664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 566us (757us total) trans 34359738534 rc 301/301 00000100:00100000:3.0:1789130493.436500:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:2.0:1789130493.455841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.466339:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605185792 00000100:00100000:1.0:1789130493.466365:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605185792 00000100:00100000:1.0:1789130493.466480:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:1.0:1789130493.466493:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605185792:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130493.466537:0:43681:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x14:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130493.466773:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605185792:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 282us (10940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130493.466783:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:3.0:1789130493.473890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.474685:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186048 00000100:00100000:0.0:1789130493.474701:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186048 00000100:00100000:0.0:1789130493.474806:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:0.0:1789130493.474819:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605186048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130493.474848:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130493.474851:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130493.474888:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec488 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c9 expref: 44 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.474915:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:0.0:1789130493.474922:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130493.474938:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec50d lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9ec expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130493.475928:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe6:0x0], index 1: 0 00010000:00010000:0.0:1789130493.478822:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec514 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.478851:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec514 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.478865:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec514 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.478954:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec50d lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ec expref: 46 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.478978:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec514 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ec expref: 45 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.478993:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130493.478996:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130493.478999:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130493.480723:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+45:46967:x1876037605186048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5892us (6834us total) trans 34359738535 rc 0/0 00000100:00100000:0.0:1789130493.480742:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:3.0:1789130493.498890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.499060:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186304 00000100:00100000:0.0:1789130493.499073:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186304 00000100:00100000:0.0:1789130493.499168:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789130493.499181:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+45:46967:x1876037605186304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130493.499265:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130493.499304:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec514 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ec expref: 45 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499331:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130493.499348:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130493.499378:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499397:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499409:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499429:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499442:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499448:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499559:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499568:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499574:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499582:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130493.499587:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499594:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499637:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:0.0:1789130493.499641:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130493.499646:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 2/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499654:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec522 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499665:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499673:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499681:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499686:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130493.499689:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499696:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499704:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5d25987a (ffff90b497c01100) 00010000:00010000:0.0:1789130493.499707:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130493.499710:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.499717:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec529 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x10:0x0].0x5d25987a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130493.500027:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605186304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 846us (1151us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130493.500038:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789130493.515850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.515979:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186432 00000100:00100000:3.0:1789130493.515993:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186432 00000100:00100000:3.0:1789130493.516071:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:3.0:1789130493.516084:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+44:46967:x1876037605186432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130493.516125:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130493.516174:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec530 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9f3 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516228:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516247:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516262:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516405:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec530 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 46 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516427:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 45 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.516437:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130493.516441:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130493.516445:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:3.0:1789130493.516525:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+45:46967:x1876037605186432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 443us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.516533:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:3.0:1789130493.519109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.524730:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186688 00000100:00100000:0.0:1789130493.524753:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186688 00000100:00100000:0.0:1789130493.524982:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:0.0:1789130493.524997:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+45:46967:x1876037605186688:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130493.525182:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.525208:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.525226:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130493.527075:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].6, 88 off8624 00000004:00080000:0.0:1789130493.527818:0:43681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1656625213446ns, next at 1657624487058ns, rc = 0 00000004:00010000:0.0:1789130493.527987:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000314c44b reply state 00000000e18801dd transno 34359738536 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130493.528003:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130493.528331:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+47:46967:x1876037605186688:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 3329us (9236us total) trans 34359738536 rc 0/0 00000100:00100000:0.0:1789130493.528342:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789130493.536726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.536783:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186816 00000100:00100000:3.0:1789130493.536795:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186816 00000100:00100000:3.0:1789130493.536871:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:3.0:1789130493.536884:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+47:46967:x1876037605186816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130493.536918:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130493.536949:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ac9fa expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.537033:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 48 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.537051:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 48 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.537076:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130493.537079:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130493.537083:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:3.0:1789130493.537172:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+48:46967:x1876037605186816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 290us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.537181:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00010000:00010000:1.0:1789130493.537633:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537647:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537656:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537665:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130493.537671:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537682:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537701:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:1.0:1789130493.537705:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130493.537710:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.537717:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec53e lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.544552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.545926:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605186944 00000100:00100000:3.0:1789130493.545943:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605186944 00000100:00100000:3.0:1789130493.546036:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789130493.546049:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605186944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789130493.553919:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605186944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 7854us (9375us total) trans 34359738380 rc 0/0 00000100:00100000:0.0:1789130493.553940:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789130493.566563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.566799:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605187200 00000100:00100000:0.0:1789130493.566813:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605187200 00000100:00100000:0.0:1789130493.566898:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:0.0:1789130493.566910:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+47:46967:x1876037605187200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130493.567278:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+48:46967:x1876037605187200:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 367us (741us total) trans 34359738537 rc 0/0 00000100:00100000:0.0:1789130493.567298:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:2.0:1789130493.574193:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130493.580208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.580392:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605187456 00000100:00100000:3.0:1789130493.580407:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605187456 00000100:00100000:3.0:1789130493.580492:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:3.0:1789130493.580506:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+48:46967:x1876037605187456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130493.580685:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+48:46967:x1876037605187456:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 181us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.580695:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:0.0:1789130493.584403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.585190:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605187584 00000100:00100000:3.0:1789130493.585207:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605187584 00000100:00100000:3.0:1789130493.586408:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789130493.586433:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+48:46967:x1876037605187584:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130493.586468:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130493.586501:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec54c lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca01 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586628:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586649:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586663:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130493.586716:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130493.586740:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586773:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec54c lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca01 expref: 50 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586792:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca01 expref: 49 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.586801:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130493.586805:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130493.586810:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:3.0:1789130493.586909:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+49:46967:x1876037605187584:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 484us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.586918:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789130493.597425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.604874:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605187712 00000100:00100000:1.0:1789130493.604896:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605187712 00000100:00100000:0.0:1789130493.619250:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1789130493.619270:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605187712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130493.619314:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130493.619352:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca08 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130493.619391:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f6fd, blocks: 0x1 00010000:00010000:0.0:1789130493.619422:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=1656s v=(0 0) 00010000:00010000:0.0:1789130493.619428:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130493.619441:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 10 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.619465:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 10 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.619482:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130493.619572:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605187712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 308us (22163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130493.619581:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1789130493.623449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.623646:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605187968 00000100:00100000:0.0:1789130493.623659:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605187968 00000100:00100000:0.0:1789130493.623745:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:0.0:1789130493.623757:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+49:46967:x1876037605187968:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130493.623917:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+49:46967:x1876037605187968:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 161us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130493.623927:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:0.0:1789130493.646125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130493.646344:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188096 00000100:00100000:2.0:1789130493.646360:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188096 00000100:00100000:2.0:1789130493.646450:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789130493.646462:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:46967:x1876037605188096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130493.646489:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130493.646519:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca0f expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.646565:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 11 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.646576:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130493.646584:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130493.646590:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 11 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.646651:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 11 pid: 44366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.646669:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 11 pid: 44366 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130493.646688:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eae580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:44793:1876037626905856:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130493.646834:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130493.652067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.653813:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188224 00000100:00100000:1.0:1789130493.653834:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188224 00010000:00010000:1.0:1789130493.653910:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 12 pid: 44366 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.653965:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789130493.653979:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605188224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130493.654004:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130493.654039:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 12 pid: 44366 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.654055:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 12 pid: 44366 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.654092:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130493.654097:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130493.654108:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 12 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.654125:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 12 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.654197:0:45795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 12 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.654221:0:45795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45795:1876037626905984:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130493.654444:0:45795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b387306300 going to sleep for 11 seconds 00010000:00010000:1.0:1789130493.654515:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e505758c/0x5c74554e47cec55a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca08 expref: 12 pid: 44366 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.654535:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eae580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:44793:1876037626905856:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130493.654576:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 11 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.654589:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1600, rc 0) 00000100:00100000:1.0:1789130493.654650:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:46967:x1876037605188096:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 8190us (8554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130493.654659:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1789130493.661745:0:45795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45795:1876037626905984:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130493.661830:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130493.661927:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605188224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 7950us (9875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.661943:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789130493.664305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130493.664964:0:44372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188352 00000100:00100000:3.0:1789130493.664982:0:44372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188352 00002000:00100000:3.0:1789130493.665065:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe6:0x0] (0->14) req@ffff90b3897d1a40 x1876037605188352/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:209/0 lens 504/0 e 0 to 0 dl 1789130504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130493.665079:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d1a40 with x1876037605188352 ext(0->14) 00002000:00010000:3.0:1789130493.665088:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d1a40 00000100:00100000:3.0:1789130493.665156:0:44372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789130493.665173:0:44372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605188352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130493.666655:0:44372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605188352:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 1475us (2368us total) trans 34359738381 rc 0/0 00000100:00100000:3.0:1789130493.666673:0:44372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00100000:3.0:1789130493.666687:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe6:0x0] (0->14) req@ffff90b3897d1a40 x1876037605188352/t34359738381(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:209/0 lens 504/448 e 0 to 0 dl 1789130504 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130493.666708:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d1a40 with x1876037605188352 ext(0->14) 00002000:00010000:3.0:1789130493.666717:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d1a40 00000100:00100000:3.0:1789130493.680309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.680481:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188480 00000100:00100000:0.0:1789130493.680499:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188480 00000100:00100000:0.0:1789130493.680598:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:0.0:1789130493.680639:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+49:46967:x1876037605188480:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1789130493.703057:0:43702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1656800449001ns, next at 1657800445358ns, rc = 0 00000100:00100000:3.0:1789130493.703089:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130493.703119:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626906112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130493.703273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130493.703351:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626906112 00000100:00100000:3.0:1789130493.703363:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626906112 00000100:00100000:3.0:1789130493.703439:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130493.703451:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626906112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130493.703497:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130493.703553:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626906112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130493.703560:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789130493.703586:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130493.703868:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626906112:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789130493.821631:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738537 is committed 00000004:00080000:3.0:1789130493.821660:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789130493.821689:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789130493.821758:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487d55780 refcount 2 committed 0 result 0 batchid 30064771679 00000020:00080000:3.0:1789130493.821764:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4c1862800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487d55cc0 00000020:00080000:3.0:1789130493.821768:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4c1862f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3895c3000 00000020:00080000:3.0:1789130493.821802:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4860abb40 refcount 2 committed 0 result 0 batchid 30064771680 00000020:00080000:3.0:1789130493.821807:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b487676000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4860abf00 00000020:00080000:3.0:1789130493.821811:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b487676600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3869dc000 00000020:00080000:3.0:1789130493.822000:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771680 committed batchid 30064771678 00000100:00100000:0.0:1789130493.822105:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46967:x1876037605188480:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 141462us (141819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130493.822121:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1789130493.822293:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130493.822316:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626906496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130493.822399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130493.823439:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626906496 00000100:00100000:0.0:1789130493.823456:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626906496 00000100:00100000:0.0:1789130493.823698:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789130493.823714:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130493.823715:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626906496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789130493.824014:0:44366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb size from disk: 0 -> 15 00002000:00010000:0.0:1789130493.824018:0:44366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb mtime from disk: 0 -> 1789130493 00002000:00010000:0.0:1789130493.824021:0:44366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130493.824023:0:44366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb ctime from disk: 1789130493 -> 1789130493 00002000:00010000:0.0:1789130493.824025:0:44366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130493.824132:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626906496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 420us (1731us total) trans 34359738382 rc 0/0 00000100:00100000:0.0:1789130493.824152:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1789130493.824262:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386eaa940/2, rc 0, transno 34359738382 00000100:00100000:2.0:1789130493.824271:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626906496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789130493.825263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.827908:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188608 00000100:00100000:0.0:1789130493.827939:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188608 00000100:00100000:1.0:1789130493.828204:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130493.828219:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2367:x1876037605188608:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000020:00080000:3.0:1789130493.828662:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771678 00000100:00100000:3.0:1789130493.828703:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ea92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626906368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789130493.828806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130493.828881:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130493.828891:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626906240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130493.828924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130493.828958:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626906368 00000100:00100000:3.0:1789130493.828963:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626906368 00000100:00100000:3.0:1789130493.828998:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626906240 00000100:00100000:3.0:1789130493.829002:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626906240 00000100:00100000:3.0:1789130493.829035:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130493.829043:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626906368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789130493.829069:0:44367:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:229 count 1 00010000:00010000:3.0:1789130493.830337:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.830372:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 12 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.830382:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789130493.830388:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130493.830394:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.830453:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 12 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.830471:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 12 pid: 44367 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130493.830489:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626906624:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130493.830597:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130493.840690:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626906624:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130493.840729:0:44367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.846112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130493.846194:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188736 00000100:00100000:1.0:1789130493.846206:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188736 00010000:00010000:1.0:1789130493.846272:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 13 pid: 44367 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.846330:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789130493.846344:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:2369:x1876037605188736:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130493.846371:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130493.846379:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 13 pid: 44367 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.846399:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 13 pid: 44367 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.846435:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaff93df/0x5c74554e47cec35b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac96e expref: 13 pid: 44367 timeout: 1756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.846458:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130493.846463:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130493.846471:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.846482:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.846517:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130493.846600:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605188736:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 257us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130493.846634:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:3.0:1789130493.848916:0:44367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.848942:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.848958:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.848967:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.850305:0:44367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130493.851239:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1876037626906368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22188us (22425us total) trans 34359738383 rc 0/0 00000100:00100000:3.0:1789130493.851255:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130493.851304:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130493.851322:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626906240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130493.851365:0:44367:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:229 count 1 00002000:00010000:3.0:1789130493.851413:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe5:0x0] initial LVB size: 15, mtime: 0x6aa3f6fb, atime: 0x6aa3f6fb, ctime: 0x6aa3f6fb, blocks: 0x1 00010000:00010000:3.0:1789130493.851423:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.851444:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=1656s v=(0 0) 00010000:00010000:3.0:1789130493.851449:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130493.851457:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.851478:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.851490:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130493.851499:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855157:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130493.855179:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855197:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130493.855204:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855219:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855254:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855264:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47cec568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855301:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130493.855306:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855314:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130493.855317:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855324:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855334:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130493.855341:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130493.855342:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130493.855344:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130493.858377:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386ea92c0/2, rc 0, transno 34359738383 00000100:00100000:2.0:1789130493.858401:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ea92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626906368:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789130493.860168:0:44367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789130493.860191:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cec56f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130493.862541:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626906240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11216us (33604us total) trans 34359738382 rc 0/0 00000100:00100000:3.0:1789130493.862560:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1789130493.867646:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130493.873718:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386ef6d00/2, rc 0, transno 34359738382 00000100:00100000:3.0:1789130493.873748:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626906240:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789130493.979816:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738382 is committed 00000001:00080000:2.0:1789130493.979889:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738378 is committed 00000001:00080000:2.0:1789130493.979905:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738381 is committed 00000100:00100000:0.0:1789130493.980581:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605188608:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 152356us (155315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130493.980597:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789130493.989005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130493.989333:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605188992 00000100:00100000:0.0:1789130493.989350:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605188992 00000100:00100000:0.0:1789130493.989422:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:0.0:1789130493.989435:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:46967:x1876037605188992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130493.989937:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130493.990438:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec553 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca01 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130493.990466:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130493.990473:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130493.993746:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.993847:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130493.993864:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130493.995696:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e260f2ab reply state 0000000038b5e3d6 transno 34359738538 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130493.995719:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130493.996056:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:46967:x1876037605188992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 6616us (7057us total) trans 34359738538 rc 0/0 00000100:00100000:1.0:1789130493.996070:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00010000:00010000:2.0:1789130494.006459:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006484:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006495:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006503:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130494.006568:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006580:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006658:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130494.006662:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130494.006668:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.006675:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec576 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130494.007313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130494.007693:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605189120 00000100:00100000:0.0:1789130494.007707:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605189120 00000100:00100000:0.0:1789130494.008006:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789130494.008029:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605189120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789130494.008677:0:44793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb size from disk: 15 -> 15 00002000:00010000:0.0:1789130494.008684:0:44793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb mtime from disk: 1789130493 -> 1789130491 00002000:00010000:0.0:1789130494.008688:0:44793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb atime from disk: 0 -> 1789130491 00002000:00010000:0.0:1789130494.008691:0:44793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb ctime from disk: 1789130493 -> 1789130491 00002000:00010000:0.0:1789130494.008694:0:44793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789130494.008803:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605189120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 776us (1495us total) trans 34359738384 rc 0/0 00000100:00100000:0.0:1789130494.008814:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00080000:2.0:1789130494.009368:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130494.015852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130494.015964:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605189376 00000100:00100000:3.0:1789130494.015977:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605189376 00000100:00100000:3.0:1789130494.018134:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:3.0:1789130494.018177:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:46967:x1876037605189376:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789130494.018316:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.018343:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.018354:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.018404:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.018423:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 12 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.018454:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626906752:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130494.019587:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130494.032032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130494.032312:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626906752:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130494.032354:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.041282:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605189504 00000100:00100000:3.0:1789130494.041301:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605189504 00010000:00010000:3.0:1789130494.041439:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130494.042021:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130494.042044:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605189504:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130494.042070:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130494.042084:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042239:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042275:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec537 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9f3 expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042295:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:1.0:1789130494.042301:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042314:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042324:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.042368:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130494.042478:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605189504:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 443us (10470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130494.042488:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00010000:00010000:2.0:1789130494.042583:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042594:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042670:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042678:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042687:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042695:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130494.042701:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042710:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042721:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130494.042725:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789130494.042730:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.042737:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec57d lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130494.042796:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:46967:x1876037605189376:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 24638us (26957us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789130494.042805:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:0.0:1789130494.066315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130494.067264:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605189632 00000100:00100000:3.0:1789130494.067281:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605189632 00000100:00100000:3.0:1789130494.067379:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789130494.067392:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605189632:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789130494.067459:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.067483:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 8 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.067494:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789130494.067499:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130494.067504:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.067551:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 8 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.067568:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 8 pid: 44793 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.067588:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626906880:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130494.067757:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1789130494.072001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130494.072339:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626906880:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130494.072449:0:44367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130494.072591:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605189760 00000100:00100000:1.0:1789130494.072599:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605189760 00010000:00010000:1.0:1789130494.072672:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 9 pid: 44793 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130494.074133:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789130494.074210:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605189760:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130494.074243:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130494.074279:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 9 pid: 44793 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.074300:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 9 pid: 44793 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.074335:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd585178/0x5c74554e47cec561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca0f expref: 9 pid: 44793 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.074357:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130494.074363:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130494.074381:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.074392:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.074434:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130494.074520:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605189760:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 324us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130494.074529:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:3.0:1789130494.074750:0:44367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074761:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074794:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074804:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074813:0:44367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074821:0:44367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130494.074826:0:44367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074841:0:44367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074855:0:44367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.074864:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47cec584 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.074927:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605189632:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7538us (8631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130494.074936:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789130494.087421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130494.087569:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190016 00000100:00100000:3.0:1789130494.087584:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190016 00000100:00100000:3.0:1789130494.087694:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789130494.087705:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:46967:x1876037605190016:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789130494.087816:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.087839:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.087853:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.088265:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.088281:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.088292:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.088338:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.088354:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 12 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.088386:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626907008:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130494.088506:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1789130494.104957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130494.105014:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190144 00000100:00100000:0.0:1789130494.105027:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190144 00010000:00010000:0.0:1789130494.105087:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130494.105133:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789130494.105154:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605190144:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130494.105176:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130494.105184:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.105200:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 13 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.105230:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130494.105236:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.105248:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.105256:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.105281:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130494.105343:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605190144:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 192us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130494.105352:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00010000:00010000:2.0:1789130494.107130:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec545 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9fa expref: 12 pid: 43679 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130494.107166:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626907008:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130494.107197:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.107208:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.107215:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130494.107485:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738539 00000001:00080000:2.0:1789130494.107683:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738540 00000001:00080000:2.0:1789130494.107736:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738541 00000100:00100000:2.0:1789130494.107844:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626907136:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130494.107922:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130494.107956:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130494.108133:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626907136 00000100:00100000:0.0:1789130494.108149:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626907136 00000100:00100000:0.0:1789130494.108208:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130494.108218:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626907136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130494.108334:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626907136:12345-0@lo:1000:mdt00_000.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130494.108344:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130494.109799:0:43679:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738382 gen 2 00000004:00080000:2.0:1789130494.109808:0:43679:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738379 committed transno 34359738382 00000004:00080000:2.0:1789130494.109837:0:43679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386eaa940, transno 34359738382 00000100:00100000:2.0:1789130494.112088:0:43679:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b386ea92c0 x1876037626906368/t34359738383(34359738383) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130509 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130494.112113:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626907136:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789130494.112815:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738542 00000100:00100000:2.0:1789130494.113524:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626907264:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130494.113704:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130494.113740:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130494.114550:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626907264 00000100:00100000:0.0:1789130494.114562:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626907264 00000100:00100000:0.0:1789130494.114675:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130494.114687:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626907264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130494.116497:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:43679:x1876037626907264:12345-0@lo:1000:mdt00_000.0 Request processed in 1801us (2782us total) trans 34359738385 rc 0/0 00000100:00100000:0.0:1789130494.116513:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130494.117924:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626907264:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789130494.118167:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738543 00010000:00010000:0.0:1789130494.118265:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118279:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118288:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118295:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130494.118301:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118311:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118342:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130494.118345:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130494.118352:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118359:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec592 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118853:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118861:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118868:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118874:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130494.118878:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118884:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118895:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130494.118898:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130494.118901:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118907:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec4c0 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.118939:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.120200:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.120223:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.120287:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.120311:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 16 pid: 43681 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130494.120333:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626907392:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130494.122246:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130494.128075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130494.128144:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190272 00000100:00100000:0.0:1789130494.128159:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190272 00010000:00010000:0.0:1789130494.128218:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 17 pid: 43681 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130494.128265:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789130494.128278:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605190272:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130494.128300:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130494.128308:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 17 pid: 43681 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.128324:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 17 pid: 43681 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.128353:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130494.128372:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.128386:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.128395:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130494.128421:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130494.128489:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605190272:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 213us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130494.128498:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:3.0:1789130494.129154:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec4dc lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9de expref: 16 pid: 43681 timeout: 1757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.129176:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626907392:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130494.129205:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129215:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129221:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129237:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129245:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129254:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129261:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130494.129268:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129277:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129291:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130494.129294:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130494.129298:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129305:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec599 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129316:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129322:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129328:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129333:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130494.129337:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129343:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129351:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130494.129353:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130494.129356:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130494.129368:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec58b lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130494.129734:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:46967:x1876037605190016:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 42029us (42326us total) trans 34359738544 rc 0/0 00000100:00100000:3.0:1789130494.129747:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000020:00080000:3.0:1789130494.129753:0:43679:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1789130494.130420:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130494.130427:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130494.130460:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 5 count 5 00000040:00080000:0.0:1789130494.130469:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:0.0:1789130494.143751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130494.144102:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190528 00000100:00100000:1.0:1789130494.144117:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190528 00000100:00100000:1.0:1789130494.144210:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130494.144225:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:46967:x1876037605190528:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789130494.149417:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130494.149766:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738545 00010000:00010000:1.0:1789130494.149884:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.149909:0:43683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.149923:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.149934:0:43683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.149941:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.149948:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130494.150449:0:43683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130494.150668:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46967:x1876037605190528:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 6438us (6923us total) trans 34359738546 rc 0/0 00000100:00100000:1.0:1789130494.150683:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000020:00080000:1.0:1789130494.150694:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789130494.158093:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130494.158116:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.158132:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130494.158147:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.158160:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.158190:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x16:0x0].0x0 (ffff90b4909bd900) 00010000:00010000:2.0:1789130494.158193:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130494.158201:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.158208:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5a0 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130494.158236:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130494.158238:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130494.158240:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130494.605881:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130495.111944:0:46264:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130495.111958:0:46264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130495.112015:0:46264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 5 count 5 00000040:00080000:3.0:1789130495.112023:0:46264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:0.0:1789130495.279295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.281546:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190656 00000100:00100000:3.0:1789130495.281565:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190656 00000100:00080000:0.0:1789130495.281638:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130495.281702:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:3.0:1789130495.281716:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46985:x1876037605190656:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130495.281842:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.281865:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.281883:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.281902:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.281909:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.281917:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282341:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282353:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282361:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130495.282429:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282446:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282453:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282461:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282473:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.282478:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282487:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282503:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:3.0:1789130495.282506:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.282513:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282520:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5a7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282534:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282541:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282547:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282552:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.282555:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282562:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282575:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939400) 00010000:00010000:3.0:1789130495.282578:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.282581:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282587:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ae lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282637:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282644:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282651:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282656:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.282659:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282665:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282674:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130495.282676:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.282679:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.282685:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5b5 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130495.282801:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:46985:x1876037605190656:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1085us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130495.282813:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:3.0:1789130495.323292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.323404:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605190912 00000100:00100000:1.0:1789130495.323419:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605190912 00000100:00100000:1.0:1789130495.323500:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:1.0:1789130495.323513:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:46988:x1876037605190912:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130495.323542:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130495.323573:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec5bc lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca16 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323711:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323731:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323746:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323766:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323783:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.323792:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324242:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec5d1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324252:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec5d1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324261:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec5d1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130495.324273:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:1.0:1789130495.324392:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324406:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324414:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324422:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ea00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130495.324427:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324436:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324453:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:1.0:1789130495.324456:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130495.324463:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324470:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec5c3 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324486:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324492:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324498:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324504:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130495.324507:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324513:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324521:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b4909bdb00) 00010000:00010000:1.0:1789130495.324524:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130495.324527:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324532:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec5ca lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324587:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec5bc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca16 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324635:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec5d1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca16 expref: 19 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.324644:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:1.0:1789130495.324646:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130495.324648:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130495.324750:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+19:46988:x1876037605190912:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1239us (1473us total) trans 34359738547 rc 0/0 00000100:00100000:1.0:1789130495.324759:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:3.0:1789130495.327128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.327290:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605191040 00000100:00100000:1.0:1789130495.327303:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605191040 00000100:00100000:1.0:1789130495.328980:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:1.0:1789130495.329007:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46988:x1876037605191040:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1789130495.329122:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329140:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329154:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329186:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329193:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329201:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329206:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130495.329210:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329217:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329228:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:1.0:1789130495.329231:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130495.329236:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.329241:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec5df lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130495.329348:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:46988:x1876037605191040:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 352us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130495.329359:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:3.0:1789130495.338450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.339271:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605191296 00000100:00100000:1.0:1789130495.339286:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605191296 00000100:00100000:1.0:1789130495.339359:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130495.339371:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:46988:x1876037605191296:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130495.339746:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:46988:x1876037605191296:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 376us (1311us total) trans 34359738548 rc 0/0 00000100:00100000:1.0:1789130495.339756:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1789130495.385990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.386040:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605191424 00000100:00100000:3.0:1789130495.386054:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605191424 00000100:00100000:3.0:1789130495.387794:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:3.0:1789130495.387811:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:46998:x1876037605191424:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130495.387845:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130495.387878:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca1d expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.387970:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.387989:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.388003:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.390285:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:3.0:1789130495.390296:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130495.390409:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.390459:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec5e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca1d expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.390479:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca1d expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.390490:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:3.0:1789130495.390493:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130495.390498:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:3.0:1789130495.390594:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:46998:x1876037605191424:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2786us (4614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130495.392053:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:3.0:1789130495.394742:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.396144:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605191680 00000100:00100000:3.0:1789130495.396161:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605191680 00000100:00100000:3.0:1789130495.396246:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:3.0:1789130495.396259:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:46998:x1876037605191680:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130495.396288:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130495.396319:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5f4 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca24 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.396488:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec5fb lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.396507:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec5fb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.396528:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec5fb lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.396542:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130495.396889:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec5f4 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca24 expref: 24 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.396911:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec5fb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca24 expref: 23 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.396922:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:3.0:1789130495.396925:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789130495.396929:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:3.0:1789130495.397767:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+23:46998:x1876037605191680:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1503us (3031us total) trans 34359738549 rc 0/0 00000100:00100000:3.0:1789130495.397778:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:3.0:1789130495.403228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130495.403675:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605191936 00000100:00100000:0.0:1789130495.403692:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605191936 00000100:00100000:0.0:1789130495.403773:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789130495.403786:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46998:x1876037605191936:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130495.404185:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130495.404190:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1789130495.404231:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cec5fb lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca24 expref: 23 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404255:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec5d1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca16 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404267:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b4909bdc00) 00010000:00010000:0.0:1789130495.404281:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130495.404301:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec609 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca2b expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404364:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404382:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404396:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404415:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404423:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404430:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404441:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130495.404446:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404455:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404465:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130495.404469:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130495.404474:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404481:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec610 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404511:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404518:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.404525:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.405210:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca2b expref: 24 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.405221:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130495.405224:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130495.405240:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec609 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca2b expref: 24 pid: 43679 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.405258:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca2b expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.405289:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130495.405292:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789130495.405294:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130495.405387:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46998:x1876037605191936:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1603us (2171us total) trans 34359738550 rc 0/0 00000100:00100000:0.0:1789130495.405397:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:3.0:1789130495.418314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130495.418549:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192064 00000100:00100000:2.0:1789130495.418808:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192064 00000100:00100000:2.0:1789130495.418917:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130495.418931:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:46998:x1876037605192064:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130495.418958:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130495.419218:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cec61e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca32 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130495.419260:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe6:0x0] initial LVB size: 15, mtime: 0x6aa3f6fb, atime: 0x6aa3f6fb, ctime: 0x6aa3f6fb, blocks: 0xb 00010000:00010000:2.0:1789130495.419291:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=1658s v=(0 0) 00010000:00010000:2.0:1789130495.419297:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130495.419310:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cec61e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca32 expref: 8 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.419334:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063034fee/0x5c74554e47cec61e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca32 expref: 8 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.419349:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0e00, rc 0) 00000100:00100000:2.0:1789130495.419436:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:46998:x1876037605192064:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 508us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130495.419445:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1789130495.424924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.425693:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192192 00000100:00100000:3.0:1789130495.425707:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192192 00002000:00100000:3.0:1789130495.425793:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe6:0x0] (0->4095) req@ffff90b386ef6580 x1876037605192192/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:211/0 lens 488/0 e 0 to 0 dl 1789130506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130495.425806:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ef6580 with x1876037605192192 ext(0->4095) 00002000:00010000:3.0:1789130495.425813:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386ef6580 00000100:00100000:3.0:1789130495.425849:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789130495.425860:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605192192:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130495.426407:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605192192:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 546us (1496us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130495.426418:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:3.0:1789130495.426425:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe6:0x0] (0->4095) req@ffff90b386ef6580 x1876037605192192/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:211/0 lens 488/4536 e 0 to 0 dl 1789130506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130495.426433:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ef6580 with x1876037605192192 ext(0->4095) 00002000:00010000:3.0:1789130495.426437:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386ef6580 00000100:00100000:3.0:1789130495.433489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130495.434259:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192448 00000100:00100000:0.0:1789130495.434272:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192448 00000100:00100000:0.0:1789130495.434341:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:0.0:1789130495.434353:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:46998:x1876037605192448:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130495.436488:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490c93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:46998:x1876037605192448:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 2121us (3000us total) trans 34359738551 rc 0/0 00000100:00100000:0.0:1789130495.436813:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789130495.507450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.507495:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192576 00000100:00100000:3.0:1789130495.507508:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192576 00000100:00100000:3.0:1789130495.507679:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:3.0:1789130495.507691:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+24:47008:x1876037605192576:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130495.507835:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.507859:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.507876:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.507901:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.507908:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.507920:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508321:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508331:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508340:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130495.508389:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508402:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508406:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508412:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508417:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.508420:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508425:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508436:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:3.0:1789130495.508439:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.508444:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508449:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec625 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508459:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508462:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508466:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508469:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.508471:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508476:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508483:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939f00) 00010000:00010000:3.0:1789130495.508486:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.508489:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508495:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec62c lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508513:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508521:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508527:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508532:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130495.508536:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508542:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508550:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130495.508552:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130495.508568:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.508576:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec633 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130495.508735:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+24:47008:x1876037605192576:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1044us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130495.508746:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:3.0:1789130495.546768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.546926:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192832 00000100:00100000:1.0:1789130495.546941:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192832 00000100:00100000:1.0:1789130495.547020:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130495.547034:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+24:44606:x1876037605192832:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789130495.547746:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:44606:x1876037605192832:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 712us (990us total) trans 34359738552 rc 0/0 00000100:00100000:1.0:1789130495.547757:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:0.0:1789130495.553724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.554210:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605192960 00000100:00100000:1.0:1789130495.554225:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605192960 00000100:00100000:1.0:1789130495.554314:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789130495.554328:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:44606:x1876037605192960:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130495.554349:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1789130495.554384:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec426 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9ad expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.554415:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48a1fd200) 00010000:00010000:1.0:1789130495.554437:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec473 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9c2 expref: 24 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.554448:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:1.0:1789130495.554456:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec617 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca2b expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.554465:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130495.554477:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cec5ed lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca1d expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.554489:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec442 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ac9b4 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.554497:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:1.0:1789130495.554502:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130495.555316:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:44606:x1876037605192960:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 985us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130495.555330:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789130495.620283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.620452:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605193088 00000100:00100000:3.0:1789130495.620468:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605193088 00000100:00100000:3.0:1789130495.620590:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:3.0:1789130495.620626:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:47021:x1876037605193088:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789130495.620665:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130495.620695:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec63a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca39 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.620782:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.620801:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.620816:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.621087:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130495.621091:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130495.621186:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.621334:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec63a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca39 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.621352:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca39 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.621360:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130495.621363:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130495.621367:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:3.0:1789130495.621448:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:47021:x1876037605193088:12345-192.168.201.39@tcp:101:cat.0 Request processed in 847us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130495.621456:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00010000:00010000:2.0:1789130495.621900:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130495.625579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.626218:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605193216 00000100:00100000:1.0:1789130495.626235:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605193216 00000100:00100000:1.0:1789130495.626322:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:1.0:1789130495.626336:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:47021:x1876037605193216:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130495.626365:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130495.626397:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca40 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626475:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626489:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626501:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626514:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626519:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.626523:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.628304:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.628328:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.628341:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130495.628451:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:1.0:1789130495.628455:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130495.628542:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.628557:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630518:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630528:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630536:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130495.630543:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630554:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630633:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130495.630637:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130495.630643:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630651:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec64f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630676:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630682:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630688:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630694:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130495.630698:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630703:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630710:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe25544b (ffff90b4909bdb00) 00010000:00010000:1.0:1789130495.630713:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130495.630716:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.630722:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec656 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe25544b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.631376:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cec648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca40 expref: 23 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.631393:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca40 expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.631399:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130495.631401:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789130495.631403:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ea00, rc 0) 00000100:00100000:1.0:1789130495.631510:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+22:47021:x1876037605193216:12345-192.168.201.39@tcp:101:cat.0 Request processed in 5176us (5946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130495.631522:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789130495.635754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130495.635840:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605193472 00000100:00100000:2.0:1789130495.635852:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605193472 00000100:00100000:2.0:1789130495.636071:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1789130495.636084:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:47021:x1876037605193472:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789130495.636126:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130495.636155:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec664 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca47 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636268:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636286:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636299:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636317:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636323:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636329:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636714:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636721:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636727:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130495.636735:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:2.0:1789130495.636852:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636861:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636868:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636875:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130495.636880:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636888:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636904:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130495.636908:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130495.636915:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636922:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec66b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636936:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636941:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636947:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636957:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130495.636960:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636966:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636974:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130495.636977:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130495.636980:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.636985:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec672 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.637040:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec664 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 25 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.637054:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 24 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130495.637062:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130495.637065:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130495.637067:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130495.637178:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:47021:x1876037605193472:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1096us (1438us total) trans 34359738553 rc 0/0 00000100:00100000:2.0:1789130495.637187:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1789130495.642459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130495.642926:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605193728 00000100:00100000:0.0:1789130495.642940:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605193728 00000100:00100000:0.0:1789130495.643013:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:0.0:1789130495.643027:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:47021:x1876037605193728:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789130495.644049:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:47021:x1876037605193728:12345-192.168.201.39@tcp:35:cat.0 Request processed in 1018us (1599us total) trans 34359738554 rc 0/0 00000100:00100000:0.0:1789130495.644074:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:0.0:1789130495.738017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.738229:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605193984 00000100:00100000:3.0:1789130495.738241:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605193984 00000100:00100000:3.0:1789130495.738310:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:3.0:1789130495.738325:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+25:47031:x1876037605193984:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130495.738363:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130495.738388:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca4e expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.738885:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec68e lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.738948:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec68e lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.738961:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec68e lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.738973:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00010000:00010000:3.0:1789130495.739250:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca4e expref: 28 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.739271:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec68e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca4e expref: 27 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.739282:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130495.739286:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130495.739290:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4200, rc 0) 00000100:00100000:3.0:1789130495.741407:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:47031:x1876037605193984:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3070us (3386us total) trans 34359738555 rc 0/0 00000100:00100000:3.0:1789130495.741424:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:0.0:1789130495.845372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130495.846268:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605194112 00000100:00100000:3.0:1789130495.846280:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605194112 00000100:00100000:3.0:1789130495.846336:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:3.0:1789130495.846347:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:47037:x1876037605194112:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130495.846371:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130495.846392:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec69c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca55 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.846740:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.846831:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.846844:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.847024:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x10:0x0]: returning size 7680 00000004:00200000:3.0:1789130495.847028:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130495.847120:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.847148:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec69c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca55 expref: 29 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.847850:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca55 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.847867:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130495.847871:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130495.847875:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:3.0:1789130495.847985:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:47037:x1876037605194112:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1638us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130495.847994:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00000001:00080000:1.0:1789130495.853542:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738381 is committed 00000001:00080000:1.0:1789130495.853562:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738380 is committed 00000001:00080000:1.0:1789130495.853572:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738382 is committed 00000100:00100000:2.0:1789130495.869025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130495.869333:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605194368 00000100:00100000:1.0:1789130495.869344:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605194368 00000100:00100000:1.0:1789130495.869409:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:1.0:1789130495.869435:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:47037:x1876037605194368:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130495.869456:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130495.869478:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec6aa lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca5c expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.869582:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.869598:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.869633:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.869670:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130495.869684:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 29 pid: 43679 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130495.869699:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626907520:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130495.871322:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130495.873458:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626907520:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130495.873487:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130495.886674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130495.887041:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605194496 00000100:00100000:0.0:1789130495.887063:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605194496 00010000:00010000:0.0:1789130495.887123:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 30 pid: 43679 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130495.887174:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1789130495.887186:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:2369:x1876037605194496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130495.887203:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130495.887210:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 30 pid: 43679 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887224:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 30 pid: 43679 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887246:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec679 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca47 expref: 30 pid: 43679 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887262:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130495.887267:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887278:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887290:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130495.887323:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130495.887386:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:2369:x1876037605194496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130495.887393:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00010000:00010000:3.0:1789130495.887566:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.887575:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130495.887595:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130495.887798:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cec6aa lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.887816:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 29 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130495.887824:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130495.887827:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130495.887829:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:3.0:1789130495.887858:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:47037:x1876037605194368:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 18441us (18845us total) trans 34359738556 rc 0/0 00000100:00100000:3.0:1789130495.887866:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:1.0:1789130496.053723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130496.064794:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605194624 00000100:00100000:0.0:1789130496.064810:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605194624 00000100:00100000:0.0:1789130496.064895:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:0.0:1789130496.064905:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47047:x1876037605194624:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130496.064982:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.064999:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.065013:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.065028:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.065035:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.065041:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.066557:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.066573:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.066584:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130496.071136:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071378:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071388:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071395:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071401:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130496.071407:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071424:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071442:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130496.071446:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130496.071451:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071458:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec6bf lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071478:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071485:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071491:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071496:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130496.071499:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071504:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071512:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b497c01f00) 00010000:00010000:0.0:1789130496.071515:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130496.071517:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071523:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec6c6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071544:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071550:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071555:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071561:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130496.071564:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071570:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071578:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130496.071580:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130496.071583:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.071588:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec6cd lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130496.071743:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47047:x1876037605194624:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 6834us (18026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.071754:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:2.0:1789130496.208448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130496.208597:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605194880 00000100:00100000:3.0:1789130496.208633:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605194880 00000100:00100000:3.0:1789130496.208701:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:3.0:1789130496.208713:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:47053:x1876037605194880:12345-192.168.201.39@tcp:101:multiop.0 00010000:00010000:3.0:1789130496.208734:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130496.208757:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6d4 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca63 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208832:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208846:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208857:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208873:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208881:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.208888:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209419:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec6e9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209433:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec6e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209440:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec6e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130496.209450:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130496.209541:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209549:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209556:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209562:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130496.209566:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209573:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209585:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130496.209588:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130496.209593:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209599:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec6db lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209643:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209649:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209656:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209661:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130496.209664:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209670:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209678:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939400) 00010000:00010000:3.0:1789130496.209681:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130496.209684:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209689:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6e2 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209737:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6d4 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca63 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209752:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec6e9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca63 expref: 31 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.209764:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130496.209766:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789130496.209769:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:3.0:1789130496.209841:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:47053:x1876037605194880:12345-192.168.201.39@tcp:101:multiop.0 Request processed in 1130us (1403us total) trans 34359738557 rc 0/0 00000100:00100000:3.0:1789130496.209849:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:2.0:1789130496.215886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130496.215979:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605195136 00000100:00100000:1.0:1789130496.215990:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605195136 00000100:00100000:1.0:1789130496.216050:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130496.216070:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:47053:x1876037605195136:12345-192.168.201.39@tcp:35:multiop.0 00000100:00100000:1.0:1789130496.216387:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:47053:x1876037605195136:12345-192.168.201.39@tcp:35:multiop.0 Request processed in 327us (510us total) trans 34359738558 rc 0/0 00000100:00100000:1.0:1789130496.216396:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789130496.263561:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626907648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130496.263656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130496.263851:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626907648 00000100:00100000:3.0:1789130496.263859:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626907648 00000100:00100000:3.0:1789130496.263916:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130496.263926:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626907648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130496.263962:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130496.264006:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626907648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130496.264014:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789130496.264084:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130496.264830:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626908032:0@lo:400:kworker.0 00000100:00100000:1.0:1789130496.264878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130496.264927:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130496.264934:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626908160:0@lo:400:kworker.0 00000100:00100000:1.0:1789130496.264959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130496.265073:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626907648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130496.265787:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908032 00000100:00100000:0.0:1789130496.265795:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908032 00000100:00100000:0.0:1789130496.265845:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908160 00000100:00100000:0.0:1789130496.265849:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908160 00000100:00100000:0.0:1789130496.265892:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130496.265902:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130496.265967:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626908032:12345-0@lo:400:kworker.0 Request processed in 67us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.265974:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130496.265989:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130496.265996:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626908160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130496.266023:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626908160:12345-0@lo:400:kworker.0 Request processed in 28us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.266028:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130496.266336:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626907776:0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.266378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130496.266422:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626908288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.266446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130496.266468:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130496.266474:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.266499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130496.266532:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626907904 00000100:00100000:3.0:1789130496.266536:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626907904 00000100:00100000:3.0:1789130496.266572:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130496.266579:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.266662:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626907904:12345-0@lo:400:kworker.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130496.266669:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130496.266702:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738382 gen 2 00000004:00080000:3.0:1789130496.266708:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738381 committed transno 34359738382 00000004:00080000:3.0:1789130496.266729:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386ef6d00, transno 34359738382 00000100:00100000:3.0:1789130496.266740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.267064:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908288 00000100:00100000:3.0:1789130496.267069:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908288 00000100:00100000:3.0:1789130496.270453:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130496.270472:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130496.270576:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626908288:12345-0@lo:400:kworker.0 Request processed in 111us (4128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130496.270583:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130496.270663:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626908288:0@lo:400:kworker.0 00000100:00100000:0.0:1789130496.270930:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626907776 00000100:00100000:0.0:1789130496.270937:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626907776 00000100:00100000:0.0:1789130496.270986:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789130496.270993:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626907776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130496.271033:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626907776:12345-0@lo:400:kworker.0 Request processed in 41us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.271039:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789130496.271087:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626907776:0@lo:400:kworker.0 00000100:00080000:1.0:1789130496.271278:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130496.271285:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130496.271312:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626908160:0@lo:400:kworker.0 00000100:00100000:1.0:1789130496.271326:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626908032:0@lo:400:kworker.0 00000100:00100000:2.0:1789130496.343734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130496.343867:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605195264 00000100:00100000:3.0:1789130496.343878:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605195264 00000100:00100000:3.0:1789130496.343946:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:3.0:1789130496.343956:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:47063:x1876037605195264:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130496.344035:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344054:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344076:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344511:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344521:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344529:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344853:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344863:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344870:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130496.344910:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344921:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344927:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344934:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344939:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130496.344944:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344951:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344962:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130496.344966:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130496.344970:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344977:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec6f7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344989:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.344995:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345000:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345005:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130496.345008:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345014:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345020:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b488939400) 00010000:00010000:3.0:1789130496.345022:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130496.345025:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345030:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec6fe lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345044:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345051:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345316:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345322:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130496.345325:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345331:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.345339:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130496.345341:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130496.345345:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.346254:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec705 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130496.346361:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:47063:x1876037605195264:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2404us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130496.346372:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789130496.450373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130496.450489:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605195520 00000100:00100000:1.0:1789130496.450500:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605195520 00000100:00100000:1.0:1789130496.450564:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:1.0:1789130496.450575:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:47070:x1876037605195520:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130496.450597:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130496.450658:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec70c lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca6a expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450736:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450755:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450767:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450782:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450790:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.450796:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451235:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec721 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451245:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec721 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451253:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec721 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130496.451263:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:1.0:1789130496.451357:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451366:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451372:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451378:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130496.451382:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451389:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451400:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130496.451403:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130496.451408:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451413:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec713 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451424:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451429:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451435:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451440:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130496.451443:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451450:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451462:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b4909bda00) 00010000:00010000:1.0:1789130496.451465:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130496.451468:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451473:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec71a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451514:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec70c lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca6a expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451527:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec721 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca6a expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.451534:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:1.0:1789130496.451536:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130496.451538:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130496.453225:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:47070:x1876037605195520:12345-192.168.201.39@tcp:101:cat.0 Request processed in 2513us (2723us total) trans 34359738559 rc 0/0 00000100:00100000:1.0:1789130496.453241:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:2.0:1789130496.457299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130496.457402:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605195776 00000100:00100000:1.0:1789130496.457414:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605195776 00000100:00100000:1.0:1789130496.457488:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:1.0:1789130496.457501:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:47070:x1876037605195776:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:1.0:1789130496.457911:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:47070:x1876037605195776:12345-192.168.201.39@tcp:35:cat.0 Request processed in 412us (625us total) trans 34359738560 rc 0/0 00000100:00100000:1.0:1789130496.457920:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130496.461522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130496.461672:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605195904 00000100:00100000:0.0:1789130496.461684:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605195904 00000100:00100000:0.0:1789130496.461786:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789130496.461811:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:2368:x1876037605195904:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130496.461839:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130496.461872:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec721 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca6a expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.461895:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130496.461902:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130496.461968:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:2368:x1876037605195904:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 160us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.461976:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1789130496.594793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130496.596308:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196032 00000100:00100000:1.0:1789130496.596326:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196032 00000100:00100000:1.0:1789130496.596406:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:1.0:1789130496.596418:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:47076:x1876037605196032:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130496.596443:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130496.596479:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec72f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca71 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596545:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596561:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596573:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596588:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596596:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.596631:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.597426:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.597439:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.597453:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 4/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.597485:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130496.597500:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 35 pid: 43680 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130496.597513:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626908416:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130496.597700:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130496.602517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130496.602591:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626908416:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130496.602639:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130496.604020:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196288 00000100:00100000:3.0:1789130496.604032:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196288 00000100:00100000:3.0:1789130496.604344:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789130496.604355:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:44606:x1876037605196288:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130496.604847:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:44606:x1876037605196288:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 246us (2091us total) trans 34359738561 rc 0/0 00000100:00100000:3.0:1789130496.604858:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130496.617167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130496.617303:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196416 00000100:00100000:0.0:1789130496.617314:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196416 00010000:00010000:0.0:1789130496.617357:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 37 pid: 43680 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130496.617402:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:0.0:1789130496.617411:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:2369:x1876037605196416:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130496.617425:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130496.617432:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 37 pid: 43680 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617444:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 37 pid: 43680 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617465:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec6b1 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca5c expref: 37 pid: 43680 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617480:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:0.0:1789130496.617485:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617494:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617502:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 4/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130496.617536:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130496.617592:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:2369:x1876037605196416:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 182us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130496.617630:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00010000:00010000:2.0:1789130496.618517:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618528:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130496.618571:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00000004:00200000:2.0:1789130496.618576:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130496.618596:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618640:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618649:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618655:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618662:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618668:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130496.618672:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618679:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618689:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130496.618692:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130496.618696:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618703:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec736 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618715:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618720:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618880:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618885:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130496.618888:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618899:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618907:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x5a11b149 (ffff90b4909bda00) 00010000:00010000:2.0:1789130496.618909:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130496.618912:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618917:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec73d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x5a11b149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618952:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec72f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618965:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 35 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.618971:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130496.618974:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130496.618976:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:2.0:1789130496.619029:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:47076:x1876037605196032:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 22613us (24246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130496.619036:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:2.0:1789130496.623918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130496.624040:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196672 00000100:00100000:3.0:1789130496.624161:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196672 00000100:00100000:3.0:1789130496.624223:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1789130496.624234:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:47076:x1876037605196672:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130496.624268:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130496.624289:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec74b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca78 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.624390:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.624405:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.624414:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.624445:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.624464:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 36 pid: 43679 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130496.624478:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626908544:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130496.624560:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130496.631328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130496.631514:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626908544:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130496.631544:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130496.636195:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196800 00000100:00100000:2.0:1789130496.636209:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196800 00010000:00010000:2.0:1789130496.636262:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 37 pid: 43679 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130496.636372:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130496.636383:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+37:2369:x1876037605196800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130496.636399:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130496.636406:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 37 pid: 43679 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636420:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 37 pid: 43679 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636441:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec744 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca71 expref: 37 pid: 43679 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636455:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:2.0:1789130496.636460:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636469:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636477:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130496.636510:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130496.636575:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:2369:x1876037605196800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 194us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130496.636583:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:3.0:1789130496.636692:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.636701:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130496.636740:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x14:0x0]: returning size 15 00010000:00010000:3.0:1789130496.636892:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec74b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca78 expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.636908:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca78 expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130496.636915:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:3.0:1789130496.636918:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130496.636920:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:3.0:1789130496.636948:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:47076:x1876037605196672:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 12717us (13040us total) trans 34359738562 rc 0/0 00000100:00100000:3.0:1789130496.636956:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00010000:00010000:3.0:1789130496.646310:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130497.669737:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130498.104052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130498.104106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130498.104110:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605196928 00000100:00100000:2.0:1789130498.104121:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605196928 00000100:00100000:1.0:1789130498.104144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130498.104176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130498.104184:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789130498.104196:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605196928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130498.104211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130498.104237:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197440 00000100:00100000:1.0:1789130498.104242:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197440 00000100:00100000:2.0:1789130498.104281:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605196928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130498.104288:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197056 00000100:00100000:2.0:1789130498.104290:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:1.0:1789130498.104294:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197056 00000100:00100000:1.0:1789130498.104328:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1789130498.104337:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605197440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130498.104375:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605197440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 39us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130498.104382:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1789130498.104397:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130498.104404:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:2367:x1876037605197056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130498.104431:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:2367:x1876037605197056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130498.104438:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130498.104461:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197184 00000100:00100000:1.0:1789130498.104465:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197184 00000100:00100000:1.0:1789130498.104502:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197312 00000100:00100000:1.0:1789130498.104505:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197312 00000100:00100000:1.0:1789130498.104526:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130498.104533:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605197184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130498.104559:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605197184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130498.104566:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789130498.104578:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789130498.104584:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605197312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130498.104640:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605197312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130498.104646:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00080000:1.0:1789130498.104664:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130498.104668:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130498.104671:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130498.702878:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130498.826574:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626908672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130498.826680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130498.826765:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908672 00000100:00100000:0.0:1789130498.826772:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908672 00000100:00100000:0.0:1789130498.826828:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789130498.826839:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626908672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130498.826875:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130498.826919:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626908672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130498.826926:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789130498.826946:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130498.826980:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626908672:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789130498.922730:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738554 is committed 00000001:00080000:0.0:1789130498.922768:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738560 is committed 00000020:00080000:0.0:1789130498.922805:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b383e28900 refcount 2 committed 0 result 0 batchid 30064771681 00000020:00080000:0.0:1789130498.922811:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b383e28840 00000020:00080000:0.0:1789130498.922815:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386d17400 00000001:00080000:0.0:1789130498.922844:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738562 is committed 00000020:00080000:0.0:1789130498.922870:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771680 batchid updated 00000004:00080000:0.0:1789130498.922878:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789130498.923290:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771681 committed batchid 30064771680 00000020:00080000:2.0:1789130498.923662:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771680 00000001:00080000:1.0:1789130499.482051:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738385 is committed 00000001:00080000:1.0:1789130499.482078:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738384 is committed 00010000:00010000:2.0:1789130499.718741:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130500.295161:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130500.295177:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130500.295225:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 5 count 5 00000040:00080000:0.0:1789130500.295233:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:3.0:1789130500.746197:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130501.382632:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626908800:0@lo:400:kworker.0 00000100:00100000:1.0:1789130501.382764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130501.382790:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626908928:0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.382829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130501.382852:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626909440:0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.382879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130501.382956:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626909312:0@lo:400:kworker.0 00000100:00100000:1.0:1789130501.382987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130501.383017:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908928 00000100:00100000:2.0:1789130501.383027:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908928 00000100:00100000:1.0:1789130501.383029:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909440 00000100:00100000:1.0:1789130501.383032:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909440 00000100:00100000:1.0:1789130501.383088:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909312 00000100:00100000:1.0:1789130501.383092:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909312 00000100:00100000:0.0:1789130501.383158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626909056:0@lo:400:kworker.0 00000100:00100000:0.0:1789130501.383190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130501.383214:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626909568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130501.383238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130501.383259:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130501.383265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626909184:0@lo:400:kworker.0 00000100:00100000:0.0:1789130501.383287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130501.383344:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626908800 00000100:00100000:3.0:1789130501.383349:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626908800 00000100:00100000:3.0:1789130501.383385:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789130501.383396:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626908800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130501.383459:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626908800:12345-0@lo:400:kworker.0 Request processed in 64us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130501.383476:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789130501.383537:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909184 00000100:00100000:3.0:1789130501.383541:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909184 00000100:00100000:3.0:1789130501.383559:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130501.383567:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626909440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130501.383628:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626909440:12345-0@lo:400:kworker.0 Request processed in 62us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130501.383636:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130501.383649:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130501.383655:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626909184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130501.383689:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626909184:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130501.383695:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130501.383751:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626909440:0@lo:400:kworker.0 00000100:00100000:3.0:1789130501.383790:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909568 00000100:00100000:3.0:1789130501.383794:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909568 00000100:00100000:2.0:1789130501.388446:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909056 00000100:00100000:2.0:1789130501.389810:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909056 00000100:00100000:2.0:1789130501.389907:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130501.389921:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626908928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.390064:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626908928:12345-0@lo:400:kworker.0 Request processed in 146us (7233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130501.390073:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130501.390092:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130501.390099:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626909056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.390584:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626909056:12345-0@lo:400:kworker.0 Request processed in 482us (7390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130501.390594:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130501.391216:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626908928:0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.391334:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626909184:0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.391346:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738385 gen 2 00000004:00080000:2.0:1789130501.391354:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386ea92c0, transno 34359738383 00000004:00080000:2.0:1789130501.391369:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738385 committed transno 34359738385 00000100:00100000:2.0:1789130501.391393:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626909056:0@lo:400:kworker.0 00000100:00100000:2.0:1789130501.392912:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626908800:0@lo:400:kworker.0 00000100:00100000:1.0:1789130501.399173:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130501.399195:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130501.399336:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626909312:12345-0@lo:400:kworker.0 Request processed in 147us (16347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130501.399344:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130501.399413:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626909312:0@lo:400:kworker.0 00000100:00080000:0.0:1789130501.401263:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130501.401277:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130501.401281:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130501.403967:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789130501.404020:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626909568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130501.404083:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130501.404229:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626909568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (20988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130501.406857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626909568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130501.417674:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789130501.765934:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130502.621375:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130502.621453:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197568 00000100:00100000:3.0:1789130502.621473:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197568 00000100:00100000:3.0:1789130502.621589:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:3.0:1789130502.621647:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605197568:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789130502.621818:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605197568:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 217us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130502.621827:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00080000:0.0:1789130502.627631:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130502.644325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130502.644385:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197824 00000100:00100000:2.0:1789130502.644399:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197824 00000100:00100000:2.0:1789130502.644479:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789130502.644496:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:46758:x1876037605197824:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130502.646911:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48546b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:46758:x1876037605197824:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2409us (2977us total) trans 34359738563 rc 0/0 00000100:00100000:2.0:1789130502.646927:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:3.0:1789130502.790102:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130502.931333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130502.938211:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605197952 00000100:00100000:3.0:1789130502.938231:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605197952 00000100:00100000:3.0:1789130502.938320:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1789130502.938332:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:47517:x1876037605197952:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:3.0:1789130502.938356:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130502.938381:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca7f expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130502.938464:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130502.938481:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130502.938500:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130502.939026:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130502.939042:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130502.939141:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130502.939173:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cec760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 7 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130502.939195:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 6 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130502.939204:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130502.939207:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130502.939211:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:2.0:1789130502.939308:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:47517:x1876037605197952:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 977us (7989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130502.939317:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00080000:0.0:1789130502.939541:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130503.197855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130503.198933:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198080 00000100:00100000:1.0:1789130503.198947:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198080 00000100:00100000:1.0:1789130503.199048:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:1.0:1789130503.199060:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605198080:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130503.199184:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388df3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605198080:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 125us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130503.199193:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:1.0:1789130503.205952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130503.206214:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198208 00000100:00100000:2.0:1789130503.206242:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198208 00000100:00100000:2.0:1789130503.206358:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789130503.206375:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605198208:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130503.206504:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605198208:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 133us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130503.206513:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00080000:0.0:1789130503.207771:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130503.212509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130503.212782:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198336 00000100:00100000:3.0:1789130503.212807:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198336 00000100:00100000:3.0:1789130503.212908:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789130503.212931:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605198336:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130503.213051:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605198336:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 133us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130503.213060:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00080000:0.0:1789130503.213563:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789130503.813851:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130503.942062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626909696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130503.942182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130503.942475:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909696 00000100:00100000:1.0:1789130503.942486:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909696 00000100:00100000:1.0:1789130503.942561:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130503.942573:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626909696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130503.942645:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130503.942709:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626909696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130503.942717:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789130503.942742:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130503.946054:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626909696:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789130504.036247:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738563 is committed 00000020:00080000:0.0:1789130504.036271:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771681 batchid updated 00000020:00080000:2.0:1789130504.036327:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771681 00000020:00080000:2.0:1789130504.036344:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771681 00010000:00010000:3.0:1789130504.838128:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130505.861932:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130506.502941:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626909824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130506.503038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.503225:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626910080:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.503259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.503318:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626910592:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.503347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.503376:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130506.503382:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626910208:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.503407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.503442:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626910592 00000100:00100000:0.0:1789130506.503453:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626910592 00000100:00100000:0.0:1789130506.503524:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130506.503540:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626910592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.503678:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626910592:12345-0@lo:400:kworker.0 Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130506.503686:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130506.503709:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626909952:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.503720:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626910080 00000100:00100000:0.0:1789130506.503726:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626910080 00000100:00100000:0.0:1789130506.503767:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626910208 00000100:00100000:0.0:1789130506.503772:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626910208 00000100:00100000:3.0:1789130506.503791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.503821:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130506.503834:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626910080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130506.503849:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626910464:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504037:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626910080:12345-0@lo:400:kworker.0 Request processed in 207us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130506.504045:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130506.504059:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130506.504067:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626910208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504099:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626910208:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130506.504106:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789130506.504124:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130506.504128:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130506.504130:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130506.504161:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626910208:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504174:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626910080:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504183:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626910592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130506.504386:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130506.504434:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130506.504442:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626910336:0@lo:400:kworker.0 00000100:00100000:3.0:1789130506.504472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130506.504736:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626910464 00000100:00100000:0.0:1789130506.504744:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626910464 00000100:00100000:0.0:1789130506.504797:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626910336 00000100:00100000:0.0:1789130506.504801:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626910336 00000100:00100000:0.0:1789130506.504819:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130506.504826:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626910464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504881:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626910464:12345-0@lo:400:kworker.0 Request processed in 55us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130506.504887:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130506.504901:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130506.504908:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626910336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.504947:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626910336:12345-0@lo:400:kworker.0 Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130506.504953:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789130506.504967:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130506.504992:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626910336:0@lo:400:kworker.0 00000100:00100000:0.0:1789130506.505003:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626910464:0@lo:400:kworker.0 00000100:00100000:2.0:1789130506.505353:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909824 00000100:00100000:2.0:1789130506.505359:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909824 00000100:00100000:2.0:1789130506.505441:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130506.505452:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626909824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130506.505484:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1789130506.505671:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626909824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130506.505679:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130506.505971:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a217e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626909824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130506.512259:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626909952 00000100:00100000:3.0:1789130506.512289:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626909952 00000100:00100000:3.0:1789130506.512370:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789130506.512382:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130506.512483:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626909952:12345-0@lo:400:kworker.0 Request processed in 103us (8692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130506.512491:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789130506.512516:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626909952:0@lo:400:kworker.0 00000001:02000400:1.0:1789130506.754546:0:46469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 16: Test detach with different options ========================================================== 08:41:44 (1789130504) 00010000:00010000:3.0:1789130506.887843:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130507.909978:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130508.331389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.331440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.331474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.331495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.331518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.331553:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198720 00000100:00100000:1.0:1789130508.331574:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198720 00000100:00100000:1.0:1789130508.331665:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198848 00000100:00100000:1.0:1789130508.331669:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198848 00000100:00100000:1.0:1789130508.331694:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130508.331706:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605198720:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130508.331801:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605198720:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 97us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.331808:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789130508.331829:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130508.331835:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605198848:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130508.331860:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b388e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605198848:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.331890:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1789130508.331966:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198464 00000100:00100000:3.0:1789130508.331971:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198464 00000100:00100000:3.0:1789130508.332012:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789130508.332021:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605198464:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130508.332051:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c2078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605198464:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130508.332057:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:0.0:1789130508.334980:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198976 00000100:00100000:0.0:1789130508.334994:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198976 00000100:00100000:0.0:1789130508.335051:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605198592 00000100:00100000:0.0:1789130508.335055:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605198592 00000100:00100000:0.0:1789130508.335101:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130508.335111:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605198976:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130508.335163:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789130508.335173:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605198592:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130508.335202:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605198976:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 93us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130508.335204:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605198592:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130508.335211:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00080000:3.0:1789130508.335847:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130508.335853:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130508.335856:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130508.340422:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789130508.702020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130508.702276:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605199104 00000100:00100000:3.0:1789130508.702288:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605199104 00000100:00100000:3.0:1789130508.702354:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:3.0:1789130508.702365:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:47776:x1876037605199104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130508.702388:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130508.702411:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec76e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca86 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702483:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702497:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702508:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702523:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702531:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.702537:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703044:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703055:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703063:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130508.703145:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789130508.703150:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130508.703228:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703239:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703245:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703252:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703257:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130508.703261:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703269:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703281:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130508.703284:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130508.703289:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703295:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703306:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703312:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703317:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703322:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130508.703324:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703329:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703336:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b488939300) 00010000:00010000:3.0:1789130508.703338:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130508.703341:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703350:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec77c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703385:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec76e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca86 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703399:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca86 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130508.703406:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130508.703407:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130508.703410:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4c00, rc 0) 00000100:00100000:3.0:1789130508.703758:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:47776:x1876037605199104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1393us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130508.703768:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:1.0:1789130508.711183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130508.711811:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605199360 00000100:00100000:2.0:1789130508.712125:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605199360 00000100:00100000:2.0:1789130508.712242:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:2.0:1789130508.712253:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:47776:x1876037605199360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130508.712574:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130508.712598:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec78a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca8d expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712837:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712852:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712953:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712972:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712979:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.712985:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.714264:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec79f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.714293:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec79f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.714303:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec79f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130508.714323:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789130508.715078:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715088:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715094:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715100:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130508.715105:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715111:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715124:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130508.715127:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130508.715131:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715137:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cec791 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715151:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715156:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715162:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715166:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130508.715169:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715173:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715179:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b48a1fd500) 00010000:00010000:2.0:1789130508.715181:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130508.715183:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.715188:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec798 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.717813:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec78a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca8d expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.717999:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec79f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca8d expref: 14 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130508.718010:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130508.718013:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130508.718016:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:2.0:1789130508.718144:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:47776:x1876037605199360:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5890us (6969us total) trans 34359738564 rc 0/0 00000100:00100000:2.0:1789130508.718154:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:0.0:1789130508.728391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.729103:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605199488 00000100:00100000:1.0:1789130508.729114:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605199488 00000100:00100000:1.0:1789130508.729177:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:1.0:1789130508.729188:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:47776:x1876037605199488:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789130508.729368:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:47776:x1876037605199488:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 182us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.729378:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:1.0:1789130508.871808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130508.872669:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605199744 00000100:00100000:0.0:1789130508.872685:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605199744 00000100:00100000:0.0:1789130508.872777:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:0.0:1789130508.872790:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:47791:x1876037605199744:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130508.872955:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130508.872961:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130508.872998:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca39 expref: 14 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.873024:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130508.873031:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130508.873048:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec7ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca94 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.874385:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.874422:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 5 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.874432:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.874485:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 5 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.874511:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 5 pid: 43681 timeout: 1771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130508.874532:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626910720:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130508.874677:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130508.883126:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626910720:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130508.883224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.883315:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605199872 00000100:00100000:1.0:1789130508.883324:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605199872 00010000:00010000:1.0:1789130508.883379:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 6 pid: 43681 timeout: 1771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.884001:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130508.884329:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789130508.884342:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605199872:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130508.884362:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130508.884370:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 6 pid: 43681 timeout: 1771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884386:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 6 pid: 43681 timeout: 1771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884421:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca7f expref: 6 pid: 43681 timeout: 1771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884436:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130508.884441:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884453:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884461:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.884495:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130508.884580:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605199872:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 241us (1358us total) trans 0 rc 0/0 00010000:00010000:0.0:1789130508.884580:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.884588:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130508.884589:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00010000:00010000:0.0:1789130508.887643:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.887675:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.887691:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130508.890348:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe6:0x0], index 0: 0 00010000:00010000:0.0:1789130508.890642:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893005:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893025:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893229:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893239:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893247:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893254:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130508.893258:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893266:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893279:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130508.893282:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130508.893287:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893293:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec7b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130508.893311:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000006fc609e reply state 00000000d5281816 transno 34359738565 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130508.893321:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789130508.893366:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec7ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 16 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893395:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 15 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130508.893403:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130508.893405:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130508.893408:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130508.893500:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+16:47791:x1876037605199744:12345-192.168.201.39@tcp:101:bash.0 Request processed in 20712us (21707us total) trans 34359738565 rc 0/0 00000100:00100000:0.0:1789130508.893510:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00010000:00010000:1.0:1789130508.897897:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897916:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897925:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897937:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130508.897944:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897954:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897974:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b497c01d00) 00010000:00010000:1.0:1789130508.897977:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130508.897981:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.897987:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec7bb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130508.902598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.902957:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200000 00000100:00100000:1.0:1789130508.902974:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200000 00000100:00100000:1.0:1789130508.903049:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1789130508.903060:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605200000:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130508.903079:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130508.903225:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aca9b expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130508.903253:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130508.903275:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=1671s v=(0 0) 00010000:00010000:1.0:1789130508.903280:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130508.903290:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.903316:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.903329:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130508.903441:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605200000:12345-192.168.201.39@tcp:101:bash.0 Request processed in 383us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.903450:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789130508.919044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130508.919846:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200128 00000100:00100000:0.0:1789130508.919862:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200128 00000100:00100000:1.0:1789130508.920098:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789130508.920123:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:47791:x1876037605200128:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130508.920158:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130508.920191:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acaa2 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.920235:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.920246:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789130508.920252:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130508.920257:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.920306:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.920330:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 1772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130508.920348:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389408f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626910848:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130508.921037:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130508.931689:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389408f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626910848:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130508.931746:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 7 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.931775:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e200, rc 0) 00000100:00100000:1.0:1789130508.931982:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:47791:x1876037605200128:12345-192.168.201.39@tcp:101:bash.0 Request processed in 11871us (12952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.931993:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1789130508.933902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.934016:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200256 00000100:00100000:1.0:1789130508.934030:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200256 00010000:00010000:1.0:1789130508.934082:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 1772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130508.934267:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789130508.934280:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605200256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130508.934301:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130508.934334:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 1772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.934357:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 1772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.934385:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063b445c9/0x5c74554e47cec7d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca9b expref: 7 pid: 44793 timeout: 1772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.934407:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130508.934424:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130508.934435:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.934455:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.934506:0:45795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130508.934523:0:45795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389408f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:45795:1876037626910976:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130508.934665:0:45795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130508.939470:0:45795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389408f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:45795:1876037626910976:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130508.939514:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130508.939629:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605200256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 5327us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.939647:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789130508.939927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789130508.940888:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130508.941455:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200512 00000100:00100000:3.0:1789130508.941475:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200512 00000100:00100000:3.0:1789130508.941593:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789130508.941621:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:47791:x1876037605200512:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789130508.944676:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:47791:x1876037605200512:12345-192.168.201.39@tcp:35:bash.0 Request processed in 3057us (4734us total) trans 34359738566 rc 0/0 00000100:00100000:3.0:1789130508.944693:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789130508.990539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130508.990640:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200640 00000100:00100000:1.0:1789130508.990653:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200640 00000100:00100000:1.0:1789130508.990734:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:1.0:1789130508.990747:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:47794:x1876037605200640:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130508.990783:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130508.991074:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec7de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acaa9 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991176:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991193:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991206:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130508.991287:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130508.991292:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130508.991320:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991349:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec7de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa9 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991372:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa9 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130508.991382:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd800) 00010000:00010000:1.0:1789130508.991385:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130508.991390:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ee00, rc 0) 00000100:00100000:1.0:1789130508.992210:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:47794:x1876037605200640:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1461us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130508.992222:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:2.0:1789130509.063540:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626911104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130509.063660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130509.063814:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626911104 00000100:00100000:0.0:1789130509.063825:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626911104 00000100:00100000:0.0:1789130509.063944:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130509.063954:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626911104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130509.064000:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130509.064052:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626911104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.064058:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130509.064105:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626911104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789130509.070321:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789130509.201028:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738565 is committed 00000001:00080000:0.0:1789130509.201056:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738566 is committed 00000100:00100000:0.0:1789130509.224843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130509.225102:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605200896 00000100:00100000:3.0:1789130509.225113:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605200896 00000100:00100000:3.0:1789130509.227032:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:3.0:1789130509.227050:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:47810:x1876037605200896:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130509.227073:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130509.227096:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acab0 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.227195:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec7f3 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.227210:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec7f3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.227221:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec7f3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130509.227231:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:2.0:1789130509.233229:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab0 expref: 17 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.233260:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec7f3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab0 expref: 16 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.233286:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130509.233289:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130509.233294:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:2.0:1789130509.233508:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:47810:x1876037605200896:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 6463us (8671us total) trans 34359738567 rc 0/0 00000100:00100000:2.0:1789130509.233517:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:1.0:1789130509.249473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.249976:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201024 00000100:00100000:2.0:1789130509.249986:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201024 00000100:00100000:0.0:1789130509.250189:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789130509.250204:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:2370:x1876037605201024:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130509.250221:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130509.250247:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec7f3 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab0 expref: 16 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.250265:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130509.250279:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130509.250344:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:2370:x1876037605201024:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 144us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.250352:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789130509.281086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130509.281300:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201280 00000100:00100000:1.0:1789130509.281313:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201280 00000100:00100000:1.0:1789130509.281399:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:1.0:1789130509.281412:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:47810:x1876037605201280:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130509.281445:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130509.281475:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec801 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acab7 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.281985:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.282004:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.282018:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130509.282034:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:1.0:1789130509.282424:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec801 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab7 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.282447:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab7 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.282464:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:1.0:1789130509.282467:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130509.282471:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f800, rc 0) 00000100:00100000:1.0:1789130509.282861:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:47810:x1876037605201280:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1450us (1789us total) trans 34359738568 rc 0/0 00000100:00100000:1.0:1789130509.283115:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:3.0:1789130509.296576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.297653:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201408 00000100:00100000:2.0:1789130509.297672:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201408 00000100:00100000:2.0:1789130509.297770:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1789130509.297783:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605201408:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130509.297857:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.297898:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.297909:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130509.297914:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130509.297920:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.297964:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.297987:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 6 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130509.298003:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626911232:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130509.298382:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130509.303385:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626911232:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130509.303431:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130509.305097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.307176:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201536 00000100:00100000:2.0:1789130509.307196:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201536 00002000:00100000:2.0:1789130509.307283:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe6:0x0] (0->10) req@ffff90b394c48f00 x1876037605201536/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:225/0 lens 504/0 e 0 to 0 dl 1789130520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130509.307296:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b394c48f00 with x1876037605201536 ext(0->10) 00010000:00010000:2.0:1789130509.307308:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 7 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.307347:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 7 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130509.307357:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b394c48f00 00000100:00100000:2.0:1789130509.307405:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1789130509.307416:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605201536:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789130509.308244:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605201536:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 824us (3149us total) trans 34359738383 rc 0/0 00000100:00100000:2.0:1789130509.308257:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:2.0:1789130509.308266:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe6:0x0] (0->10) req@ffff90b394c48f00 x1876037605201536/t34359738383(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:225/0 lens 504/448 e 0 to 0 dl 1789130520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130509.308276:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b394c48f00 with x1876037605201536 ext(0->10) 00010000:00010000:2.0:1789130509.308284:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.308301:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130509.308310:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b394c48f00 00000100:00100000:3.0:1789130509.314028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.314133:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201664 00000100:00100000:2.0:1789130509.314147:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201664 00010000:00010000:2.0:1789130509.314210:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130509.314507:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789130509.314521:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605201664:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130509.314543:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789130509.314570:0:43665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe6:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:2.0:1789130509.314573:0:43665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe6:0x0] updating lvb mtime from disk: 0 -> 1789130508 00002000:00010000:2.0:1789130509.314576:0:43665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe6:0x0] updating lvb atime from disk: 0 -> 1789130509 00002000:00010000:2.0:1789130509.314578:0:43665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe6:0x0] updating lvb ctime from disk: 0 -> 1789130508 00010000:00010000:2.0:1789130509.314586:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.314632:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.314660:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001be8b779/0x5c74554e47cec7d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa2 expref: 9 pid: 44367 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.314682:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130509.314687:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130509.314693:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.314703:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.314760:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130509.314837:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605201664:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 319us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130509.314844:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:3.0:1789130509.314924:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.314935:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.314965:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.314975:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.314984:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.314993:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130509.314998:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.315007:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.315022:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.315029:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cec816 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130509.315088:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605201408:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 17309us (18528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130509.315098:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130509.320182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.321570:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605201920 00000100:00100000:0.0:1789130509.321588:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605201920 00000100:00100000:0.0:1789130509.321695:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130509.321708:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:47810:x1876037605201920:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789130509.321831:0:43682:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x17:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab7 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130509.322200:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738569 00000001:00080000:0.0:1789130509.322251:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738570 00000001:00080000:0.0:1789130509.332995:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738571 00010000:00010000:0.0:1789130509.333291:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.333319:0:43682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.333457:0:43682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.333584:0:43682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.333687:0:43682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 21 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.333705:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626911360:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130509.333882:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130509.342316:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626911360:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130509.342361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789130509.342375:0:43682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.342732:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202048 00000100:00100000:0.0:1789130509.342742:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202048 00010000:00010000:0.0:1789130509.342791:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 22 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.342852:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789130509.342874:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389409680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+22:2370:x1876037605202048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130509.342896:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130509.342904:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 22 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.342924:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 22 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.342951:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec7c2 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aca94 expref: 22 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.342970:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130509.342975:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.342986:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.342996:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.343020:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130509.343082:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389409680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:2370:x1876037605202048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.343091:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00010000:00010000:3.0:1789130509.343695:0:43682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.343707:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130509.343897:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738572 00000001:00080000:3.0:1789130509.345157:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738573 00000100:00100000:3.0:1789130509.345316:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626911488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130509.345417:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130509.345471:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49106bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130509.346152:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626911488 00000100:00100000:0.0:1789130509.346163:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626911488 00000100:00100000:0.0:1789130509.346230:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130509.346241:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626911488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130509.346359:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626911488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.346367:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130509.347058:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626911488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130509.356196:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738574 00000100:00100000:2.0:1789130509.356360:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626911616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789130509.356454:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130509.356506:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130509.356549:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626911616 00000100:00100000:0.0:1789130509.356560:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626911616 00000100:00100000:0.0:1789130509.356650:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130509.356663:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626911616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130509.356933:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43682:x1876037626911616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 271us (477us total) trans 34359738384 rc 0/0 00000100:00100000:0.0:1789130509.356942:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130509.359133:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626911616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789130509.359276:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738575 00010000:00010000:2.0:1789130509.359360:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359373:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359381:0:43682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359389:0:43682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130509.359393:0:43682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359403:0:43682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359421:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130509.359424:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130509.359430:0:43682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.359437:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec81d lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130509.359943:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x18:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130509.360095:0:43682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].7, 64 off8664 00000004:00080000:2.0:1789130509.360109:0:43682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1672457505850ns, next at 1673457502977ns, rc = 0 00000001:00080000:2.0:1789130509.360117:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738576 00010000:00010000:2.0:1789130509.360163:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130509.360166:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130509.360176:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec808 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acab7 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130509.360328:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:47810:x1876037605201920:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 38621us (40163us total) trans 34359738577 rc 0/0 00000100:00100000:2.0:1789130509.360339:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000020:00080000:2.0:1789130509.360346:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789130509.370813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.370950:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202176 00000100:00100000:0.0:1789130509.370963:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202176 00000100:00100000:0.0:1789130509.371056:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:0.0:1789130509.371068:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3894083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:47810:x1876037605202176:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130509.371102:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130509.371149:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec824 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acabe expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.371261:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec824 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acabe expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.371279:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec824 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acabe expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.371302:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130509.371305:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130509.371310:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130509.371599:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3894083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+25:47810:x1876037605202176:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 531us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.371661:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:0.0:1789130509.379180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130509.379368:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202432 00000100:00100000:3.0:1789130509.379382:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202432 00000100:00100000:3.0:1789130509.379524:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:3.0:1789130509.379537:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:47810:x1876037605202432:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789130509.379936:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:47810:x1876037605202432:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 401us (773us total) trans 34359738578 rc 0/0 00000100:00100000:3.0:1789130509.379944:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000040:00080000:0.0:1789130509.511107:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130509.511122:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130509.511174:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 5 count 5 00000040:00080000:0.0:1789130509.511183:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130509.544065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.544265:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202560 00000100:00100000:0.0:1789130509.544279:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202560 00000100:00100000:0.0:1789130509.544357:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:0.0:1789130509.544369:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:47820:x1876037605202560:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130509.544492:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.544524:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.544539:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.544560:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.544568:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.544575:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545685:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545701:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545711:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130509.545767:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545783:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545794:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545802:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545809:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130509.545813:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545821:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545835:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd800) 00010000:00010000:0.0:1789130509.545839:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130509.545845:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545851:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec82b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545875:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545881:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545887:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545891:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130509.545895:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545901:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.545908:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b497c01a00) 00010000:00010000:0.0:1789130509.547455:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130509.547469:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547481:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547589:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547596:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547622:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547627:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130509.547632:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547638:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547652:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130509.547654:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130509.547659:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.547664:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec839 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.548991:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:47820:x1876037605202560:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 4608us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.549006:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:1.0:1789130509.618689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.618982:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202816 00000100:00100000:0.0:1789130509.618991:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202816 00000100:00100000:0.0:1789130509.619046:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1789130509.619054:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:47823:x1876037605202816:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130509.619071:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130509.619089:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acac5 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619153:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619166:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619179:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619194:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619202:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.619212:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.621537:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.621555:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.621566:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130509.621577:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:2.0:1789130509.622129:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622209:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622216:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622222:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130509.622226:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622233:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622250:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd800) 00010000:00010000:2.0:1789130509.622253:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130509.622258:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622265:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622473:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622480:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622486:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622491:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130509.622494:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622500:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622508:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b497c01a00) 00010000:00010000:2.0:1789130509.622511:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130509.622514:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622519:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cec84e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622571:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 29 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622585:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.622593:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130509.622595:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130509.622598:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130509.622874:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:47823:x1876037605202816:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3817us (4191us total) trans 34359738579 rc 0/0 00000100:00100000:2.0:1789130509.622884:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:1.0:1789130509.625853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.626788:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605202944 00000100:00100000:2.0:1789130509.626800:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605202944 00000100:00100000:2.0:1789130509.627100:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:2.0:1789130509.627111:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:47823:x1876037605202944:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:2.0:1789130509.627185:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627205:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627218:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627247:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627258:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627266:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627272:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130509.627350:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627358:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627371:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130509.627374:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130509.627582:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.627590:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec863 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130509.627902:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:47823:x1876037605202944:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 791us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130509.627911:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:0.0:1789130509.630150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.630223:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605203200 00000100:00100000:2.0:1789130509.630231:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605203200 00000100:00100000:2.0:1789130509.630295:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130509.630305:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:47823:x1876037605203200:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130509.630683:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47823:x1876037605203200:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 379us (539us total) trans 34359738580 rc 0/0 00000100:00100000:2.0:1789130509.630691:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:1.0:1789130509.760373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.760522:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605203456 00000100:00100000:2.0:1789130509.760533:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605203456 00000100:00100000:2.0:1789130509.760645:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1789130509.760655:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47833:x1876037605203456:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130509.760686:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130509.760712:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec86a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acacc expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.761326:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec871 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.761343:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec871 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.761354:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec871 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130509.761365:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:2.0:1789130509.761529:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec86a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acacc expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.761547:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec871 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acacc expref: 31 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.761554:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130509.761556:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130509.761560:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130509.761711:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:47833:x1876037605203456:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1058us (1351us total) trans 34359738581 rc 0/0 00000100:00100000:2.0:1789130509.761719:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:1.0:1789130509.763967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130509.764033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130509.764089:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605203840 00000100:00100000:2.0:1789130509.764095:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605203584 00000100:00100000:3.0:1789130509.764102:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605203840 00000100:00100000:2.0:1789130509.764102:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605203584 00000100:00100000:3.0:1789130509.764173:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789130509.764184:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:47833:x1876037605203840:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130509.764262:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789130509.764271:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:2369:x1876037605203584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130509.764283:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130509.764314:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec871 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acacc expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.764335:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130509.764341:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130509.764447:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:2369:x1876037605203584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 177us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130509.764456:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789130509.764489:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:47833:x1876037605203840:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 306us (452us total) trans 34359738582 rc 0/0 00000100:00100000:3.0:1789130509.764497:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789130509.843105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130509.843238:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605204096 00000100:00100000:3.0:1789130509.843252:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605204096 00000100:00100000:3.0:1789130509.843453:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:3.0:1789130509.843467:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:47846:x1876037605204096:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130509.843501:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130509.843530:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec87f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acad3 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.843720:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec886 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.843738:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec886 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.843753:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec886 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130509.843768:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:3.0:1789130509.843965:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec87f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acad3 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.843986:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec886 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acad3 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.843997:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130509.844000:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789130509.844004:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5600, rc 0) 00000100:00100000:3.0:1789130509.844082:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:47846:x1876037605204096:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 618us (993us total) trans 34359738583 rc 0/0 00000100:00100000:3.0:1789130509.844090:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:1.0:1789130509.850451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.850655:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605204224 00000100:00100000:0.0:1789130509.850670:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605204224 00000100:00100000:0.0:1789130509.850737:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:0.0:1789130509.850749:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:47846:x1876037605204224:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1789130509.850962:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.850985:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.850999:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851032:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851040:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851049:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851060:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130509.851066:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851076:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851090:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130509.851093:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130509.851100:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130509.851106:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cec894 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.851251:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:47846:x1876037605204224:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 502us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130509.851262:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:0.0:1789130509.898505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.898649:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605204480 00000100:00100000:2.0:1789130509.898662:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605204480 00000100:00100000:2.0:1789130509.898757:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:2.0:1789130509.898767:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:47856:x1876037605204480:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130509.898804:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130509.898834:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acada expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.898977:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.898996:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.899004:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.899040:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.899051:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 34 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130509.899064:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626911744:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130509.899171:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130509.901174:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626911744:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130509.901213:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130509.902033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130509.902545:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605204608 00000100:00100000:1.0:1789130509.902556:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605204608 00010000:00010000:1.0:1789130509.902599:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 35 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130509.902683:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789130509.902692:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:2369:x1876037605204608:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130509.902707:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130509.902713:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 35 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902727:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 35 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902751:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cec855 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acac5 expref: 35 pid: 45555 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902766:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130509.902770:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902778:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902785:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.902818:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130509.902898:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:2369:x1876037605204608:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 205us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130509.902907:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00010000:00010000:2.0:1789130509.902995:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.903001:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130509.903021:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:2.0:1789130509.903195:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 35 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.903213:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.903218:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130509.903221:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789130509.903223:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130509.903246:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:47856:x1876037605204480:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 4482us (4758us total) trans 34359738584 rc 0/0 00000100:00100000:2.0:1789130509.903252:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:1.0:1789130509.905454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130509.905522:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605204992 00000100:00100000:0.0:1789130509.905534:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605204992 00000100:00100000:0.0:1789130509.905597:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789130509.905635:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:47856:x1876037605204992:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130509.905937:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:47856:x1876037605204992:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 303us (492us total) trans 34359738585 rc 0/0 00000100:00100000:0.0:1789130509.905945:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789130509.909462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130509.909550:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205120 00000100:00100000:1.0:1789130509.909562:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205120 00000100:00100000:1.0:1789130509.909661:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789130509.909672:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:47856:x1876037605205120:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130509.909692:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130509.909723:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec886 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acad3 expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.909749:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cec824 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acabe expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130509.909759:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130509.909766:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130509.909842:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:47856:x1876037605205120:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 172us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130509.909850:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789130509.912090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130509.912141:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205248 00000100:00100000:2.0:1789130509.912151:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205248 00000100:00100000:2.0:1789130509.912229:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:2.0:1789130509.912237:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389409680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:47856:x1876037605205248:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:2.0:1789130509.912371:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.912390:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130509.912403:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130509.912822:0:43679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].5, 136 off8872 00000100:00100000:2.0:1789130509.913093:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389409680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:47856:x1876037605205248:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 854us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130509.913102:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:0.0:1789130509.914564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130509.914649:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205376 00000100:00100000:3.0:1789130509.914660:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205376 00000100:00100000:3.0:1789130509.914722:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:3.0:1789130509.914733:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:47856:x1876037605205376:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130509.914758:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130509.914784:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acae1 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914887:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914900:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914923:0:43680:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914937:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914949:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130509.914951:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130509.914954:0:43680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130509.914964:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789130509.915015:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:47856:x1876037605205376:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 284us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130509.915023:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00010000:00010000:2.0:1789130509.958519:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130510.534323:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130510.534338:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130510.534386:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 6 count 6 00000040:00080000:0.0:1789130510.534396:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:0.0:1789130510.536000:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626911872:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130510.536164:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130510.557557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.557561:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b381fd8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626911872:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130510.559007:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205504 00000100:00100000:3.0:1789130510.559025:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205504 00000100:00100000:3.0:1789130510.559196:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:3.0:1789130510.559210:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:47857:x1876037605205504:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130510.559260:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130510.559430:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:47857:x1876037605205504:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 222us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130510.559439:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00080000:0.0:1789130510.563334:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130510.568379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.568458:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205632 00000100:00100000:2.0:1789130510.568473:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205632 00000100:00100000:2.0:1789130510.568560:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:2.0:1789130510.568572:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:47857:x1876037605205632:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789130510.568697:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.568719:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.568732:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.568750:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.568757:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.568764:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570062:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570086:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570098:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130510.570154:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00000004:00200000:2.0:1789130510.570161:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130510.570178:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570192:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570199:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570207:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570215:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130510.570220:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570228:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570243:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130510.570246:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130510.570720:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570732:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec8be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570756:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570763:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.570782:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571000:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130510.571006:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571013:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571026:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2ddc837e (ffff90b48a1fd500) 00010000:00010000:2.0:1789130510.571029:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130510.571031:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571037:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2ddc837e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571058:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571064:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571070:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571074:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130510.571076:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571085:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571092:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130510.571094:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130510.571097:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.571102:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8cc lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.571236:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:47857:x1876037605205632:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 2661us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130510.571250:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:1.0:1789130510.583977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.584123:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605205888 00000100:00100000:0.0:1789130510.584146:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605205888 00000100:00100000:0.0:1789130510.584226:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:0.0:1789130510.584238:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:47857:x1876037605205888:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130510.584265:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130510.584295:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec8d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acae8 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.584653:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.584673:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.584687:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130510.584700:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:1.0:1789130510.587585:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587629:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587638:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587645:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.587650:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587659:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587681:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130510.587685:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130510.587693:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587700:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec8da lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587791:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec8d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae8 expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587804:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130510.587807:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130510.587811:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cec8d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae8 expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.587823:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:1.0:1789130510.587938:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605205888:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3701us (3975us total) trans 34359738586 rc 301/301 00000100:00100000:1.0:1789130510.587948:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:1.0:1789130510.592485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.592577:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605206016 00000100:00100000:3.0:1789130510.592590:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605206016 00000100:00100000:3.0:1789130510.592710:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 246 00000100:00100000:3.0:1789130510.592721:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605206016:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130510.592770:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130510.592900:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605206016:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 179us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130510.592909:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 246 00000100:00100000:1.0:1789130510.606441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.606548:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605206272 00000100:00100000:2.0:1789130510.606563:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605206272 00000100:00100000:2.0:1789130510.606681:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:2.0:1789130510.606691:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3894092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605206272:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130510.606711:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130510.606714:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130510.606738:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec7e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaa9 expref: 35 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.606758:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd800) 00010000:00010000:2.0:1789130510.606769:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130510.606784:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acaef expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130510.607824:0:43679:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe7:0x0], index 1: 0 00010000:00010000:2.0:1789130510.608033:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8ef lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.608048:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.608059:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.608112:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec8e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaef expref: 37 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.608133:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaef expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.608141:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:2.0:1789130510.608144:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130510.608147:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0a00, rc 0) 00000100:00100000:2.0:1789130510.608228:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3894092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+36:47857:x1876037605206272:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1537us (1803us total) trans 34359738587 rc 0/0 00000100:00100000:2.0:1789130510.608236:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 247 00000100:00100000:1.0:1789130510.620559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.621070:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605206400 00000100:00100000:2.0:1789130510.621081:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605206400 00000100:00100000:3.0:1789130510.621174:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:3.0:1789130510.621187:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:47857:x1876037605206400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130510.621215:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130510.621237:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec8fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acaf6 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.621442:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.621459:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.621471:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130510.623104:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130510.623113:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130510.623226:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.623262:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec8fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaf6 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.623449:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaf6 expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.623459:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939300) 00010000:00010000:3.0:1789130510.623462:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130510.623466:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5a00, rc 0) 00000100:00100000:3.0:1789130510.623596:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:47857:x1876037605206400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2410us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130510.623642:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 248 00000100:00100000:3.0:1789130510.633902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.634431:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605206656 00000100:00100000:1.0:1789130510.634440:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605206656 00000100:00100000:1.0:1789130510.634499:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 249 00000100:00100000:1.0:1789130510.634509:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+37:47857:x1876037605206656:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130510.634565:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130510.634591:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec8ef lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaef expref: 37 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634644:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd400) 00010000:00010000:1.0:1789130510.634664:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec904 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acaf6 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634674:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939300) 00010000:00010000:1.0:1789130510.634683:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130510.634706:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634719:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634731:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634744:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634751:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.634758:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635255:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635264:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635732:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635737:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.635742:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635749:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635758:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130510.635760:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130510.635764:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635769:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec90b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635781:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635787:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635792:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635797:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.635799:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635809:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635816:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb704e990 (ffff90b4909bde00) 00010000:00010000:1.0:1789130510.635817:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130510.635820:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.635824:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47cec912 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb704e990 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.636201:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605206656:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1691us (2306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130510.636211:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 249 00000100:00100000:0.0:1789130510.640349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.640713:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605206784 00000100:00100000:2.0:1789130510.640725:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605206784 00000100:00100000:2.0:1789130510.640789:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 250 00000100:00100000:2.0:1789130510.640798:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:47857:x1876037605206784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130510.640819:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130510.640985:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec919 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acafd expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641023:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641036:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641047:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641151:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec919 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641171:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.641180:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130510.641183:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130510.641187:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0600, rc 0) 00000100:00100000:2.0:1789130510.641298:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:47857:x1876037605206784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 500us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130510.641305:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 250 00000100:00100000:0.0:1789130510.655895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.657012:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207040 00000100:00100000:2.0:1789130510.657029:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207040 00000100:00100000:2.0:1789130510.657102:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 251 00000100:00100000:2.0:1789130510.657113:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+36:47857:x1876037605207040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789130510.657200:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.657218:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.657230:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130510.658832:0:43679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].7, 88 off8712 00000004:00080000:2.0:1789130510.658868:0:43679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1673756264964ns, next at 1674756261422ns, rc = 0 00000004:00010000:2.0:1789130510.658991:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007ca1353d reply state 000000006f75e40e transno 34359738588 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.659003:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130510.659130:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:47857:x1876037605207040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2016us (3241us total) trans 34359738588 rc 0/0 00000100:00100000:2.0:1789130510.659140:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 251 00010000:00010000:0.0:1789130510.660970:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.660986:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.660993:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.660999:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.661003:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.661010:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.661026:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130510.661029:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130510.661034:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.661039:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec927 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.662483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.662589:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207168 00000100:00100000:3.0:1789130510.662633:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207168 00000100:00100000:3.0:1789130510.662695:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:3.0:1789130510.662705:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:47857:x1876037605207168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130510.662730:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130510.662750:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb04 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.662806:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.662820:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.662855:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:3.0:1789130510.662859:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130510.662863:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:3.0:1789130510.662910:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:47857:x1876037605207168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 207us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130510.662918:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 252 00000100:00100000:2.0:1789130510.671564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.671629:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207296 00000100:00100000:0.0:1789130510.671645:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207296 00000100:00080000:1.0:1789130510.671695:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130510.671728:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:0.0:1789130510.671741:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605207296:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789130510.672119:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605207296:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 381us (563us total) trans 34359738386 rc 0/0 00000100:00100000:0.0:1789130510.672132:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:0.0:1789130510.674115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.674173:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207552 00000100:00100000:3.0:1789130510.674182:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207552 00000100:00100000:3.0:1789130510.674219:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789130510.674225:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:47857:x1876037605207552:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130510.674417:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:47857:x1876037605207552:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 192us (311us total) trans 34359738589 rc 0/0 00000100:00100000:3.0:1789130510.674423:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1789130510.678848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.678914:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207808 00000100:00100000:0.0:1789130510.678924:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207808 00000100:00100000:0.0:1789130510.678984:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:0.0:1789130510.678998:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38940b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+39:47857:x1876037605207808:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130510.679107:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38940b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+39:47857:x1876037605207808:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 115us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.679113:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 253 00000100:00100000:2.0:1789130510.687262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.687441:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605207936 00000100:00100000:3.0:1789130510.687450:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605207936 00000100:00100000:3.0:1789130510.687510:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 254 00000100:00100000:3.0:1789130510.687520:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:47857:x1876037605207936:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130510.687540:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130510.687563:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec935 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb0b expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.687669:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.687686:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.687700:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130510.687777:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130510.687801:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.687833:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cec935 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb0b expref: 41 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.687865:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb0b expref: 40 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.687874:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130510.687877:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789130510.687881:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5600, rc 0) 00000100:00100000:0.0:1789130510.687942:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+40:47857:x1876037605207936:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 424us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.687950:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 254 00000100:00100000:3.0:1789130510.693087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.693184:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208064 00000100:00100000:1.0:1789130510.693194:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208064 00000100:00100000:1.0:1789130510.693253:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130510.693263:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605208064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130510.693282:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130510.693302:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb12 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130510.693328:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f70e, blocks: 0x1 00010000:00010000:1.0:1789130510.693349:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=1673s v=(0 0) 00010000:00010000:1.0:1789130510.693353:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130510.693375:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 9 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.693398:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 9 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.693412:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130510.693469:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605208064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 208us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.693477:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789130510.700734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.700788:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208320 00000100:00100000:2.0:1789130510.700799:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208320 00000100:00100000:2.0:1789130510.700984:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 255 00000100:00100000:2.0:1789130510.700993:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+40:47857:x1876037605208320:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130510.701090:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+40:47857:x1876037605208320:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130510.701096:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 255 00000100:00100000:2.0:1789130510.705081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.705450:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208448 00000100:00100000:1.0:1789130510.705460:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208448 00000100:00100000:1.0:1789130510.705524:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130510.705533:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:47857:x1876037605208448:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130510.705553:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130510.705572:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb19 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.705639:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 10 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.705649:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130510.705653:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130510.705661:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.705745:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 10 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.705762:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 10 pid: 44793 timeout: 1773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.705775:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626912000:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130510.705875:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130510.709598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.709756:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208576 00000100:00100000:1.0:1789130510.709764:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208576 00010000:00010000:1.0:1789130510.709812:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 11 pid: 44793 timeout: 1773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130510.709859:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789130510.709868:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605208576:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130510.709882:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130510.709903:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 11 pid: 44793 timeout: 1773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.709917:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 11 pid: 44793 timeout: 1773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.709943:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130510.709947:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130510.709955:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 11 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.709964:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 11 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.709999:0:43664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 11 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130510.710018:0:43664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:43664:1876037626912128:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130510.710127:0:43664:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d556c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789130510.710393:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063b445c9/0x5c74554e47cec943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb12 expref: 11 pid: 44793 timeout: 1773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.710409:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626912000:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130510.710434:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.710444:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e200, rc 0) 00000100:00100000:0.0:1789130510.710488:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:47857:x1876037605208448:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4955us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.710496:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130510.726870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.727425:0:44372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208704 00000100:00100000:3.0:1789130510.727435:0:44372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208704 00002000:00100000:3.0:1789130510.727501:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe7:0x0] (0->10) req@ffff90b389408780 x1876037605208704/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:226/0 lens 504/0 e 0 to 0 dl 1789130521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130510.727513:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389408780 with x1876037605208704 ext(0->10) 00002000:00010000:3.0:1789130510.727520:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b389408780 00000100:00100000:3.0:1789130510.727554:0:44372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789130510.727565:0:44372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605208704:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130510.728079:0:44372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605208704:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 515us (1217us total) trans 34359738387 rc 0/0 00000100:00100000:3.0:1789130510.728088:0:44372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00002000:00100000:3.0:1789130510.728095:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe7:0x0] (0->10) req@ffff90b389408780 x1876037605208704/t34359738387(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:226/0 lens 504/448 e 0 to 0 dl 1789130521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130510.728103:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b389408780 with x1876037605208704 ext(0->10) 00002000:00010000:3.0:1789130510.728106:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b389408780 00000100:00100000:3.0:1789130510.732485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.733830:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208832 00000100:00100000:1.0:1789130510.733859:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208832 00000100:00100000:1.0:1789130510.733925:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:1.0:1789130510.733935:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+40:47857:x1876037605208832:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789130510.736214:0:43664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:43664:1876037626912128:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130510.736242:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130510.736310:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605208576:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 26441us (26719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.736322:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000001:00080000:0.0:1789130510.760215:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738585 is committed 00000001:00080000:0.0:1789130510.760302:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738586 is committed 00000001:00080000:0.0:1789130510.760372:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738588 is committed 00000004:00080000:0.0:1789130510.760377:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789130510.760402:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789130510.760414:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b49106b780 refcount 2 committed 0 result 0 batchid 30064771682 00000020:00080000:0.0:1789130510.760419:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b48a1859c0 00000020:00080000:0.0:1789130510.760422:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b390cbb400 00000020:00080000:0.0:1789130510.760437:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771682 committed batchid 30064771681 00000020:00080000:0.0:1789130510.760593:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771681 00000100:00100000:3.0:1789130510.760795:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626912384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130510.760872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130510.760911:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130510.760916:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626912256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130510.760942:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130510.760971:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626912384 00000100:00100000:3.0:1789130510.760977:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626912384 00000100:00100000:3.0:1789130510.761020:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626912256 00000100:00100000:3.0:1789130510.761023:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626912256 00000100:00100000:3.0:1789130510.761114:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130510.761171:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626912384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130510.761199:0:44793:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:230 count 1 00002000:00010000:3.0:1789130510.761230:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe6:0x0] initial LVB size: 11, mtime: 0x6aa3f70c, atime: 0x6aa3f70d, ctime: 0x6aa3f70c, blocks: 0x1 00010000:00010000:3.0:1789130510.761238:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.761260:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=1673s v=(0 0) 00010000:00010000:3.0:1789130510.761264:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130510.761271:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.761287:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.761297:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.761308:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.761326:0:44793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130510.761644:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626912384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 480us (772us total) trans 34359738385 rc 0/0 00000100:00100000:0.0:1789130510.762069:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130510.762080:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626912256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130510.762124:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+24:47857:x1876037605208832:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 28188us (29655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.762137:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 256 00002000:00010000:0.0:1789130510.762181:0:44367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:0.0:1789130510.762185:0:44367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb mtime from disk: 0 -> 1789130510 00002000:00010000:0.0:1789130510.762187:0:44367:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130510.762190:0:44367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb ctime from disk: 1789130510 -> 1789130510 00002000:00010000:0.0:1789130510.762192:0:44367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130510.762222:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626912256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (1278us total) trans 34359738388 rc 0/0 00000100:00100000:0.0:1789130510.762228:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000001:00080000:0.0:1789130510.762245:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738589 is committed 00000100:00080000:0.0:1789130510.763068:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130510.763192:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:3.0:1789130510.763217:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130510.763225:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.763236:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130510.763241:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.763258:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.763278:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.763286:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cec951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.763308:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130510.763310:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130510.763312:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130510.763345:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b394c4a1c0/2, rc 0, transno 34359738388 00000100:00100000:3.0:1789130510.763351:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626912256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1789130510.763363:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b394c4a580/2, rc 0, transno 34359738385 00000100:00100000:3.0:1789130510.763368:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626912384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130510.770526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.770633:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605208960 00000100:00100000:0.0:1789130510.770642:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605208960 00000100:00100000:0.0:1789130510.770826:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130510.770835:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605208960:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789130510.806461:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738388 is committed 00000001:00080000:2.0:1789130510.806480:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738386 is committed 00000001:00080000:2.0:1789130510.806488:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738387 is committed 00000100:00100000:1.0:1789130510.806945:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605208960:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 36105us (36424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.806957:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789130510.810803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.811228:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209216 00000100:00100000:0.0:1789130510.811239:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209216 00000100:00100000:0.0:1789130510.811344:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 257 00000100:00100000:0.0:1789130510.811356:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:47857:x1876037605209216:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130510.811410:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130510.811437:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cec93c lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb0b expref: 17 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.811455:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130510.811459:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130510.811490:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.811502:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.811511:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130510.813309:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003be50226 reply state 0000000049ba7043 transno 34359738590 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.813336:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130510.813475:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:47857:x1876037605209216:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2120us (2678us total) trans 34359738590 rc 0/0 00000100:00100000:0.0:1789130510.813484:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 257 00010000:00010000:1.0:1789130510.818019:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818037:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818045:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818051:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.818056:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818068:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818085:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:1.0:1789130510.818088:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130510.818093:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.818099:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cec958 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130510.823252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.823944:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209344 00000100:00100000:0.0:1789130510.823957:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209344 00000100:00100000:1.0:1789130510.824098:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1789130510.824111:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605209344:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789130510.824358:0:44366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb size from disk: 11 -> 11 00002000:00010000:1.0:1789130510.824361:0:44366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb mtime from disk: 1789130510 -> 1789130508 00002000:00010000:1.0:1789130510.824364:0:44366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb atime from disk: 0 -> 1789130509 00002000:00010000:1.0:1789130510.824366:0:44366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb ctime from disk: 1789130510 -> 1789130509 00002000:00010000:1.0:1789130510.824368:0:44366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe7:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789130510.824432:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605209344:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 323us (1189us total) trans 34359738389 rc 0/0 00000100:00100000:1.0:1789130510.824441:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789130510.836550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.836671:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209600 00000100:00100000:0.0:1789130510.836679:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209600 00000100:00100000:0.0:1789130510.836728:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:0.0:1789130510.836735:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:47857:x1876037605209600:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789130510.836797:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.836814:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.836825:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.836870:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.836886:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 17 pid: 43681 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.836900:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626912512:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130510.837002:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130510.841585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.841960:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626912512:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130510.841991:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.842198:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209728 00000100:00100000:2.0:1789130510.842205:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209728 00010000:00010000:2.0:1789130510.842244:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 18 pid: 43681 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.842338:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789130510.842349:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:2369:x1876037605209728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130510.842363:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130510.842370:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 18 pid: 43681 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842383:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 18 pid: 43681 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842405:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cec920 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acafd expref: 18 pid: 43681 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842420:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:2.0:1789130510.842426:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842436:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842448:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.842478:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130510.842530:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605209728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 182us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130510.842539:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00010000:00010000:0.0:1789130510.842598:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842639:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842666:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842674:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842681:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842688:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.842693:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842700:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842710:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130510.842713:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789130510.842717:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.842724:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cec95f lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.842770:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:47857:x1876037605209600:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 6034us (6227us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789130510.842789:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:3.0:1789130510.844781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.845001:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209856 00000100:00100000:2.0:1789130510.845010:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209856 00000100:00100000:2.0:1789130510.845167:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130510.845177:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605209856:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130510.845219:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.845239:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.845248:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130510.845253:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130510.845257:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.845289:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.845304:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 9 pid: 44367 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.845319:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626912640:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130510.847431:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130510.850818:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626912640:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130510.850877:0:44365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130510.852903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130510.853132:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605209984 00000100:00100000:2.0:1789130510.853142:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605209984 00010000:00010000:2.0:1789130510.853182:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130510.853274:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789130510.853284:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605209984:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130510.853300:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130510.853322:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.853336:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.853359:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be8b779/0x5c74554e47cec94a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb19 expref: 10 pid: 44367 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.853376:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130510.853381:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130510.853387:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.853397:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.853426:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130510.853485:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605209984:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130510.853492:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00010000:00010000:3.0:1789130510.854565:0:44365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854578:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854632:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854642:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854651:0:44365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854658:0:44365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130510.854662:0:44365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854671:0:44365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854686:0:44365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.854693:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010b122aa/0x5c74554e47cec966 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130510.854766:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605209856:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 9591us (9990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130510.854779:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130510.857225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.857305:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605210240 00000100:00100000:1.0:1789130510.857315:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605210240 00000100:00100000:1.0:1789130510.857401:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 259 00000100:00100000:1.0:1789130510.857410:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:47857:x1876037605210240:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130510.857484:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857502:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857514:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857770:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857781:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 17 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857789:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857823:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 17 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.857847:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 17 pid: 43680 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130510.857861:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626912768:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130510.857931:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130510.861076:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626912768:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130510.861246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.862402:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605210368 00000100:00100000:1.0:1789130510.862410:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605210368 00010000:00010000:1.0:1789130510.862449:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 18 pid: 43680 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130510.862522:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789130510.862531:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:2369:x1876037605210368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130510.862543:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130510.862549:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 18 pid: 43680 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862558:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 18 pid: 43680 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862574:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47cec92e lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb04 expref: 18 pid: 43680 timeout: 1773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862585:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:1.0:1789130510.862589:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862594:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862600:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.862748:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130510.862786:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605210368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 256us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.862794:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00010000:00010000:2.0:1789130510.862862:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.862872:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130510.862877:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130510.863067:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738591 00000001:00080000:2.0:1789130510.863226:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738592 00000001:00080000:2.0:1789130510.863271:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738593 00000100:00100000:2.0:1789130510.863348:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626912896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130510.863395:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130510.863419:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130510.863781:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626912896 00000100:00100000:0.0:1789130510.863786:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626912896 00000100:00100000:0.0:1789130510.863827:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130510.863847:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626912896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130510.863917:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626912896:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.863925:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130510.864039:0:43679:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738388 gen 2 00000004:00080000:0.0:1789130510.864045:0:43679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b394c4a1c0, transno 34359738388 00000100:00100000:0.0:1789130510.864059:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626912896:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789130510.864519:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738594 00000100:00100000:0.0:1789130510.864572:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626913024:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130510.864879:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130510.864900:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130510.865080:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913024 00000100:00100000:0.0:1789130510.865085:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913024 00000100:00100000:0.0:1789130510.865107:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130510.865113:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626913024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130510.865245:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626913024:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (366us total) trans 34359738390 rc 0/0 00000100:00100000:0.0:1789130510.865253:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130510.865282:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626913024:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789130510.865342:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738595 00010000:00010000:0.0:1789130510.865365:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865375:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865382:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865388:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.865393:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865401:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865415:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b48a1fd500) 00010000:00010000:0.0:1789130510.865418:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130510.865423:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865429:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cec974 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865458:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865464:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865470:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865475:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.865477:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865483:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865491:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130510.865493:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130510.865500:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865511:0:43679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865520:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.865544:0:43679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.865555:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383f283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626913152:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130510.866491:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130510.870189:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383f283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626913152:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130510.870225:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870235:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec8b0 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870265:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870278:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870290:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870305:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870312:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870317:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870322:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.870325:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870332:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870342:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130510.870344:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130510.870348:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870354:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec97b lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870363:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870369:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870374:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870379:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130510.870382:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870386:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870393:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130510.870395:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130510.870397:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.870402:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cec96d lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.871243:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:47857:x1876037605210240:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 13829us (14021us total) trans 34359738596 rc 0/0 00000100:00100000:0.0:1789130510.871254:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 259 00000020:00080000:0.0:1789130510.871261:0:43679:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1789130510.871763:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130510.871769:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130510.871849:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 6 count 6 00000040:00080000:1.0:1789130510.871856:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130510.872544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.872581:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605210496 00000100:00100000:0.0:1789130510.872594:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605210496 00000100:00100000:0.0:1789130510.872746:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1789130510.872757:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:47856:x1876037605210496:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:1.0:1789130510.874420:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:47856:x1876037605210496:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 1658us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.874432:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1789130510.878598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.878726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.878818:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605210752 00000100:00100000:1.0:1789130510.878828:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605210752 00000100:00100000:1.0:1789130510.878898:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:1.0:1789130510.878910:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:47856:x1876037605210752:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:1.0:1789130510.879292:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].6, 136 off9008 00000100:00100000:1.0:1789130510.879388:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383f283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:47856:x1876037605210752:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 480us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.879396:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:3.0:1789130510.879502:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211008 00000100:00100000:3.0:1789130510.879507:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211008 00000100:00100000:3.0:1789130510.879544:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130510.879551:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:47857:x1876037605211008:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789130510.880124:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789130510.880221:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738597 00010000:00010000:3.0:1789130510.880265:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880280:0:43683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880292:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880300:0:43683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880307:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880313:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130510.880335:0:43683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130510.880390:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+23:47857:x1876037605211008:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 839us (1663us total) trans 34359738598 rc 0/0 00000100:00100000:3.0:1789130510.880398:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000020:00080000:3.0:1789130510.880402:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789130510.880598:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130510.880694:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.880708:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130510.880712:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.880720:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.880734:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x19:0x0].0x0 (ffff90b488939b00) 00010000:00010000:0.0:1789130510.880737:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789130510.880742:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.880748:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cec982 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.880765:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130510.880767:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130510.880768:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130510.911505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.911756:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211136 00000100:00100000:0.0:1789130510.911767:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211136 00000100:00100000:0.0:1789130510.911831:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:0.0:1789130510.911852:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+23:47859:x1876037605211136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130510.911875:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130510.911899:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb20 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.911964:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.912108:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.912120:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130510.912281:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130510.912284:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130510.912392:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.912412:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cec989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb20 expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.912471:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb20 expref: 24 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.912480:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:0.0:1789130510.912483:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130510.912486:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130510.912545:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:47859:x1876037605211136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 697us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.912551:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 261 00000100:00100000:2.0:1789130510.916456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130510.916552:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211264 00000100:00100000:1.0:1789130510.916563:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211264 00000100:00100000:1.0:1789130510.916637:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:1.0:1789130510.916648:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+24:47859:x1876037605211264:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130510.916669:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130510.916689:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb27 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916750:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916764:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916775:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916801:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916809:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.916815:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.917113:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.917125:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.917134:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 4/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.917165:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.917178:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 25 pid: 43681 timeout: 1774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130510.917192:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626913280:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130510.917272:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4be62d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130510.920484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130510.920557:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211520 00000100:00100000:3.0:1789130510.920566:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211520 00000100:00100000:3.0:1789130510.920657:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789130510.920670:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:44607:x1876037605211520:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130510.920919:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:44607:x1876037605211520:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 251us (452us total) trans 34359738599 rc 0/0 00000100:00100000:3.0:1789130510.920927:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789130510.921383:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b389409e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626913280:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130510.921407:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130510.922923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130510.923183:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211648 00000100:00100000:0.0:1789130510.923192:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211648 00010000:00010000:0.0:1789130510.923229:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 27 pid: 43681 timeout: 1774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130510.923265:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1789130510.923274:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:2369:x1876037605211648:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130510.923287:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130510.923293:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 27 pid: 43681 timeout: 1774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923305:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 27 pid: 43681 timeout: 1774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923326:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cec8a2 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acada expref: 27 pid: 43681 timeout: 1774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923342:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:0.0:1789130510.923348:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923357:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923365:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 4/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130510.923404:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130510.923456:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:2369:x1876037605211648:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 183us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130510.923471:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00010000:00010000:1.0:1789130510.923646:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923655:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130510.923699:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00000004:00200000:1.0:1789130510.923704:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130510.923722:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923735:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923746:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923753:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923759:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923766:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.923769:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923776:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923800:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130510.923803:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130510.923807:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923813:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cec99e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923828:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923833:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923848:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923852:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130510.923855:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923859:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923866:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b4909bd700) 00010000:00010000:1.0:1789130510.923867:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130510.923870:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923874:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f800/0x5c74554e47cec9a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923908:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cec997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb27 expref: 26 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923921:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb27 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130510.923932:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130510.923934:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130510.923936:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130510.923962:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+25:47859:x1876037605211264:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 7317us (7515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130510.923969:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 262 00010000:00010000:3.0:1789130510.981897:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130511.155199:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738384 is committed 00000001:00080000:0.0:1789130511.155309:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738383 is committed 00000001:00080000:0.0:1789130511.155321:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738385 is committed 00000100:00100000:1.0:1789130511.621762:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130511.621796:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130511.621894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130511.621962:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913408 00000100:00100000:1.0:1789130511.621970:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913408 00000100:00100000:1.0:1789130511.622017:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130511.622027:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626913408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130511.622054:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3764387840 00000100:00100000:1.0:1789130511.622100:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626913408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130511.622107:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130511.622152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130511.625133:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130511.625161:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626913536:0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.625242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130511.625277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626914048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.625298:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626913920:0@lo:400:kworker.0 00000100:00100000:1.0:1789130511.625318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130511.625364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130511.625544:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626913664:0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.626978:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626914048 00000100:00100000:2.0:1789130511.626992:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626914048 00000100:00100000:2.0:1789130511.627048:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913920 00000100:00100000:2.0:1789130511.627052:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913920 00000100:00100000:2.0:1789130511.627081:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130511.627090:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.627174:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626914048:12345-0@lo:400:kworker.0 Request processed in 85us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130511.627182:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130511.627198:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789130511.627205:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.627237:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626913920:12345-0@lo:400:kworker.0 Request processed in 33us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130511.627243:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789130511.627260:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130511.627296:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626914048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130511.627567:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626913920:0@lo:400:kworker.0 00000100:00100000:3.0:1789130511.629173:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626913792:0@lo:400:kworker.0 00000100:00100000:3.0:1789130511.629244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130511.630595:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913792 00000100:00100000:3.0:1789130511.630630:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913792 00000100:00100000:3.0:1789130511.630685:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130511.630693:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626913792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130511.630762:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626913792:12345-0@lo:400:kworker.0 Request processed in 69us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130511.630769:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130511.630808:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626913792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130511.632155:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913536 00000100:00100000:0.0:1789130511.632167:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913536 00000100:00100000:0.0:1789130511.632223:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789130511.632232:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626913536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130511.632737:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626913536:0@lo:400:kworker.0 00000100:00100000:0.0:1789130511.636210:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626913536:12345-0@lo:400:kworker.0 Request processed in 3970us (10958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130511.636225:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789130511.638034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130511.644480:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626913664 00000100:00100000:3.0:1789130511.644496:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626913664 00000100:00100000:3.0:1789130511.644588:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789130511.644619:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626913664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130511.644720:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626913664:12345-0@lo:400:kworker.0 Request processed in 122us (6691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130511.644728:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130511.645700:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738385 gen 2 00000004:00080000:1.0:1789130511.645709:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738384 committed transno 34359738385 00000004:00080000:1.0:1789130511.645732:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b394c4a580, transno 34359738385 00000100:00100000:1.0:1789130511.645745:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626913664:0@lo:400:kworker.0 00000100:00080000:0.0:1789130511.646293:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789130511.817713:0:46524:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130511.817722:0:46524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130511.817795:0:46524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:3.0:1789130511.817801:0:46524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000040:00080000:0.0:1789130511.898714:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130511.898722:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130511.898786:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:0.0:1789130511.898792:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:0.0:1789130511.900594:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626914176:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130511.900728:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130511.911229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130511.911265:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605211776 00000100:00100000:0.0:1789130511.911283:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605211776 00000100:00100000:0.0:1789130511.911335:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 263 00000100:00100000:0.0:1789130511.911508:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+26:47870:x1876037605211776:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130511.911548:0:43681:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130511.911679:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+26:47870:x1876037605211776:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 176us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130511.911687:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 263 00000100:00100000:3.0:1789130511.914764:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626914176:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130511.934940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130511.937468:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212032 00000100:00100000:3.0:1789130511.937483:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212032 00000100:00100000:3.0:1789130511.937569:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:3.0:1789130511.937580:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:47870:x1876037605212032:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130511.937654:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130511.937679:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb2e expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130511.937776:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec9ba lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130511.937792:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec9ba lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130511.937806:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec9ba lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130511.937831:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:3.0:1789130511.937961:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb2e expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130511.937981:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec9ba lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb2e expref: 27 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130511.937989:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130511.937992:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130511.937996:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130511.938062:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:47870:x1876037605212032:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 485us (3132us total) trans 34359738600 rc 0/0 00000100:00100000:3.0:1789130511.938070:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:3.0:1789130511.947028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130511.947343:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212160 00000100:00100000:1.0:1789130511.947354:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212160 00000100:00100000:1.0:1789130511.947428:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789130511.947440:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:2369:x1876037605212160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130511.947465:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130511.947491:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cec9ba lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb2e expref: 27 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130511.947520:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:1.0:1789130511.947525:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130511.947577:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:2369:x1876037605212160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 140us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130511.947585:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789130511.950657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130511.951107:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212416 00000100:00100000:2.0:1789130511.951118:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212416 00000100:00100000:2.0:1789130511.951177:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 265 00000100:00100000:2.0:1789130511.951187:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+26:47870:x1876037605212416:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130511.951264:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951293:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951305:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951493:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951502:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951510:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951517:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130511.951521:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951529:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951541:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130511.951544:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130511.951550:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130511.951557:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cec9c8 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130511.951998:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:47870:x1876037605212416:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 809us (1344us total) trans 34359738601 rc 0/0 00000100:00100000:2.0:1789130511.952007:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 265 00000040:00080000:3.0:1789130511.955571:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130511.955581:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130511.955788:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:3.0:1789130511.955795:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130511.959347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130511.960378:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212672 00000100:00100000:3.0:1789130511.960390:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212672 00000100:00100000:3.0:1789130511.960453:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1789130511.960463:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:47870:x1876037605212672:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130511.960729:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:47870:x1876037605212672:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 267us (1391us total) trans 34359738602 rc 0/0 00000100:00100000:3.0:1789130511.960737:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00010000:00010000:0.0:1789130512.007926:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130513.030020:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130513.446901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130513.446933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130513.446959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130513.446979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130513.447074:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212928 00000100:00100000:1.0:1789130513.447084:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212928 00000100:00100000:1.0:1789130513.447152:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:1.0:1789130513.447163:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:2369:x1876037605212928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130513.447206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130513.447232:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213184 00000100:00100000:0.0:1789130513.447236:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213184 00000100:00100000:1.0:1789130513.447253:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:2369:x1876037605212928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 91us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130513.447260:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1789130513.447262:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213056 00000100:00100000:0.0:1789130513.447264:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213056 00000100:00100000:1.0:1789130513.447273:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213312 00000100:00100000:1.0:1789130513.447276:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213312 00000100:00100000:0.0:1789130513.447284:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1789130513.447291:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605213184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130513.447300:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130513.447306:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605213312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130513.447318:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605213184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130513.447324:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789130513.447326:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605213312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130513.447331:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789130513.447337:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1789130513.447343:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605213056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130513.447351:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605212800 00000100:00100000:1.0:1789130513.447354:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605212800 00000100:00100000:0.0:1789130513.447367:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605213056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130513.447372:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789130513.447377:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:1.0:1789130513.447383:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605212800:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130513.447406:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605212800:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130513.447412:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00080000:1.0:1789130513.447437:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130513.447441:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130513.447444:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130514.068634:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130514.182314:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130514.182338:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626914304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130514.182407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130514.185736:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626914304 00000100:00100000:1.0:1789130514.185750:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626914304 00000100:00080000:2.0:1789130514.185803:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130514.185846:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789130514.185857:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626914304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130514.185895:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130514.185979:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626914304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130514.185988:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789130514.186044:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626914304:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789130514.272761:0:46575:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130514.272771:0:46575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130514.272836:0:46575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:3.0:1789130514.272842:0:46575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130514.641495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130514.647653:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213568 00000100:00100000:2.0:1789130514.647672:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213568 00000100:00100000:2.0:1789130514.648122:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:2.0:1789130514.648137:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:47891:x1876037605213568:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130514.648172:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130514.648207:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec9cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb35 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130514.648438:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec9d6 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130514.648455:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec9d6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130514.648468:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec9d6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130514.648480:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:2.0:1789130514.648641:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cec9cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb35 expref: 31 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130514.648669:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec9d6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb35 expref: 30 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130514.648678:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:2.0:1789130514.648681:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789130514.648684:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1200, rc 0) 00000100:00100000:2.0:1789130514.648932:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+30:47891:x1876037605213568:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 797us (7451us total) trans 34359738603 rc 0/0 00000100:00100000:2.0:1789130514.648940:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:1.0:1789130514.653967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130514.654047:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213696 00000100:00100000:3.0:1789130514.654057:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213696 00000100:00100000:3.0:1789130514.654114:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 267 00000100:00100000:3.0:1789130514.654125:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:47891:x1876037605213696:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789130514.654187:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654205:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654216:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654240:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654247:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654253:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654259:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130514.654263:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654275:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654285:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130514.654287:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130514.654292:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.654299:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9e4 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130514.654432:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:47891:x1876037605213696:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 308us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130514.654440:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 267 00000100:00100000:0.0:1789130514.884596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130514.884810:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605213824 00000100:00100000:1.0:1789130514.884822:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605213824 00000100:00100000:1.0:1789130514.884888:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:1.0:1789130514.884899:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605213824:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130514.884923:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130514.884951:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001475205f/0x5c74554e47cec9eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb3c expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130514.884984:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe7:0x0] initial LVB size: 11, mtime: 0x6aa3f70c, atime: 0x6aa3f70d, ctime: 0x6aa3f70d, blocks: 0xb 00010000:00010000:1.0:1789130514.885011:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=1677s v=(0 0) 00010000:00010000:1.0:1789130514.885016:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130514.885026:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001475205f/0x5c74554e47cec9eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb3c expref: 9 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130514.885045:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001475205f/0x5c74554e47cec9eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb3c expref: 9 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130514.885059:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f800, rc 0) 00000100:00100000:1.0:1789130514.885134:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605213824:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 237us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130514.885142:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789130514.890840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130514.891117:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214080 00000100:00100000:3.0:1789130514.891130:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214080 00000100:00100000:3.0:1789130514.891215:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:3.0:1789130514.891228:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:47907:x1876037605214080:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130514.891250:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130514.891253:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1789130514.891297:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cec9ac lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb27 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891323:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cec9d6 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb35 expref: 29 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891337:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cec8b7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acae1 expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891353:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b497c01c00) 00010000:00010000:3.0:1789130514.891364:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130514.891380:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9f2 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb43 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891435:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891449:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891458:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891479:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891485:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891491:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891496:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130514.891500:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891507:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891518:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130514.891521:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130514.891524:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891529:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cec9f9 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891552:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891559:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891565:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891865:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb43 expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891872:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130514.891874:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130514.891884:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cec9f2 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb43 expref: 30 pid: 43679 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891897:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb43 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130514.891924:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130514.891927:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789130514.891929:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:3.0:1789130514.892000:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47907:x1876037605214080:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 775us (1170us total) trans 34359738604 rc 0/0 00000100:00100000:3.0:1789130514.892008:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:2.0:1789130514.898872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130514.898974:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214208 00000100:00100000:3.0:1789130514.898986:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214208 00002000:00100000:3.0:1789130514.899061:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe7:0x0] (0->4095) req@ffff90b386efbc00 x1876037605214208/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:230/0 lens 488/0 e 0 to 0 dl 1789130525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130514.899073:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386efbc00 with x1876037605214208 ext(0->4095) 00002000:00010000:3.0:1789130514.899082:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386efbc00 00000100:00100000:3.0:1789130514.899119:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789130514.899130:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605214208:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130514.899390:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605214208:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 261us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789130514.899399:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00002000:00100000:3.0:1789130514.899407:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe7:0x0] (0->4095) req@ffff90b386efbc00 x1876037605214208/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:230/0 lens 488/4536 e 0 to 0 dl 1789130525 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130514.899417:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386efbc00 with x1876037605214208 ext(0->4095) 00002000:00010000:3.0:1789130514.899421:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386efbc00 00000100:00100000:0.0:1789130514.906700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130514.907005:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214464 00000100:00100000:1.0:1789130514.907016:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214464 00000100:00100000:1.0:1789130514.907080:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130514.907092:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:47907:x1876037605214464:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130514.907374:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:47907:x1876037605214464:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 284us (682us total) trans 34359738605 rc 0/0 00000100:00100000:1.0:1789130514.907382:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789130515.046462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130515.046560:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214592 00000100:00100000:3.0:1789130515.046572:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214592 00000100:00100000:3.0:1789130515.046692:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 269 00000100:00100000:3.0:1789130515.046723:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:47917:x1876037605214592:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130515.046842:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.046864:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.046880:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.046897:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.046905:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.046912:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047293:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047303:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047311:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130515.047354:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047368:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047375:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047388:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047394:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.047398:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047406:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047420:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130515.047423:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.047428:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047435:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047447:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047454:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047460:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047465:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.047467:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047477:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047484:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b488939600) 00010000:00010000:3.0:1789130515.047487:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.047490:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047495:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047510:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047516:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047521:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047526:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.047528:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047533:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047539:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130515.047541:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.047544:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.047553:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca15 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.047689:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:47917:x1876037605214592:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 986us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130515.047698:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 269 00000100:00080000:2.0:1789130515.049051:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130515.078626:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130515.197531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130515.197629:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214720 00000100:00100000:3.0:1789130515.197639:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214720 00000100:00100000:3.0:1789130515.197703:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:3.0:1789130515.197714:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:47923:x1876037605214720:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130515.197734:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130515.197757:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb4a expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197831:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197845:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197857:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197872:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197879:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.197890:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198160:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198167:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198172:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130515.198210:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00000004:00200000:3.0:1789130515.198213:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130515.198226:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198235:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198240:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198245:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198249:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198253:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.198256:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198262:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198276:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130515.198278:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.198282:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198286:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47ceca23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198295:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198299:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198303:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198305:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.198307:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198310:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198314:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b488939600) 00010000:00010000:3.0:1789130515.198315:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.198317:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198323:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceca2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198345:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198353:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 31 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.198357:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130515.198359:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130515.198360:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:3.0:1789130515.198423:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:47923:x1876037605214720:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 712us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130515.198431:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:0.0:1789130515.202272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130515.202368:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605214976 00000100:00100000:3.0:1789130515.202377:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605214976 00000100:00100000:3.0:1789130515.202559:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 271 00000100:00100000:3.0:1789130515.202574:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:47923:x1876037605214976:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130515.202594:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130515.206777:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb51 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.206917:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.206936:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.206946:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.206981:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 32 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.206997:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 32 pid: 43679 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.207011:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626914432:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130515.207097:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130515.211569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130515.212120:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605215104 00000100:00100000:0.0:1789130515.212131:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605215104 00010000:00010000:0.0:1789130515.212183:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 33 pid: 43679 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130515.212224:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:0.0:1789130515.212235:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:2369:x1876037605215104:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130515.212250:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130515.212257:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 33 pid: 43679 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.212270:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 33 pid: 43679 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.212294:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130515.212299:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.212309:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.212316:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.212335:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130515.212407:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:2369:x1876037605215104:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 173us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130515.212414:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:3.0:1789130515.218137:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca31 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb4a expref: 32 pid: 43679 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.218166:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626914432:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130515.218203:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.218214:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.218220:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130515.218244:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:3.0:1789130515.218530:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.218552:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.218562:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130515.218566:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130515.218570:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5400, rc 0) 00000100:00100000:3.0:1789130515.218802:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:47923:x1876037605214976:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 16231us (16538us total) trans 34359738606 rc 0/0 00000100:00100000:3.0:1789130515.218810:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 271 00000100:00100000:2.0:1789130515.396161:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130515.396481:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605215232 00000100:00100000:3.0:1789130515.396494:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605215232 00000100:00100000:3.0:1789130515.396980:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:3.0:1789130515.396996:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:47933:x1876037605215232:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130515.397078:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.397095:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.397107:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.397123:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.397131:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.397142:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399127:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399147:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399159:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130515.399209:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399222:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399228:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399236:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399243:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.399247:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.399254:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.403367:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130515.403441:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.403456:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.403467:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ceca4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.403496:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.403502:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.403509:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.405506:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.406629:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407004:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407024:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b488939600) 00010000:00010000:3.0:1789130515.407027:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.407033:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407040:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ceca54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407069:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407076:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407083:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407089:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130515.407092:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407098:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407104:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130515.407106:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130515.407109:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.407115:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ceca5b lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.408004:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:47933:x1876037605215232:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 11000us (11842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130515.408019:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:2.0:1789130515.575127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130515.575228:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605215488 00000100:00100000:1.0:1789130515.575239:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605215488 00000100:00100000:1.0:1789130515.575303:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 273 00000100:00100000:1.0:1789130515.575314:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:47940:x1876037605215488:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789130515.575335:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130515.575356:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb58 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575423:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575439:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575450:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575465:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575472:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.575478:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576081:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceca77 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576093:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceca77 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576101:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceca77 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130515.576112:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:1.0:1789130515.576208:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576216:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576222:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576228:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130515.576231:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576238:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576250:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130515.576253:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130515.576257:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576263:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576275:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576281:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576286:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576290:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130515.576293:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576298:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576304:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b4909bd800) 00010000:00010000:1.0:1789130515.576307:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130515.576309:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576315:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576358:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb58 expref: 35 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576370:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceca77 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb58 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.576377:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130515.576379:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130515.576382:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130515.576505:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:47940:x1876037605215488:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1192us (1387us total) trans 34359738607 rc 0/0 00000100:00100000:1.0:1789130515.576566:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 273 00000100:00100000:1.0:1789130515.590594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130515.591009:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605215744 00000100:00100000:2.0:1789130515.591019:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605215744 00000100:00100000:2.0:1789130515.591111:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130515.591121:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:47940:x1876037605215744:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1789130515.591421:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:47940:x1876037605215744:12345-192.168.201.39@tcp:35:cat.0 Request processed in 300us (836us total) trans 34359738608 rc 0/0 00000100:00100000:2.0:1789130515.591429:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130515.705039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130515.705326:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605215872 00000100:00100000:1.0:1789130515.705337:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605215872 00000100:00100000:1.0:1789130515.705409:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:1.0:1789130515.705420:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:47950:x1876037605215872:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130515.705510:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705529:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705542:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705558:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705565:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705572:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705950:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705961:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.705969:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130515.706013:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706024:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706031:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706038:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706045:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130515.706050:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706058:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706071:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130515.706074:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130515.706079:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706086:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ceca85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706098:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706105:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706111:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706116:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130515.706119:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706125:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706131:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b4909bd800) 00010000:00010000:1.0:1789130515.706133:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130515.706136:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706142:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ceca8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706156:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706162:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706168:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706172:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130515.706175:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706182:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706189:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130515.706192:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130515.706194:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.706200:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ceca93 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130515.706274:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:47950:x1876037605215872:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 855us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130515.706281:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:1.0:1789130515.833654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130515.834173:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216000 00000100:00100000:2.0:1789130515.834185:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216000 00000100:00100000:2.0:1789130515.834265:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:2.0:1789130515.834277:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:47956:x1876037605216000:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130515.834310:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130515.834339:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceca9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb5f expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834423:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834439:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834452:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834468:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834476:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.834483:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.837105:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.837138:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 2/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.837148:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 4/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.837204:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.837221:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 36 pid: 43680 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130515.837236:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386efa580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626914560:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130515.837363:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130515.843554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130515.844464:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386efa580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626914560:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130515.844512:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.844942:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216256 00000100:00100000:3.0:1789130515.844952:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216256 00000100:00100000:3.0:1789130515.845137:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130515.845149:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:44607:x1876037605216256:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789130515.845471:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:44607:x1876037605216256:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 324us (1937us total) trans 34359738609 rc 0/0 00000100:00100000:3.0:1789130515.845480:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130515.857900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130515.858931:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216384 00000100:00100000:3.0:1789130515.858945:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216384 00010000:00010000:3.0:1789130515.859081:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 38 pid: 43680 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130515.859132:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1789130515.859144:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+38:2369:x1876037605216384:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130515.859168:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130515.859176:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 4/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 38 pid: 43680 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.859192:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 38 pid: 43680 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.859217:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ceca3f lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb51 expref: 38 pid: 43680 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.859234:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130515.859240:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.859250:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.859258:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 4/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130515.863777:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130515.863890:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:2369:x1876037605216384:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4739us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130515.863905:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00010000:00010000:2.0:1789130515.870318:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870337:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130515.870520:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00000004:00200000:2.0:1789130515.870526:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130515.870686:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870704:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870715:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870726:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870735:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.870741:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130515.871049:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871060:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871076:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130515.871080:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130515.871085:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871091:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecaa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871111:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871118:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871124:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871130:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130515.871134:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871140:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871148:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b48a1fd200) 00010000:00010000:2.0:1789130515.871151:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130515.871154:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871160:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecaa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871207:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47ceca9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871324:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130515.871333:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:2.0:1789130515.871335:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130515.871338:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130515.871819:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:47956:x1876037605216000:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 37541us (38218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130515.871829:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:0.0:1789130515.881074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130515.883652:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216640 00000100:00100000:1.0:1789130515.883672:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216640 00000100:00100000:1.0:1789130515.883808:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:1.0:1789130515.883819:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:47956:x1876037605216640:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130515.883855:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130515.883885:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb66 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.884187:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.884208:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.884218:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.884257:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.884271:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 37 pid: 43681 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130515.884285:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626914688:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130515.884673:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130515.891802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130515.891932:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626914688:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130515.891988:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130515.893516:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216768 00000100:00100000:0.0:1789130515.893530:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216768 00010000:00010000:0.0:1789130515.893587:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 38 pid: 43681 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130515.893664:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789130515.893675:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:2369:x1876037605216768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130515.893692:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130515.893710:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 38 pid: 43681 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893725:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 38 pid: 43681 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893761:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecaaf lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb5f expref: 38 pid: 43681 timeout: 1778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893789:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130515.893794:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893805:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893813:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130515.893841:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130515.893916:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+37:2369:x1876037605216768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 243us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130515.893925:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00010000:00010000:1.0:1789130515.895538:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.895554:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130515.895582:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x17:0x0]: returning size 11 00010000:00010000:1.0:1789130515.896194:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb66 expref: 38 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.896216:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb66 expref: 37 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130515.896225:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130515.896227:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130515.896232:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130515.896294:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+37:47956:x1876037605216640:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 12476us (15231us total) trans 34359738610 rc 0/0 00000100:00100000:1.0:1789130515.896303:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:1.0:1789130516.026079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130516.026207:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605216896 00000100:00100000:3.0:1789130516.026217:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605216896 00000100:00100000:3.0:1789130516.028343:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:3.0:1789130516.028379:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:47966:x1876037605216896:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130516.028472:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.028489:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.028504:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.028521:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.028527:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.028533:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.029584:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.030983:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031009:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130516.031061:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031075:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031081:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031088:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031094:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130516.031098:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031105:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031118:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:3.0:1789130516.031121:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130516.031137:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031145:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47cecacb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031161:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031169:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031175:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031180:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130516.031182:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031189:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031196:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f904cb5 (ffff90b488939600) 00010000:00010000:3.0:1789130516.031198:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130516.031201:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031207:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1f904cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031225:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031231:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031238:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031243:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130516.031246:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031252:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031260:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130516.031262:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130516.031265:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130516.031271:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecad9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130516.031386:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:47966:x1876037605216896:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 3026us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.031398:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 277 00010000:00010000:1.0:1789130516.101966:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130516.349639:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738596 is committed 00000020:00080000:0.0:1789130516.349688:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4bac29a80 refcount 2 committed 0 result 0 batchid 30064771683 00000020:00080000:0.0:1789130516.349704:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bac29d80 00000020:00080000:0.0:1789130516.349708:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386d88800 00000020:00080000:0.0:1789130516.349721:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771682 batchid updated 00000001:00080000:0.0:1789130516.349727:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738610 is committed 00000020:00080000:0.0:1789130516.349805:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771683 committed batchid 30064771682 00000020:00080000:0.0:1789130516.349995:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771682 00000001:00080000:2.0:1789130516.360163:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738390 is committed 00000001:00080000:2.0:1789130516.360182:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738389 is committed 00000100:00100000:3.0:1789130516.742237:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626914816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130516.743884:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626915072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130516.744016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130516.744089:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626915584:0@lo:400:kworker.0 00000100:00100000:0.0:1789130516.744118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130516.744148:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789130516.744155:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626914944:0@lo:400:kworker.0 00000100:00100000:0.0:1789130516.744186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130516.744210:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626915456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130516.744234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130516.744269:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915072 00000100:00100000:0.0:1789130516.744277:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915072 00000100:00100000:3.0:1789130516.744749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130516.744791:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626915328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.744815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130516.744832:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130516.744837:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626915200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.744858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130516.744887:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626914816 00000100:00100000:3.0:1789130516.744891:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626914816 00000100:00100000:3.0:1789130516.744943:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130516.744952:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626914816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130516.744988:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130516.745030:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626914816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745038:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130516.745061:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915200 00000100:00100000:3.0:1789130516.745064:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915200 00000100:00100000:3.0:1789130516.745085:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130516.745091:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626915072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745127:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626915072:12345-0@lo:400:kworker.0 Request processed in 37us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745134:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130516.745146:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130516.745152:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626915200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745176:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626915200:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745181:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130516.745216:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626915072:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745256:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915584 00000100:00100000:3.0:1789130516.745261:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915584 00000100:00100000:3.0:1789130516.745303:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915456 00000100:00100000:3.0:1789130516.745306:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915456 00000100:00100000:3.0:1789130516.745323:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915328 00000100:00100000:3.0:1789130516.745326:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915328 00000100:00100000:3.0:1789130516.745340:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130516.745347:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626915584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745384:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626915584:12345-0@lo:400:kworker.0 Request processed in 37us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745391:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130516.745404:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789130516.745411:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626915456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745441:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626915456:12345-0@lo:400:kworker.0 Request processed in 30us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745447:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789130516.745459:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130516.745466:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745494:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626915328:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745500:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130516.745541:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626915456:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745551:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626915584:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745576:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738390 gen 2 00000004:00080000:3.0:1789130516.745582:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738390 committed transno 34359738390 00000100:00100000:3.0:1789130516.745596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626915200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745632:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626915328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745646:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626914816:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130516.745684:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130516.745689:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130516.745691:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130516.745706:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626914944 00000100:00100000:3.0:1789130516.745710:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626914944 00000100:00100000:3.0:1789130516.745752:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789130516.745759:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626914944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130516.745798:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626914944:12345-0@lo:400:kworker.0 Request processed in 39us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130516.745805:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789130516.745836:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626914944:0@lo:400:kworker.0 00010000:00010000:3.0:1789130517.127127:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130518.152337:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130518.568015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130518.568057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130518.568070:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217152 00000100:00100000:3.0:1789130518.568082:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217152 00000100:00100000:0.0:1789130518.568099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130518.568130:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217408 00000100:00100000:1.0:1789130518.568135:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217408 00000100:00100000:0.0:1789130518.568135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130518.568160:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1789130518.568166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130518.568175:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217280 00000100:00100000:3.0:1789130518.568176:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:2370:x1876037605217152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130518.568179:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217280 00000100:00100000:1.0:1789130518.568210:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789130518.568259:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:2370:x1876037605217152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130518.568261:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217024 00000100:00100000:2.0:1789130518.568266:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217024 00000100:00100000:3.0:1789130518.568267:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:3.0:1789130518.568283:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217536 00000100:00100000:3.0:1789130518.568286:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217536 00000100:00100000:2.0:1789130518.568306:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:2.0:1789130518.568317:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605217024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130518.568328:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789130518.568335:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605217536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130518.568353:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605217024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130518.568361:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1789130518.568379:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2370:x1876037605217536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130518.568384:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00080000:3.0:1789130518.568398:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130518.568402:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130518.568404:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130518.568467:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605217408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130518.568513:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605217408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 295us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130518.569445:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789130518.569461:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605217280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130518.569514:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605217280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130518.570418:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789130518.571224:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:1.0:1789130519.177130:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130519.302643:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626915712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130519.302736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130519.302978:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915712 00000100:00100000:3.0:1789130519.302986:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915712 00000100:00100000:3.0:1789130519.303075:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130519.303085:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626915712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130519.303122:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130519.303176:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626915712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130519.303183:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789130519.303477:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130519.303560:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626915712:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789130520.134014:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130520.134029:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130520.134077:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:3.0:1789130520.134085:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:1.0:1789130520.200082:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130521.222791:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130521.412708:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771683 batchid updated 00000020:00080000:3.0:1789130521.412780:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771683 00000020:00080000:3.0:1789130521.412791:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771683 00000100:00100000:0.0:1789130521.581495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130521.581587:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217664 00000100:00100000:3.0:1789130521.581598:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217664 00000100:00100000:3.0:1789130521.581772:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:3.0:1789130521.581784:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:47776:x1876037605217664:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1789130521.582004:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130521.582053:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:47776:x1876037605217664:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 270us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130521.582062:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:3.0:1789130521.602096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130521.602189:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605217920 00000100:00100000:2.0:1789130521.602198:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605217920 00000100:00100000:2.0:1789130521.602250:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130521.602259:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:47776:x1876037605217920:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130521.604177:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:47776:x1876037605217920:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1911us (2082us total) trans 34359738611 rc 0/0 00000100:00100000:0.0:1789130521.604188:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789130521.862006:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626916096:0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130521.862157:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789130521.862163:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626915968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130521.862214:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626916480:0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130521.862272:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916096 00000100:00100000:3.0:1789130521.862280:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916096 00000100:00100000:3.0:1789130521.862333:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915968 00000100:00100000:3.0:1789130521.862337:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915968 00000100:00100000:3.0:1789130521.862357:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130521.862365:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626916096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862416:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626916096:12345-0@lo:400:kworker.0 Request processed in 51us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130521.862424:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130521.862440:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130521.862446:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626915968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862474:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626915968:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130521.862480:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130521.862500:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916480 00000100:00100000:3.0:1789130521.862504:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916480 00000100:00100000:3.0:1789130521.862527:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130521.862534:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862565:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626916480:12345-0@lo:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130521.862572:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789130521.862623:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130521.862628:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130521.862630:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130521.862667:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626915968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862678:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626916480:0@lo:400:kworker.0 00000100:00100000:3.0:1789130521.862687:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626916096:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.862782:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626916224:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.862814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130521.862840:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789130521.862846:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626915840:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.862933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130521.862961:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626916352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.862984:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130521.863015:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916224 00000100:00100000:2.0:1789130521.863020:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916224 00000100:00100000:2.0:1789130521.863046:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916352 00000100:00100000:2.0:1789130521.863050:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916352 00000100:00100000:2.0:1789130521.863073:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789130521.863080:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626916224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.863117:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626916224:12345-0@lo:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130521.863123:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789130521.863136:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130521.863142:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626916352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.863168:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626916352:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130521.863174:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130521.863192:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626915840 00000100:00100000:2.0:1789130521.863196:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626915840 00000100:00100000:2.0:1789130521.863220:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789130521.863225:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626915840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.863253:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626915840:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130521.863259:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1789130521.863284:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130521.863302:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626915840:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.863313:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626916352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130521.863322:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626916224:0@lo:400:kworker.0 00000100:00100000:1.0:1789130521.865042:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130521.865066:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626916608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130521.865129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130521.865250:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916608 00000100:00100000:2.0:1789130521.865258:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916608 00000100:00100000:2.0:1789130521.865309:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130521.865318:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626916608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130521.865355:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1789130521.865412:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626916608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130521.865419:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130521.865688:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626916608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130521.951303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130521.951412:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218048 00000100:00100000:2.0:1789130521.951423:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218048 00000100:00100000:2.0:1789130521.951504:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:2.0:1789130521.951514:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:48411:x1876037605218048:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1789130521.951535:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130521.951567:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb6d expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.951682:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.951697:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.951712:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130521.951907:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130521.951911:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130521.951990:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.952015:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 7 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.952037:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 6 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130521.952045:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130521.952048:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130521.952052:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0000, rc 0) 00000100:00100000:2.0:1789130521.952123:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:48411:x1876037605218048:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 610us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130521.952130:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00080000:3.0:1789130521.952807:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130522.245912:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130523.269996:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130523.686179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130523.686231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130523.686265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130523.686293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130523.686320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130523.686354:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218560 00000100:00100000:0.0:1789130523.686364:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218560 00000100:00100000:0.0:1789130523.686425:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218432 00000100:00100000:0.0:1789130523.686429:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218432 00000100:00100000:0.0:1789130523.686453:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789130523.686465:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605218560:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130523.686543:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605218560:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130523.686551:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789130523.686570:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789130523.686577:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605218432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130523.686649:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605218432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130523.686656:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789130523.686680:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218304 00000100:00100000:0.0:1789130523.686684:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218304 00000100:00100000:0.0:1789130523.686712:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218688 00000100:00100000:0.0:1789130523.686715:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218688 00000100:00100000:0.0:1789130523.686735:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130523.686742:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2367:x1876037605218304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130523.686777:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2367:x1876037605218304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130523.686785:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789130523.686797:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789130523.686804:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2367:x1876037605218688:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130523.686988:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218176 00000100:00100000:3.0:1789130523.686994:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218176 00000100:00100000:3.0:1789130523.687027:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:3.0:1789130523.687035:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605218176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130523.687060:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605218176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130523.687067:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:0.0:1789130523.687131:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2367:x1876037605218688:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130523.687141:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00080000:0.0:1789130523.687161:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130523.687165:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130523.687167:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789130524.294006:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130524.422100:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626916736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130524.422168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130524.422264:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916736 00000100:00100000:3.0:1789130524.422272:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916736 00000100:00100000:3.0:1789130524.422320:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130524.422326:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626916736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130524.422354:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130524.422399:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626916736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130524.422404:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789130524.422502:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130524.422539:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626916736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130525.319044:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130525.864804:0:46778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 17: Test auto attach for layout refresh ========================================================== 08:42:04 (1789130524) 00010000:00010000:1.0:1789130526.342321:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130526.526199:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738611 is committed 00000100:00100000:1.0:1789130526.982174:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626916992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130526.982273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130526.982356:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626917504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130526.982387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130526.982418:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130526.982424:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626917120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130526.982448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130526.982487:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916992 00000100:00100000:1.0:1789130526.982496:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916992 00000100:00100000:1.0:1789130526.982570:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626917120 00000100:00100000:1.0:1789130526.982574:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626917120 00000100:00100000:1.0:1789130526.982630:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130526.982644:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626916992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130526.982700:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626917504 00000100:00100000:0.0:1789130526.982705:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626917504 00000100:00100000:1.0:1789130526.982711:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626916992:12345-0@lo:400:kworker.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130526.982721:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130526.982756:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789130526.982764:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789130526.982772:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626917504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130526.982777:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626917120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130526.982827:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626917504:12345-0@lo:400:kworker.0 Request processed in 62us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130526.982830:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626917120:12345-0@lo:400:kworker.0 Request processed in 57us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130526.982840:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789130526.982844:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789130526.982937:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.982982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130526.983010:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626917376:0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130526.983057:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130526.983063:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626917248:0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983086:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130526.983116:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626916864 00000100:00100000:2.0:1789130526.983120:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626916864 00000100:00100000:2.0:1789130526.983163:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130526.983171:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626916864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983209:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626916864:12345-0@lo:400:kworker.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130526.983216:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130526.983248:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626917376 00000100:00100000:2.0:1789130526.983252:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626917376 00000100:00100000:2.0:1789130526.983279:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626917248 00000100:00100000:2.0:1789130526.983283:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626917248 00000100:00100000:2.0:1789130526.983307:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130526.983314:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626917376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983346:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626917376:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130526.983353:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130526.983366:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130526.983373:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983400:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626917248:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130526.983407:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130526.983457:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626917248:0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983469:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789130526.983478:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626917376:0@lo:400:kworker.0 00000100:00100000:3.0:1789130526.983585:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626917632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130526.983643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130526.983685:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626917632 00000100:00100000:3.0:1789130526.983689:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626917632 00000100:00100000:3.0:1789130526.983721:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130526.983728:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626917632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130526.983765:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1789130526.983805:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626917632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130526.983816:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130526.983863:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626917632:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789130526.984014:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130526.984021:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130526.984035:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130526.984070:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626917120:0@lo:400:kworker.0 00000100:00100000:0.0:1789130526.984083:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626916992:0@lo:400:kworker.0 00000100:00100000:0.0:1789130526.984368:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626917504:0@lo:400:kworker.0 00010000:00010000:1.0:1789130527.368233:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130527.534795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.534908:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605218944 00000100:00100000:2.0:1789130527.534922:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605218944 00000100:00100000:2.0:1789130527.535034:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:2.0:1789130527.535057:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:48672:x1876037605218944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130527.535091:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130527.535120:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecaee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb74 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130527.535213:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130527.535222:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535242:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535258:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535278:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535286:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535293:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535892:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecb03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535905:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecb03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.535914:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecb03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130527.535940:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789130527.536166:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536175:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536182:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536190:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130527.536194:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536202:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536217:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939000) 00010000:00010000:2.0:1789130527.536220:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130527.536225:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536232:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecaf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536246:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536252:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536258:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536268:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130527.536271:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536277:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536285:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b482b51d00) 00010000:00010000:2.0:1789130527.536287:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130527.536290:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536296:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecafc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536881:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecaee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb74 expref: 19 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536904:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecb03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb74 expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.536913:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:2.0:1789130527.536916:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130527.536919:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1600, rc 0) 00000100:00100000:2.0:1789130527.537010:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:48672:x1876037605218944:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1965us (2230us total) trans 34359738612 rc 0/0 00000100:00100000:2.0:1789130527.537020:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:0.0:1789130527.543852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.544328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.544410:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219200 00000100:00100000:2.0:1789130527.544424:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219200 00000100:00100000:2.0:1789130527.545349:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:2.0:1789130527.545372:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:48672:x1876037605219200:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130527.545623:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:48672:x1876037605219200:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 261us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.545630:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:3.0:1789130527.551346:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219072 00000100:00100000:3.0:1789130527.551367:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219072 00000100:00100000:3.0:1789130527.551454:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1789130527.551468:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:2370:x1876037605219072:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130527.551728:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130527.551764:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1600/0x5c74554e47cecb03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb74 expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.551789:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:3.0:1789130527.551795:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130527.551869:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:2370:x1876037605219072:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 404us (8035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130527.551878:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1789130527.809493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.809699:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219456 00000100:00100000:2.0:1789130527.809713:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219456 00000100:00100000:2.0:1789130527.809928:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:2.0:1789130527.809943:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:48692:x1876037605219456:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130527.809974:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130527.809978:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130527.810014:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cec990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb20 expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810038:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130527.810044:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130527.810062:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecb11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb7b expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810480:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810496:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 5 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810506:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810561:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 5 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.810579:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 5 pid: 45555 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.810593:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef8780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626917760:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130527.810915:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130527.818471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130527.818591:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219584 00000100:00100000:1.0:1789130527.818639:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219584 00010000:00010000:1.0:1789130527.818727:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 6 pid: 45555 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130527.818781:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00080000:0.0:1789130527.818915:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130527.818949:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605219584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130527.818971:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130527.818980:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 6 pid: 45555 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.818997:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 6 pid: 45555 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.819028:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:1.0:1789130527.819034:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.819044:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.819052:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.819076:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130527.819189:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605219584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 398us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130527.819199:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00010000:00010000:2.0:1789130527.819397:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0000/0x5c74554e47cecae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb6d expref: 5 pid: 45555 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.819418:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef8780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626917760:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130527.819457:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.819467:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.819473:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.819501:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.819511:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.819519:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130527.821086:0:43679:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe7:0x0], index 0: 0 00010000:00010000:2.0:1789130527.821420:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821437:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821449:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821492:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821499:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821506:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821512:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce0a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130527.821517:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821525:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821547:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01200) 00010000:00010000:2.0:1789130527.821551:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130527.821557:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821568:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0a00/0x5c74554e47cecb18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130527.821583:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008596ac65 reply state 000000001ccf299f transno 34359738613 ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.821594:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789130527.821678:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecb11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 19 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821701:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.821710:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130527.821712:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130527.821714:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130527.822190:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:48692:x1876037605219456:12345-192.168.201.39@tcp:101:bash.0 Request processed in 11853us (12314us total) trans 34359738613 rc 0/0 00000100:00100000:2.0:1789130527.822202:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:1.0:1789130527.827156:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.827842:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219712 00000100:00100000:2.0:1789130527.827859:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219712 00010000:00010000:0.0:1789130527.827981:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.827997:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.828006:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.828014:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130527.828019:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.828028:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.828048:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b482b51d00) 00010000:00010000:0.0:1789130527.828051:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130527.828058:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.828066:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecb1f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.828197:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130527.828219:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605219712:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130527.828243:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130527.828268:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb82 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130527.828307:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130527.828332:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=1690s v=(0 0) 00010000:00010000:2.0:1789130527.828338:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130527.828349:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.828370:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.828385:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1000, rc 0) 00000100:00100000:2.0:1789130527.828495:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605219712:12345-192.168.201.39@tcp:101:bash.0 Request processed in 277us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.828504:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130527.831577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.832237:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219840 00000100:00100000:2.0:1789130527.832254:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219840 00000100:00100000:2.0:1789130527.832342:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130527.832356:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:48692:x1876037605219840:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130527.832382:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130527.832408:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb89 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.832449:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.832467:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130527.832472:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130527.832478:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 7 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.832721:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.832738:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 1790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.832756:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ef8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626917888:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130527.832883:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b383e28000 going to sleep for 11 seconds 00000100:00080000:1.0:1789130527.839142:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130527.839907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130527.840142:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ef8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626917888:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130527.840211:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 7 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130527.840240:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1600, rc 0) 00000100:00100000:1.0:1789130527.840326:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:48692:x1876037605219840:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7973us (8762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130527.840338:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789130527.841657:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605219968 00000100:00100000:3.0:1789130527.841671:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605219968 00010000:00010000:3.0:1789130527.841732:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 1790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130527.841770:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789130527.841781:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605219968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130527.841868:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130527.841899:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 1790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.841920:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 1790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.841950:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d74dd967/0x5c74554e47cecb34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb82 expref: 7 pid: 44793 timeout: 1790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.841970:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130527.841975:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130527.841985:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.841997:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.842045:0:43664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130527.842061:0:43664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:43664:1876037626918016:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130527.845240:0:43664:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130527.846214:0:43664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:43664:1876037626918016:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130527.846247:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130527.846323:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605219968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4542us (6423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130527.846338:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789130527.848331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.848410:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605220224 00000100:00100000:3.0:1789130527.848423:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605220224 00000100:00100000:3.0:1789130527.848498:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130527.848509:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:48692:x1876037605220224:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789130527.849048:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:48692:x1876037605220224:12345-192.168.201.39@tcp:35:bash.0 Request processed in 539us (728us total) trans 34359738614 rc 0/0 00000100:00100000:3.0:1789130527.849058:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130527.912883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.913008:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605220352 00000100:00100000:0.0:1789130527.913021:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605220352 00000100:00100000:0.0:1789130527.913108:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:0.0:1789130527.913122:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+19:48698:x1876037605220352:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130527.913157:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130527.913199:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb90 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913290:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913307:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913323:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130527.913402:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130527.913406:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130527.913435:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913467:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb90 expref: 21 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913497:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb90 expref: 20 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.913506:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:0.0:1789130527.913509:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130527.913514:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2800, rc 0) 00000100:00100000:0.0:1789130527.913665:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:48698:x1876037605220352:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 545us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130527.913673:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:2.0:1789130527.917665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.917980:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605220608 00000100:00100000:3.0:1789130527.917993:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605220608 00000100:00100000:3.0:1789130527.918067:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:3.0:1789130527.918079:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:48698:x1876037605220608:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130527.918107:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130527.918136:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecb50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb97 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.918275:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.918292:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.918302:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.918348:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.918366:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 21 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130527.918385:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626918144:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130527.918741:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130527.922557:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626918144:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130527.922736:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.923711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.924470:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605220736 00000100:00100000:3.0:1789130527.924545:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605220736 00010000:00010000:3.0:1789130527.924719:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 22 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.924982:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789130527.925007:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+22:2369:x1876037605220736:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130527.925028:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130527.925038:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 22 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925060:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 22 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925089:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecb26 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb7b expref: 22 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925112:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130527.925119:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925130:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925140:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.925286:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130527.925368:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:2369:x1876037605220736:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 373us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.925377:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00010000:00010000:3.0:1789130527.926569:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.926583:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130527.926891:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 19 00010000:00010000:0.0:1789130527.927275:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47cecb50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb97 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.927300:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb97 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.927310:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130527.927314:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789130527.927318:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:0.0:1789130527.927430:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:48698:x1876037605220608:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 9352us (9777us total) trans 34359738615 rc 0/0 00000100:00100000:0.0:1789130527.927441:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:2.0:1789130527.931029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.931122:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605220992 00000100:00100000:0.0:1789130527.931135:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605220992 00000100:00100000:0.0:1789130527.931310:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 285 00000100:00100000:0.0:1789130527.931325:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:48698:x1876037605220992:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130527.931361:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130527.931365:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130527.931402:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47cecb57 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb97 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.931422:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130527.931437:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130527.931456:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecb65 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acb9e expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.931600:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.931638:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.931651:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130527.931667:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 19 00010000:00010000:0.0:1789130527.932217:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecb65 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb9e expref: 23 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.932236:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb9e expref: 22 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.932245:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130527.932247:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130527.932250:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130527.932392:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+22:48698:x1876037605220992:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1070us (1376us total) trans 34359738616 rc 0/0 00000100:00100000:0.0:1789130527.932401:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 285 00000100:00100000:2.0:1789130527.937123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.937310:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221120 00000100:00100000:0.0:1789130527.937323:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221120 00000100:00100000:0.0:1789130527.937438:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:0.0:1789130527.937451:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:48698:x1876037605221120:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130527.937561:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130527.937595:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acba5 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.937703:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.937721:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.937745:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130527.937749:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130527.937754:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130527.937893:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:48698:x1876037605221120:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 444us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130527.937902:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:3.0:1789130527.941674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.941731:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221248 00000100:00100000:3.0:1789130527.941745:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221248 00000100:00100000:3.0:1789130527.941812:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789130527.941825:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605221248:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:3.0:1789130527.941885:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.941911:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.941922:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789130527.941928:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130527.941933:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.941979:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.941996:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 6 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130527.942013:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626918272:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130527.942116:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130527.945199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.945300:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221376 00000100:00100000:0.0:1789130527.945316:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221376 00002000:00100000:0.0:1789130527.945389:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe7:0x0] (0->18) req@ffff90b386f9f480 x1876037605221376/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:243/0 lens 512/0 e 0 to 0 dl 1789130538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130527.945410:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f9f480 with x1876037605221376 ext(0->18) 00010000:00010000:0.0:1789130527.945423:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 7 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.945444:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 7 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130527.945453:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386f9f480 00000100:00100000:0.0:1789130527.945509:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789130527.945521:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605221376:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:0.0:1789130527.946298:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605221376:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 776us (1106us total) trans 34359738386 rc 0/0 00000100:00100000:0.0:1789130527.946309:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:0.0:1789130527.946317:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe7:0x0] (0->18) req@ffff90b386f9f480 x1876037605221376/t34359738386(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:243/0 lens 512/448 e 0 to 0 dl 1789130538 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130527.946326:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f9f480 with x1876037605221376 ext(0->18) 00010000:00010000:0.0:1789130527.946333:0:44371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 9 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.946346:0:44371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 9 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130527.946352:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386f9f480 00000100:00100000:1.0:1789130527.949349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.949643:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221504 00000100:00100000:0.0:1789130527.949658:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221504 00010000:00010000:0.0:1789130527.949720:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 9 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130527.949771:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:0.0:1789130527.949783:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605221504:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130527.949804:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130527.949830:0:43665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe7:0x0] updating lvb size from disk: 0 -> 19 00002000:00010000:0.0:1789130527.949833:0:43665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe7:0x0] updating lvb mtime from disk: 0 -> 1789130527 00002000:00010000:0.0:1789130527.949835:0:43665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe7:0x0] updating lvb atime from disk: 0 -> 1789130527 00002000:00010000:0.0:1789130527.949838:0:43665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe7:0x0] updating lvb ctime from disk: 0 -> 1789130527 00010000:00010000:0.0:1789130527.949845:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 9 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.949860:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 9 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.949894:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130527.949899:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130527.949906:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.949916:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.949942:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130527.950007:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605221504:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 227us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130527.950016:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:2.0:1789130527.955216:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd585178/0x5c74554e47cecb3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acb89 expref: 8 pid: 44366 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.955254:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626918272:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130527.955292:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955307:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955314:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955361:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955369:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955377:0:44793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955385:0:44793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130527.955390:0:44793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955400:0:44793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.955423:0:44793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.959664:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c030ea61/0x5c74554e47cecb81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.959801:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605221248:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 17974us (18139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.959812:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130527.968691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.968938:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221760 00000100:00100000:3.0:1789130527.968951:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221760 00000100:00100000:3.0:1789130527.969027:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:3.0:1789130527.969040:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+23:48698:x1876037605221760:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:3.0:1789130527.969126:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x1a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb9e expref: 23 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130527.969473:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738617 00000001:00080000:3.0:1789130527.969549:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738618 00000001:00080000:3.0:1789130527.970232:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738619 00010000:00010000:3.0:1789130527.970302:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.970320:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.970330:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.970375:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 27 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.970395:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 27 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130527.970412:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626918400:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130527.970545:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130527.974104:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130527.974240:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626918400:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130527.974282:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.974299:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605221888 00000100:00100000:2.0:1789130527.974320:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605221888 00010000:00010000:2.0:1789130527.974383:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 28 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130527.974441:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:2.0:1789130527.974452:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:2370:x1876037605221888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130527.974467:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130527.974474:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 28 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.974496:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 28 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.974518:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecb7a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acba5 expref: 28 pid: 43679 timeout: 1791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.974544:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:2.0:1789130527.974550:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.974559:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.974567:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.974646:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130527.974656:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130527.974849:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738620 00010000:00010000:2.0:1789130527.974886:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130527.974957:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:2370:x1876037605221888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 505us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.974967:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000001:00080000:3.0:1789130527.975134:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738621 00000100:00100000:3.0:1789130527.975721:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626918528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130527.978666:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130527.978749:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626918528 00000100:00100000:2.0:1789130527.978763:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626918528 00000100:00100000:2.0:1789130527.978845:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130527.978859:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626918528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130527.978912:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0cb5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130527.978986:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626918528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.978994:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130527.979185:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626918528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789130527.979894:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738622 00000100:00100000:0.0:1789130527.980002:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe61c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626918656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130527.981504:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130527.981570:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaefb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130527.981642:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626918656 00000100:00100000:2.0:1789130527.981671:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626918656 00000100:00100000:2.0:1789130527.981817:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130527.981831:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626918656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130527.982114:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626918656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 285us (615us total) trans 34359738387 rc 0/0 00000100:00100000:2.0:1789130527.982132:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130527.982307:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe61c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626918656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789130527.982410:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738623 00010000:00010000:0.0:1789130527.982485:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982497:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982504:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982511:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130527.982516:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982524:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982551:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130527.982555:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130527.982562:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130527.982570:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecb88 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130527.982986:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x1b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130527.984692:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].8, 64 off8728 00000004:00080000:0.0:1789130527.984734:0:43683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1691082128920ns, next at 1692082119351ns, rc = 0 00000001:00080000:0.0:1789130527.984750:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738624 00010000:00010000:0.0:1789130527.985124:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130527.985130:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130527.985146:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecb6c lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb9e expref: 31 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130527.988264:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:48698:x1876037605221760:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 19209us (19573us total) trans 34359738625 rc 0/0 00000100:00100000:0.0:1789130527.988287:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000020:00080000:0.0:1789130527.988299:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789130527.990892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130527.990989:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605222016 00000100:00100000:2.0:1789130527.990999:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605222016 00000100:00100000:2.0:1789130527.991077:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 287 00000100:00100000:2.0:1789130527.991089:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:48698:x1876037605222016:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130527.991127:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130527.991151:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3e00/0x5c74554e47cecb8f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbac expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.991225:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3e00/0x5c74554e47cecb8f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbac expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.991240:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3e00/0x5c74554e47cecb8f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbac expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130527.991260:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130527.991264:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130527.991278:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc3e00, rc 0) 00000100:00100000:2.0:1789130527.991340:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:48698:x1876037605222016:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 254us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130527.991348:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 287 00000100:00100000:1.0:1789130527.994588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130527.994927:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605222272 00000100:00100000:0.0:1789130527.994938:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605222272 00000100:00100000:0.0:1789130527.994992:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789130527.995002:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:48698:x1876037605222272:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130527.995242:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:48698:x1876037605222272:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 243us (664us total) trans 34359738626 rc 0/0 00000100:00100000:0.0:1789130527.995249:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789130528.093722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.093799:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605222400 00000100:00100000:2.0:1789130528.093808:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605222400 00000100:00100000:2.0:1789130528.093863:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00100000:2.0:1789130528.093870:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:48708:x1876037605222400:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130528.093932:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.093946:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.093954:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.093974:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.093979:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.093983:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094067:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094074:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094080:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130528.094122:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094134:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094141:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094148:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094153:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.094157:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094164:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094175:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130528.094178:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.094182:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094188:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecb96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094200:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094205:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094210:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094214:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.094216:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094222:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094228:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b482b51800) 00010000:00010000:2.0:1789130528.094231:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.094233:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094242:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecb9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094258:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094265:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094270:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094275:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.094278:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094283:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094290:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.094292:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.094294:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.094301:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecba4 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130528.094681:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:48708:x1876037605222400:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 810us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130528.094689:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00100000:1.0:1789130528.155369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.155518:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605222528 00000100:00100000:2.0:1789130528.155567:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605222528 00000100:00100000:2.0:1789130528.156330:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 289 00000100:00100000:2.0:1789130528.156349:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:48714:x1876037605222528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130528.156379:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130528.156410:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbb3 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156508:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156534:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156549:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156569:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156577:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156584:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156748:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156757:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156768:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130528.156824:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 19 00000004:00200000:2.0:1789130528.156830:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130528.156852:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156866:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156875:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156881:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156888:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156894:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.156899:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156907:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156919:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130528.156922:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.156928:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156938:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156955:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156960:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156966:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156970:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.156973:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156979:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156986:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b482b51800) 00010000:00010000:2.0:1789130528.156989:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.156991:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.156997:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.157032:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbb3 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.157051:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbb3 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.157058:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.157060:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130528.157063:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc3800, rc 0) 00000100:00100000:2.0:1789130528.157156:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:48714:x1876037605222528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 815us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130528.157164:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 289 00000100:00100000:1.0:1789130528.163918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130528.164141:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605222784 00000100:00100000:0.0:1789130528.164166:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605222784 00000100:00100000:0.0:1789130528.164251:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 290 00000100:00100000:0.0:1789130528.164264:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:48714:x1876037605222784:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130528.164295:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130528.164332:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecbc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbba expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130528.164473:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecbce lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130528.164501:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecbce lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130528.164518:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecbce lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130528.164542:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 19 00010000:00010000:0.0:1789130528.164758:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecbc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbba expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130528.164777:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecbce lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbba expref: 35 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130528.164786:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:0.0:1789130528.164801:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130528.164806:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130528.164880:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:48714:x1876037605222784:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 618us (976us total) trans 34359738627 rc 0/0 00000100:00100000:0.0:1789130528.164888:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 290 00000100:00100000:1.0:1789130528.168948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130528.169032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.169116:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223168 00000100:00100000:2.0:1789130528.169129:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223168 00000100:00100000:2.0:1789130528.169280:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789130528.169297:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:2367:x1876037605223168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130528.169320:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130528.169355:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecbce lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbba expref: 35 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.169377:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.169383:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130528.169457:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:2367:x1876037605223168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 165us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130528.169466:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789130528.169996:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223040 00000100:00100000:0.0:1789130528.170003:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223040 00000100:00100000:0.0:1789130528.170057:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1789130528.170067:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:48714:x1876037605223040:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130528.170385:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:48714:x1876037605223040:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 319us (1451us total) trans 34359738628 rc 0/0 00000100:00100000:0.0:1789130528.170394:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000040:00080000:0.0:1789130528.326391:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130528.326405:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130528.326452:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:0.0:1789130528.326462:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130528.337072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.337876:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223424 00000100:00100000:2.0:1789130528.337894:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223424 00000100:00100000:2.0:1789130528.338001:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 291 00000100:00100000:2.0:1789130528.338014:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:48730:x1876037605223424:12345-192.168.201.39@tcp:36:truncate.0 00010000:00010000:2.0:1789130528.338093:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130528.338131:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbc0 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbb3 expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.338158:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.338164:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130528.338474:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.338492:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.338505:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130528.338578:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738629 00000004:00010000:2.0:1789130528.338668:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d1163c81 reply state 00000000bb441597 transno 34359738630 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130528.338680:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130528.339345:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:48730:x1876037605223424:12345-192.168.201.39@tcp:36:truncate.0 Request processed in 1330us (2287us total) trans 34359738630 rc 0/0 00000100:00100000:2.0:1789130528.339358:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 291 00000020:00080000:2.0:1789130528.339364:0:43680:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130528.345313:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345335:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345343:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345350:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130528.345356:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345365:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345394:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:1.0:1789130528.345398:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130528.345404:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.345411:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecbdc lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130528.391977:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130528.448129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.448355:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223552 00000100:00100000:2.0:1789130528.448369:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223552 00000100:00100000:2.0:1789130528.448462:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 292 00000100:00100000:2.0:1789130528.448483:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:48740:x1876037605223552:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789130528.448633:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448656:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448674:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448694:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448702:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448709:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448844:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448854:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448861:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130528.448915:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448931:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448942:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448950:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448956:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.448961:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448968:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448981:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130528.448984:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.448990:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.448996:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449012:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449018:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449024:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449030:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.449034:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449040:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449048:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b482b51800) 00010000:00010000:2.0:1789130528.449050:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.449053:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449059:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449080:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449086:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449092:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449098:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.449101:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449108:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449115:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.449118:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.449121:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.449127:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3a00/0x5c74554e47cecbf1 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130528.449399:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:48740:x1876037605223552:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 925us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130528.449409:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 292 00000100:00100000:0.0:1789130528.794159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130528.794211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130528.794263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130528.794327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130528.794385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.794403:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224192 00000100:00100000:0.0:1789130528.794414:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223808 00000100:00100000:2.0:1789130528.794417:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224192 00000100:00100000:0.0:1789130528.794420:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223808 00000100:00100000:3.0:1789130528.794532:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223680 00000100:00100000:3.0:1789130528.794537:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223680 00000100:00100000:3.0:1789130528.794579:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:3.0:1789130528.794591:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605223680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130528.794718:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605223680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 128us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130528.794726:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:1.0:1789130528.795007:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605223936 00000100:00100000:1.0:1789130528.795013:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605223936 00000100:00100000:1.0:1789130528.795056:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224064 00000100:00100000:1.0:1789130528.795059:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224064 00000100:00100000:1.0:1789130528.795100:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130528.795109:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605223936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130528.795155:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605223936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 48us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130528.795162:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789130528.795193:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1789130528.795201:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605224064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130528.795230:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605224064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130528.795241:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00080000:1.0:1789130528.795341:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130528.797831:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130528.797881:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:2367:x1876037605223808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130528.797921:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789130528.797936:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605224192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130528.798061:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:2367:x1876037605223808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 217us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130528.798071:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789130528.799215:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605224192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1275us (4941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130528.799237:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789130528.826298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130528.826444:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224448 00000100:00100000:2.0:1789130528.826457:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224448 00000100:00100000:2.0:1789130528.826543:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 293 00000100:00100000:2.0:1789130528.826553:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:48757:x1876037605224448:12345-192.168.201.39@tcp:101:multiop.0 00010000:00010000:2.0:1789130528.826577:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130528.826579:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130528.826628:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecb49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb90 expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.826646:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01d00) 00010000:00010000:2.0:1789130528.826658:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130528.826673:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbf8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbc1 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.826851:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.826989:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827005:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827022:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827029:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827037:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827115:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2c00/0x5c74554e47cecc0d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827122:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2c00/0x5c74554e47cecc0d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827126:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2c00/0x5c74554e47cecc0d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130528.827134:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 4 00010000:00010000:2.0:1789130528.827280:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827289:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827294:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827297:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.827300:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827306:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.827313:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130528.827315:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.829512:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829545:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3800/0x5c74554e47cecbff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829577:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829584:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829593:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829599:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130528.829622:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829631:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829650:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b482b51600) 00010000:00010000:2.0:1789130528.829653:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130528.829658:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829665:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3c00/0x5c74554e47cecc06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829759:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2a00/0x5c74554e47cecbf8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc1 expref: 38 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829781:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2c00/0x5c74554e47cecc0d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc1 expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130528.829789:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789130528.829792:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130528.829795:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc2c00, rc 0) 00000100:00100000:2.0:1789130528.830132:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+37:48757:x1876037605224448:12345-192.168.201.39@tcp:101:multiop.0 Request processed in 3576us (3846us total) trans 34359738631 rc 0/0 00000100:00100000:2.0:1789130528.830208:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 293 00010000:00010000:1.0:1789130529.414047:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130529.542147:0:43702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1692639540857ns, next at 1693639537618ns, rc = 0 00000100:00100000:0.0:1789130529.542464:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130529.542495:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626918784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130529.542670:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130529.542905:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626918784 00000100:00100000:3.0:1789130529.542916:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626918784 00000100:00100000:3.0:1789130529.543006:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130529.543020:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626918784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130529.543053:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130529.543115:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626918784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130529.543124:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130529.543417:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626918784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789130529.543524:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789130530.373946:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1789130530.373960:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130530.374005:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 7 00000040:00080000:0.0:1789130530.374016:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:1.0:1789130530.438499:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130531.462633:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130531.695484:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738386 is committed 00000001:00080000:0.0:1789130531.695508:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738387 is committed 00000001:00080000:0.0:1789130531.727953:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738628 is committed 00000004:00080000:0.0:1789130531.727992:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789130531.728025:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4afaefcc0 refcount 2 committed 0 result 0 batchid 30064771684 00000020:00080000:0.0:1789130531.728032:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4afaef300 00000020:00080000:0.0:1789130531.728036:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b394c03000 00000001:00080000:0.0:1789130531.728067:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738631 is committed 00000004:00080000:0.0:1789130531.728086:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:3.0:1789130531.728486:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130531.728516:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626918912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130531.728645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130531.728739:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626918912 00000100:00100000:3.0:1789130531.728749:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626918912 00000100:00100000:3.0:1789130531.728827:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130531.728840:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626918912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130531.728877:0:44367:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:231 count 1 00002000:00010000:3.0:1789130531.728925:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe7:0x0] initial LVB size: 19, mtime: 0x6aa3f71f, atime: 0x6aa3f71f, ctime: 0x6aa3f71f, blocks: 0xb 00010000:00010000:3.0:1789130531.728935:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.728957:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=1694s v=(0 0) 00010000:00010000:3.0:1789130531.728962:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130531.728971:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.728991:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729002:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729010:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729033:0:44367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130531.729701:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626918912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 861us (1053us total) trans 34359738388 rc 0/0 00000100:00100000:3.0:1789130531.729716:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789130531.729753:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130531.729775:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130531.729783:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729794:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130531.729799:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729810:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729832:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729841:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac221064/0x5c74554e47cecc1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130531.729866:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130531.729868:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130531.729870:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130531.729912:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738387 gen 2 00000004:00080000:3.0:1789130531.729920:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738387 committed transno 34359738387 00000100:00100000:3.0:1789130531.729952:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b386f9e580 x1876037626918912/t34359738388(34359738388) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130547 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789130531.729966:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386f9e580/2, rc 0, transno 34359738388 00000100:00100000:3.0:1789130531.729974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626918912:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789130531.731708:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771684 committed batchid 30064771683 00000020:00080000:2.0:1789130531.731995:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771683 00000100:00100000:3.0:1789130532.101948:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130532.101981:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626919040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130532.102090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130532.102408:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919040 00000100:00100000:0.0:1789130532.102419:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919040 00000100:00100000:0.0:1789130532.102523:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130532.102541:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626919040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130532.102591:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130532.102678:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626919040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130532.102687:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130532.102746:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626919040:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130532.103188:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130532.105726:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626919424:0@lo:400:kworker.0 00000100:00100000:0.0:1789130532.105822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130532.105874:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130532.105880:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130532.105912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130532.105964:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919296 00000100:00100000:0.0:1789130532.105973:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919296 00000100:00100000:0.0:1789130532.106041:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130532.106052:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626919296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130532.106115:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626919296:12345-0@lo:400:kworker.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130532.106123:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130532.106483:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626919168:0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130532.106568:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626919680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130532.106642:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130532.106648:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626919552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130532.106705:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919424 00000100:00100000:3.0:1789130532.106710:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919424 00000100:00100000:3.0:1789130532.106743:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919680 00000100:00100000:3.0:1789130532.106746:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919680 00000100:00100000:3.0:1789130532.106769:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919552 00000100:00100000:3.0:1789130532.106773:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919552 00000100:00100000:3.0:1789130532.106790:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130532.106797:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626919424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106839:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626919424:12345-0@lo:400:kworker.0 Request processed in 42us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130532.106846:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130532.106863:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130532.106870:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626919680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106903:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626919680:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130532.106913:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130532.106925:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789130532.106935:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626919552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.106964:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626919552:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130532.106969:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789130532.106987:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130532.107017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626919552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130532.107029:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626919680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130532.107147:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130532.107164:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626919424:0@lo:400:kworker.0 00000100:00100000:2.0:1789130532.107670:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919168 00000100:00100000:2.0:1789130532.107677:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919168 00000100:00100000:2.0:1789130532.107729:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789130532.107738:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626919168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130532.107804:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626919168:12345-0@lo:400:kworker.0 Request processed in 67us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130532.107811:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789130532.109358:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626919168:0@lo:400:kworker.0 00010000:00010000:1.0:1789130532.488562:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130533.511533:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130533.913754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130533.913796:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130533.913838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130533.913871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130533.913893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130533.913924:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224704 00000100:00100000:2.0:1789130533.913934:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224704 00000100:00100000:2.0:1789130533.913989:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605225088 00000100:00100000:2.0:1789130533.913992:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605225088 00000100:00100000:2.0:1789130533.914045:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130533.914054:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605224704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130533.914131:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605224704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130533.914139:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130533.914155:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130533.914161:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605225088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130533.914183:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605225088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130533.914189:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00080000:2.0:1789130533.914205:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130533.914388:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224960 00000100:00100000:1.0:1789130533.914393:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224960 00000100:00100000:1.0:1789130533.914447:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224832 00000100:00100000:1.0:1789130533.914451:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224832 00000100:00100000:1.0:1789130533.914474:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130533.914481:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605224960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130533.914516:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605224960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130533.914523:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789130533.914548:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789130533.914554:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605224832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130533.914651:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605224832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 96us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130533.914658:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789130533.914774:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605224576 00000100:00100000:0.0:1789130533.914779:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605224576 00000100:00100000:0.0:1789130533.914822:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:0.0:1789130533.914830:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605224576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130533.914863:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605224576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130533.914870:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00080000:2.0:1789130533.915327:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130533.915332:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789130534.533845:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130534.661855:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130534.661890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130534.661962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130534.662334:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919808 00000100:00100000:0.0:1789130534.662343:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919808 00000100:00100000:0.0:1789130534.662435:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130534.662449:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626919808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130534.662483:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130534.662538:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626919808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130534.662556:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130534.662596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789130534.663022:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130534.880005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130534.880480:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605225344 00000100:00100000:1.0:1789130534.880490:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605225344 00000100:00100000:1.0:1789130534.880550:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789130534.880559:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:44607:x1876037605225344:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789130534.887111:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:44607:x1876037605225344:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 6538us (7101us total) trans 34359738632 rc 0/0 00000100:00100000:1.0:1789130534.887129:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130534.893005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130534.893089:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605225600 00000100:00100000:1.0:1789130534.893100:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605225600 00000100:00100000:1.0:1789130534.893166:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789130534.893177:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:44607:x1876037605225600:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789130534.893510:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:44607:x1876037605225600:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 334us (516us total) trans 34359738633 rc 0/0 00000100:00100000:1.0:1789130534.893519:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789130534.896970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130534.897075:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605225856 00000100:00100000:1.0:1789130534.897085:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605225856 00000100:00100000:1.0:1789130534.897183:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130534.897195:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:44607:x1876037605225856:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789130534.897766:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:44607:x1876037605225856:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 571us (804us total) trans 34359738634 rc 0/0 00000100:00100000:1.0:1789130534.897774:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789130534.902697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130534.903542:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605225984 00000100:00100000:1.0:1789130534.903554:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605225984 00000100:00100000:1.0:1789130534.903651:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789130534.903662:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389409e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:44607:x1876037605225984:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130534.903679:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 12 locks, starting at 0 00010000:00010000:1.0:1789130534.903708:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2c00/0x5c74554e47cecc0d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc1 expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903738:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3e00/0x5c74554e47cecb8f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbac expref: 19 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903748:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b482b51300) 00010000:00010000:1.0:1789130534.903765:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1800/0x5c74554e47cec79f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca8d expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903775:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b48a1fde00) 00010000:00010000:1.0:1789130534.903786:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecabd lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb66 expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903798:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ceca77 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x17:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb58 expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903809:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ceca00 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x17:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acb43 expref: 15 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903818:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x17:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130534.903830:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47cec783 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca86 expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903839:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130534.903848:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cec752 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca78 expref: 13 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903867:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cec6e9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca63 expref: 12 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903877:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x14:0x0].0x0 (ffff90b48a1fd800) 00010000:00010000:1.0:1789130534.903886:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cec6a3 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca55 expref: 11 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903899:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cec68e lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca4e expref: 10 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903912:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cec65d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aca40 expref: 9 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130534.903921:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x10:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130534.903973:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130534.904036:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389409e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:44607:x1876037605225984:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 376us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130534.904043:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789130535.068441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130535.068566:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226112 00000100:00100000:2.0:1789130535.068574:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226112 00000100:00100000:2.0:1789130535.068701:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 294 00000100:00100000:2.0:1789130535.068712:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:48796:x1876037605226112:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130535.068733:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130535.068751:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2400/0x5c74554e47cecc22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbc8 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130535.068804:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130535.068815:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130535.068823:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130535.068994:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130535.068998:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130535.069052:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130535.069072:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2400/0x5c74554e47cecc22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc8 expref: 10 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130535.069085:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc8 expref: 9 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130535.069092:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130535.069096:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130535.069100:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130535.069103:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc2000, rc 0) 00000100:00100000:2.0:1789130535.069154:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:48796:x1876037605226112:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 446us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130535.069159:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 294 00000100:00100000:2.0:1789130535.073636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130535.073779:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226240 00000100:00100000:0.0:1789130535.073789:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226240 00000100:00100000:0.0:1789130535.073843:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 295 00000100:00100000:0.0:1789130535.073850:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:48796:x1876037605226240:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130535.073934:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.073966:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.073979:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.073991:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.073996:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074018:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074354:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074363:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074388:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130535.074441:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074451:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074455:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074463:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074467:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130535.074470:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074475:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074483:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:0.0:1789130535.074485:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130535.074488:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074491:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074500:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074504:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074507:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074510:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130535.074511:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074517:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074522:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b497c01100) 00010000:00010000:0.0:1789130535.074523:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130535.074524:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074527:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074537:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074540:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074543:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074545:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130535.074547:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074550:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074554:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130535.074556:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130535.074557:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130535.074570:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc3e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130535.074691:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:48796:x1876037605226240:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 840us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130535.074697:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 295 00000100:00100000:3.0:1789130535.242731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130535.246279:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226368 00000100:00100000:1.0:1789130535.246295:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226368 00000100:00100000:1.0:1789130535.246390:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 296 00000100:00100000:1.0:1789130535.246409:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:48757:x1876037605226368:12345-192.168.201.39@tcp:101:multiop.0 00010000:00010000:1.0:1789130535.246433:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130535.246458:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cecc45 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbcf expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130535.246542:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cecc45 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbcf expref: 10 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130535.246559:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ea00/0x5c74554e47cecc45 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbcf expref: 10 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130535.246578:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:1.0:1789130535.246581:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130535.246584:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ea00, rc 0) 00000100:00100000:1.0:1789130535.246684:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b389408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:48757:x1876037605226368:12345-192.168.201.39@tcp:101:multiop.0 Request processed in 285us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130535.246691:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 296 00000100:00100000:2.0:1789130535.264997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130535.265192:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226624 00000100:00100000:1.0:1789130535.265203:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226624 00000100:00100000:1.0:1789130535.265307:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:1.0:1789130535.265317:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:48757:x1876037605226624:12345-192.168.201.39@tcp:35:multiop.0 00000100:00100000:1.0:1789130535.265635:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:48757:x1876037605226624:12345-192.168.201.39@tcp:35:multiop.0 Request processed in 319us (647us total) trans 34359738635 rc 0/0 00000100:00100000:1.0:1789130535.265644:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00010000:00010000:3.0:1789130535.557879:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130536.581873:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130536.743184:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738635 is committed 00000020:00080000:2.0:1789130536.743209:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771684 batchid updated 00000020:00080000:2.0:1789130536.743226:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771684 00000020:00080000:2.0:1789130536.743235:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771684 00000001:00080000:1.0:1789130536.752026:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738388 is committed 00000100:00100000:3.0:1789130537.221946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130537.222067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130537.222230:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626919936 00000100:00100000:1.0:1789130537.222248:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626919936 00000100:00100000:1.0:1789130537.222357:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789130537.222383:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626919936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130537.222436:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130537.222704:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626920192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.222746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130537.222782:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130537.222788:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626920064:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.222822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130537.222872:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920192 00000100:00100000:0.0:1789130537.222877:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920192 00000100:00100000:0.0:1789130537.222918:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130537.222928:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626920192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.222972:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626920192:12345-0@lo:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130537.222981:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130537.223022:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738388 gen 2 00000004:00080000:0.0:1789130537.223028:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386f9e580, transno 34359738388 00000100:00100000:0.0:1789130537.223043:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626920192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.223095:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920064 00000100:00100000:0.0:1789130537.223101:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920064 00000100:00100000:0.0:1789130537.223130:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789130537.223136:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626920064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.223175:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626920064:12345-0@lo:400:kworker.0 Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130537.223182:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789130537.223209:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130537.223214:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130537.223233:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626920064:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.223261:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626920320:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.223293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130537.226110:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626919936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3727us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130537.226132:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789130537.226374:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626919936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130537.227037:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920320 00000100:00100000:3.0:1789130537.227047:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920320 00000100:00100000:3.0:1789130537.227157:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130537.227169:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626920320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130537.227291:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626920320:12345-0@lo:400:kworker.0 Request processed in 124us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130537.227300:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789130537.227827:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626920320:0@lo:400:kworker.0 00000100:00100000:1.0:1789130537.227997:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626920576:0@lo:400:kworker.0 00000100:00100000:1.0:1789130537.228071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130537.228124:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626920448:0@lo:400:kworker.0 00000100:00100000:1.0:1789130537.228966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130537.229020:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920576 00000100:00100000:0.0:1789130537.229041:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920576 00000100:00100000:0.0:1789130537.229110:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130537.229124:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.229199:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626920576:12345-0@lo:400:kworker.0 Request processed in 80us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130537.229208:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789130537.229234:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130537.229281:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626920576:0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.230859:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920448 00000100:00100000:0.0:1789130537.230872:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920448 00000100:00100000:0.0:1789130537.230943:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130537.230954:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626920448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130537.231040:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626920448:12345-0@lo:400:kworker.0 Request processed in 80us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130537.231048:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1789130537.231109:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130537.231142:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626920448:0@lo:400:kworker.0 00010000:00010000:3.0:1789130537.606319:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130538.354941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130538.355036:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226752 00000100:00100000:3.0:1789130538.355046:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226752 00000100:00100000:3.0:1789130538.355132:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 297 00000100:00100000:3.0:1789130538.355142:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:48821:x1876037605226752:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789130538.355229:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355245:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355257:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355272:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355279:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355285:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355890:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355909:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355915:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130538.355967:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355983:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355989:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.355995:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356000:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130538.356004:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356015:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356028:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:3.0:1789130538.356030:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130538.356041:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356047:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecc4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356067:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356074:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356079:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356089:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130538.356092:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356098:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356106:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b488939200) 00010000:00010000:3.0:1789130538.356109:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130538.356112:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356117:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356139:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356146:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356152:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356157:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130538.356160:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356166:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356174:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789130538.356176:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130538.356180:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.356185:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc5a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130538.356265:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:48821:x1876037605226752:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1124us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130538.356273:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 297 00000100:00080000:1.0:1789130538.356418:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130538.414487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130538.418690:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605226880 00000100:00100000:0.0:1789130538.418708:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605226880 00000100:00100000:0.0:1789130538.418792:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 298 00000100:00100000:0.0:1789130538.418804:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:48827:x1876037605226880:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130538.418828:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130538.418851:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbd6 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418921:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418935:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418947:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418964:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418971:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.418978:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419320:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419329:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419336:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130538.419385:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 4 00000004:00200000:0.0:1789130538.419390:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130538.419407:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419418:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419427:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419432:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419438:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419444:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130538.419448:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419456:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419467:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:0.0:1789130538.419470:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130538.419474:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419480:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecc68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419496:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419503:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419508:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419513:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130538.419515:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419521:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419528:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b497c01300) 00010000:00010000:0.0:1789130538.419531:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130538.419534:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419540:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419569:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419581:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 8 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.419591:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130538.419593:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130538.419595:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130538.419713:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:48827:x1876037605226880:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 911us (5236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130538.419722:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 298 00000100:00100000:2.0:1789130538.423556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130538.423750:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227136 00000100:00100000:3.0:1789130538.423761:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227136 00000100:00100000:3.0:1789130538.423837:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 299 00000100:00100000:3.0:1789130538.423848:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:48827:x1876037605227136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130538.423867:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130538.423887:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbdd expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.423983:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.423999:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.424006:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.424040:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130538.424053:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 9 pid: 43679 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130538.424065:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626920704:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130538.424149:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130538.427822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130538.428060:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38947c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626920704:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130538.428090:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130538.428177:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227264 00000100:00100000:2.0:1789130538.428185:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227264 00010000:00010000:2.0:1789130538.428227:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 10 pid: 43679 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130538.428268:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1789130538.428278:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605227264:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130538.428292:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130538.428298:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 10 pid: 43679 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428326:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 10 pid: 43679 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428361:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecc76 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbd6 expref: 10 pid: 43679 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428376:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:2.0:1789130538.428381:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428389:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428397:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130538.428429:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130538.428501:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605227264:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130538.428509:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00010000:00010000:0.0:1789130538.428821:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.428829:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130538.428856:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1a:0x0]: returning size 4 00010000:00010000:0.0:1789130538.429072:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecc7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbdd expref: 10 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.429096:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5c00/0x5c74554e47cecc84 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbdd expref: 9 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.429103:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130538.429106:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789130538.429109:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5c00, rc 0) 00000100:00100000:0.0:1789130538.429148:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:48827:x1876037605227136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5302us (5601us total) trans 34359738636 rc 0/0 00000100:00100000:0.0:1789130538.429156:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 299 00000100:00100000:3.0:1789130538.482830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130538.483034:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227392 00000100:00100000:0.0:1789130538.483044:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227392 00000100:00100000:0.0:1789130538.483102:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 300 00000100:00100000:0.0:1789130538.483113:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:48837:x1876037605227392:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130538.483187:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483203:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483215:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483230:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483237:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483244:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483581:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483592:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.483599:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130538.484777:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484790:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484797:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484805:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484811:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130538.484815:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484822:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484836:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:0.0:1789130538.484838:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130538.484843:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484849:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecc92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484863:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484870:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484876:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484881:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130538.484884:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484890:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484897:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d1d8ab3 (ffff90b497c01300) 00010000:00010000:0.0:1789130538.484900:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130538.484903:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484909:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecc99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d1d8ab3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484925:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484931:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484937:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484942:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130538.484945:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484955:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484962:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1a:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789130538.484964:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130538.484968:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130538.484974:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecca0 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130538.485057:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38947c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:48837:x1876037605227392:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1943us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130538.485068:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 300 00010000:00010000:1.0:1789130538.630954:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130539.035652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130539.035720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130539.035759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130539.035792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130539.035814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130539.035944:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227648 00000100:00100000:0.0:1789130539.035954:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227648 00000100:00100000:0.0:1789130539.036012:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228032 00000100:00100000:0.0:1789130539.036016:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228032 00000100:00100000:0.0:1789130539.036048:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789130539.036058:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605227648:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130539.036109:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227520 00000100:00100000:3.0:1789130539.036115:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227520 00000100:00100000:0.0:1789130539.036135:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605227648:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 78us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130539.036143:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:3.0:1789130539.036154:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:3.0:1789130539.036165:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605227520:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130539.036167:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:0.0:1789130539.036181:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605228032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130539.036204:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605227520:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130539.036215:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789130539.036215:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605228032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130539.036230:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789130539.036254:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227904 00000100:00100000:3.0:1789130539.036259:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227904 00000100:00100000:3.0:1789130539.036290:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605227776 00000100:00100000:3.0:1789130539.036294:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605227776 00000100:00100000:3.0:1789130539.036326:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789130539.036344:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605227904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130539.036375:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605227904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130539.036382:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789130539.036399:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:3.0:1789130539.036407:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605227776:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789130539.036515:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130539.036520:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130539.036522:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130539.036995:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605227776:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 586us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130539.037004:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:3.0:1789130539.653900:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130539.784732:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130539.784864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130539.785027:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920832 00000100:00100000:0.0:1789130539.785039:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920832 00000100:00100000:0.0:1789130539.785136:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130539.785399:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626920832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130539.785464:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130539.785555:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626920832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130539.785566:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789130539.785599:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130539.785680:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626920832:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789130540.619665:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130540.619678:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130540.620090:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 6 00000040:00080000:1.0:1789130540.620098:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:1.0:1789130540.681505:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130541.702084:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789130541.921911:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738636 is committed 00000100:00100000:3.0:1789130542.342157:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130542.342202:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130542.342334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130542.342519:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626920960 00000100:00100000:0.0:1789130542.342531:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626920960 00000100:00100000:0.0:1789130542.342637:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130542.342649:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626920960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130542.342701:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130542.342760:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626920960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130542.342768:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789130542.345355:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130542.345474:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130542.359746:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626921216:0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.359855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130542.360006:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921216 00000100:00100000:3.0:1789130542.360017:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921216 00000100:00100000:3.0:1789130542.360113:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789130542.360130:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626921216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.360222:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626921216:12345-0@lo:400:kworker.0 Request processed in 97us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130542.360256:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789130542.360302:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130542.360374:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626921216:0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.360459:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626921344:0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.360508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130542.360563:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921344 00000100:00100000:3.0:1789130542.360570:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921344 00000100:00100000:3.0:1789130542.360663:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130542.360674:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626921344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.360730:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626921344:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130542.360739:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130542.360782:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626921344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.362439:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626921088:0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.362533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130542.362594:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626921600:0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.362658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130542.362688:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130542.362696:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626921472:0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.362722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130542.362757:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921600 00000100:00100000:2.0:1789130542.362766:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921600 00000100:00100000:2.0:1789130542.362826:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921472 00000100:00100000:2.0:1789130542.362829:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921472 00000100:00100000:2.0:1789130542.362868:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130542.362883:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.362989:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626921600:12345-0@lo:400:kworker.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130542.363001:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130542.363026:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130542.363034:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626921472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.363076:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626921472:12345-0@lo:400:kworker.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130542.363086:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789130542.363118:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130542.363165:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626921472:0@lo:400:kworker.0 00000100:00100000:2.0:1789130542.363183:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626921600:0@lo:400:kworker.0 00000100:00100000:1.0:1789130542.363771:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921088 00000100:00100000:1.0:1789130542.363780:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921088 00000100:00100000:1.0:1789130542.363853:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789130542.363865:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626921088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130542.365081:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626921088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130542.365216:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3812f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626921088:12345-0@lo:400:kworker.0 Request processed in 1350us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130542.365323:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:1.0:1789130542.726018:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130543.750930:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130544.156648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130544.156713:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130544.156728:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228288 00000100:00100000:1.0:1789130544.156744:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228288 00000100:00100000:0.0:1789130544.156763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130544.156791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130544.156822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130544.156870:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228544 00000100:00100000:3.0:1789130544.156876:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228544 00000100:00100000:3.0:1789130544.156914:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228416 00000100:00100000:3.0:1789130544.156918:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228416 00000100:00100000:3.0:1789130544.156945:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789130544.156957:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605228544:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:2.0:1789130544.156973:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130544.156980:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130544.156983:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130544.157058:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605228544:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 104us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130544.157067:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789130544.157087:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:3.0:1789130544.157095:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605228416:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130544.157118:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605228416:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130544.157124:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789130544.159161:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228160 00000100:00100000:0.0:1789130544.159178:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228160 00000100:00100000:0.0:1789130544.159233:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:0.0:1789130544.159252:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605228160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130544.159338:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605228160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 95us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130544.159347:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:1.0:1789130544.159479:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228672 00000100:00100000:1.0:1789130544.159486:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228672 00000100:00100000:1.0:1789130544.159539:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:1.0:1789130544.159550:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605228288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130544.160679:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605228288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1031us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130544.160695:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:1.0:1789130544.160735:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789130544.160749:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605228672:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130544.160786:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605228672:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130544.160793:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00080000:2.0:1789130544.161230:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130544.781097:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130544.907750:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130544.907777:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626921728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130544.907977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130544.908161:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921728 00000100:00100000:0.0:1789130544.908169:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921728 00000100:00100000:0.0:1789130544.908243:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130544.908252:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626921728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130544.908285:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130544.908326:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626921728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130544.908334:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789130544.908473:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130544.908507:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626921728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130545.512893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130545.512991:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605228800 00000100:00100000:1.0:1789130545.513001:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605228800 00000100:00100000:1.0:1789130545.513058:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 301 00000100:00100000:1.0:1789130545.513068:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:48672:x1876037605228800:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789130545.513167:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:48672:x1876037605228800:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130545.513182:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 301 00000100:00100000:1.0:1789130545.535036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130545.536349:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229056 00000100:00100000:2.0:1789130545.536362:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229056 00000100:00100000:2.0:1789130545.536427:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789130545.536437:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:48672:x1876037605229056:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130545.537207:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:48672:x1876037605229056:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 768us (2178us total) trans 34359738637 rc 0/0 00000100:00100000:2.0:1789130545.537226:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00010000:00010000:3.0:1789130545.799399:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130546.010084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130546.010181:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229184 00000100:00100000:2.0:1789130546.010194:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229184 00000100:00100000:2.0:1789130546.010304:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 302 00000100:00100000:2.0:1789130546.010319:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:49279:x1876037605229184:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1789130546.010347:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130546.010375:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47cecca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbe4 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.010463:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.010480:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.010497:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130546.010847:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130546.010853:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130546.010947:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.010980:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47cecca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 7 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.011000:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 6 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130546.011010:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130546.011013:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130546.011017:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc3600, rc 0) 00000100:00100000:2.0:1789130546.011166:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49279:x1876037605229184:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 851us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130546.011175:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 302 00000100:00080000:0.0:1789130546.011452:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130546.821911:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130547.060111:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738637 is committed 00000100:00100000:3.0:1789130547.462377:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130547.462411:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626921856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130547.462524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130547.463196:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921856 00000100:00100000:0.0:1789130547.463214:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921856 00000100:00100000:0.0:1789130547.463314:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789130547.463327:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626921856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130547.463374:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130547.463450:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626921856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130547.463462:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789130547.463697:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130547.463923:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626921856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130547.469753:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626922368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.469868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130547.469943:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130547.469950:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.469983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130547.470020:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922368 00000100:00100000:2.0:1789130547.470028:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922368 00000100:00100000:2.0:1789130547.470094:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789130547.470105:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626922368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.470164:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626922368:12345-0@lo:400:kworker.0 Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130547.470177:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789130547.470210:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922240 00000100:00100000:2.0:1789130547.470213:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922240 00000100:00100000:2.0:1789130547.470250:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130547.470257:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7864050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.470287:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7864050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626922240:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130547.470293:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1789130547.471861:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130547.471922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.471939:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626922368:0@lo:400:kworker.0 00000100:00100000:3.0:1789130547.472366:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626922112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130547.472438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130547.472498:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789130547.472507:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626921984:0@lo:400:kworker.0 00000100:00100000:3.0:1789130547.472547:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130547.472570:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626922496:0@lo:400:kworker.0 00000100:00100000:3.0:1789130547.472592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130547.472659:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922496 00000100:00100000:3.0:1789130547.472666:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922496 00000100:00100000:3.0:1789130547.472723:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789130547.472733:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626922496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130547.472791:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626922496:12345-0@lo:400:kworker.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130547.472799:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789130547.472823:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130547.472854:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626922496:0@lo:400:kworker.0 00000100:00100000:0.0:1789130547.475580:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626921984 00000100:00100000:0.0:1789130547.475615:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626921984 00000100:00100000:0.0:1789130547.475695:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789130547.475706:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626921984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130547.476020:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626921984:12345-0@lo:400:kworker.0 Request processed in 313us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130547.476029:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789130547.476869:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.477363:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922112 00000100:00100000:2.0:1789130547.477374:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922112 00000100:00100000:2.0:1789130547.477470:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789130547.477482:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626922112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130547.479101:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626922112:12345-0@lo:400:kworker.0 Request processed in 1614us (6654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130547.479117:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789130547.479206:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626922112:0@lo:400:kworker.0 00000100:00080000:3.0:1789130547.479379:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130547.845903:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130548.874893:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130549.279902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130549.279966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130549.280006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130549.280253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130549.280284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130549.280321:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229440 00000100:00100000:1.0:1789130549.280333:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229440 00000100:00100000:1.0:1789130549.280401:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229824 00000100:00100000:1.0:1789130549.280404:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229824 00000100:00100000:1.0:1789130549.280427:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789130549.280437:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605229440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130549.280551:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605229440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130549.280559:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789130549.280577:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130549.280583:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605229824:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130549.280646:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605229824:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130549.280652:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00080000:1.0:1789130549.280688:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130549.281918:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229312 00000100:00100000:2.0:1789130549.281931:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229312 00000100:00100000:2.0:1789130549.281995:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:2.0:1789130549.282005:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605229312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130549.282065:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605229312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 61us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130549.282073:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:0.0:1789130549.286685:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229568 00000100:00100000:0.0:1789130549.286709:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229568 00000100:00100000:0.0:1789130549.286952:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229696 00000100:00100000:0.0:1789130549.286958:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229696 00000100:00100000:0.0:1789130549.287004:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789130549.287016:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605229696:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130549.287139:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605229696:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 125us (7132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130549.287147:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789130549.287182:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:0.0:1789130549.287189:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2366:x1876037605229568:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1789130549.287675:0:44366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ceb78b 00000100:00080000:0.0:1789130549.287690:0:44366:0:(import.c:65:import_set_state_nolock()) ffff90b388f35800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130549.287749:0:44366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738388 00000100:00100000:0.0:1789130549.288066:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+2:2366:x1876037605229568:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 874us (8177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130549.288079:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00080000:1.0:1789130549.288243:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130549.288250:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130549.288508:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130549.895234:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130550.026380:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130550.026415:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626922624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130550.026531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130550.026820:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922624 00000100:00100000:1.0:1789130550.026831:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922624 00000100:00100000:1.0:1789130550.026918:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130550.026932:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626922624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130550.026983:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789130550.027046:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626922624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130550.027054:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789130550.029337:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130550.029439:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626922624:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789130550.861833:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130550.861849:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130550.861900:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 6 00000040:00080000:1.0:1789130550.861911:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:0.0:1789130550.917851:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130551.506803:0:47006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 18: Verify size correctness after re-attach the file ========================================================== 08:42:28 (1789130548) 00010000:00010000:3.0:1789130551.946501:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789130552.177255:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f164769-cccd-48c1-b7fa-967be7565442 00000020:00000080:1.0:1789130552.177269:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b388f30000/6f164769-cccd-48c1-b7fa-967be7565442 00000020:00000080:2.0:1789130552.178039:0:43229:0:(genops.c:844:class_export_destroy()) destroying export ffff90b388f30000/6f164769-cccd-48c1-b7fa-967be7565442 for lustre-OST0000 00000020:00000080:2.0:1789130552.178134:0:43229:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b388f35800 for lustre-OST0000 00000100:00100000:3.0:1789130552.582270:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130552.582305:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626922752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130552.582409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130552.583355:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922752 00000100:00100000:1.0:1789130552.583369:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922752 00000100:00100000:1.0:1789130552.583479:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130552.583492:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626922752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130552.583547:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130552.583946:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626923008:0@lo:400:kworker.0 00000100:00080000:2.0:1789130552.584071:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130552.584129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626923136:0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.584211:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626922880:0@lo:400:kworker.0 00000100:00100000:0.0:1789130552.593205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130552.593354:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626923008 00000100:00100000:0.0:1789130552.593367:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626923008 00000100:00100000:0.0:1789130552.593471:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130552.593483:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626923008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130552.593563:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626923008:12345-0@lo:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130552.593571:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130552.593652:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626923008:0@lo:400:kworker.0 00000100:00100000:0.0:1789130552.593708:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626923264:0@lo:400:kworker.0 00000100:00100000:1.0:1789130552.594005:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626922752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10514us (11593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130552.594016:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789130552.594183:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130552.594444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130552.594657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130552.594702:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626923392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.594757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130552.594812:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626922752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130552.594849:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626923136 00000100:00100000:3.0:1789130552.594854:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626923136 00000100:00100000:3.0:1789130552.594895:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626923392 00000100:00100000:3.0:1789130552.594898:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626923392 00000100:00100000:3.0:1789130552.594924:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130552.594931:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626923136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.594982:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626923136:12345-0@lo:400:kworker.0 Request processed in 50us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130552.594989:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130552.595005:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130552.595010:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626923392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.595035:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626923392:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130552.595281:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789130552.595306:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130552.595327:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626923392:0@lo:400:kworker.0 00000100:00100000:2.0:1789130552.595930:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626922880 00000100:00100000:2.0:1789130552.595940:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626922880 00000100:00100000:2.0:1789130552.595999:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789130552.596008:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626922880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130552.596104:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626922880:12345-0@lo:400:kworker.0 Request processed in 79us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130552.596112:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789130552.596169:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626923136:0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.596384:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626922880:0@lo:400:kworker.0 00000100:00100000:0.0:1789130552.596552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130552.596981:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626923264 00000100:00100000:3.0:1789130552.596987:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626923264 00000100:00080000:1.0:1789130552.597138:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130552.598037:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130552.598233:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626923264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130552.598348:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626923264:12345-0@lo:400:kworker.0 Request processed in 298us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130552.598356:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130552.602702:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626923264:0@lo:400:kworker.0 00010000:00010000:0.0:1789130552.966029:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130553.384900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130553.385282:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605229952 00000100:00100000:2.0:1789130553.385295:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605229952 00000100:00100000:2.0:1789130553.385394:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 303 00000100:00100000:2.0:1789130553.385417:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:49539:x1876037605229952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130553.385446:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130553.385474:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47ceccb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbeb expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385555:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385573:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385588:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385774:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385783:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.385791:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.386575:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2e00/0x5c74554e47ceccca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.386590:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2e00/0x5c74554e47ceccca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387295:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2e00/0x5c74554e47ceccca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130553.387533:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789130553.387750:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789130553.387756:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130553.387854:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2e00/0x5c74554e47ceccca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387871:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387879:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387894:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387901:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130553.387906:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387915:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387931:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130553.387935:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130553.387941:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387947:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47ceccbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387963:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387970:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387976:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387981:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130553.387984:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.387995:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.388003:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b482b51c00) 00010000:00010000:2.0:1789130553.388006:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130553.388009:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.388016:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.388873:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47ceccb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbeb expref: 10 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.388898:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2e00/0x5c74554e47ceccca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbeb expref: 9 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.388907:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789130553.388910:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130553.388913:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc2e00, rc 0) 00000100:00100000:2.0:1789130553.389018:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:49539:x1876037605229952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3604us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130553.389038:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 303 00000100:00100000:1.0:1789130553.420715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130553.420896:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230208 00000100:00100000:3.0:1789130553.420908:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230208 00000100:00100000:3.0:1789130553.420989:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 304 00000100:00100000:3.0:1789130553.421001:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:49539:x1876037605230208:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130553.421032:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130553.421064:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceccd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbf2 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421332:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421353:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421366:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421387:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421394:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.421480:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422033:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cecce6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422044:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cecce6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422052:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cecce6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130553.422064:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789130553.422870:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422883:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422891:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422897:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130553.422902:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422915:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422933:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:3.0:1789130553.422936:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130553.422942:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422948:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4e00/0x5c74554e47ceccd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422965:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422971:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422977:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422982:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130553.422984:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422991:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.422998:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b488939600) 00010000:00010000:3.0:1789130553.423000:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130553.423003:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.423013:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47ceccdf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.423998:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47ceccd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf2 expref: 12 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.424019:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5a00/0x5c74554e47cecce6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf2 expref: 11 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.424028:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:3.0:1789130553.424031:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130553.424035:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5a00, rc 0) 00000100:00100000:3.0:1789130553.424368:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:49539:x1876037605230208:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3366us (3667us total) trans 34359738638 rc 0/0 00000100:00100000:3.0:1789130553.424380:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 304 00000100:00100000:3.0:1789130553.438368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130553.438919:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230336 00000100:00100000:1.0:1789130553.438934:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230336 00000100:00100000:1.0:1789130553.439033:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:1.0:1789130553.439047:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:49539:x1876037605230336:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789130553.439220:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:49539:x1876037605230336:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 175us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130553.439231:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 305 00000040:00080000:2.0:1789130553.926351:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130553.926364:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130553.926410:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 7 count 6 00000040:00080000:2.0:1789130553.926418:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130553.980947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130553.981321:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230592 00000100:00100000:2.0:1789130553.981334:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230592 00000100:00100000:2.0:1789130553.981407:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:2.0:1789130553.981420:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:49559:x1876037605230592:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130553.981446:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130553.981449:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130553.981485:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2000/0x5c74554e47cecc29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbc8 expref: 11 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.981510:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130553.981516:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130553.981533:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47ceccf4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acbf9 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.982031:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.982050:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.982060:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.982115:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130553.982135:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 5 pid: 43680 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130553.982152:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626923520:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130553.982515:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130553.987535:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626923520:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130553.987581:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130553.991234:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130554.003887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.005049:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230720 00000100:00100000:2.0:1789130554.005075:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230720 00010000:00010000:2.0:1789130554.005163:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 6 pid: 43680 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130554.005219:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789130554.005231:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605230720:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130554.005250:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130554.005258:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 6 pid: 43680 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005274:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 6 pid: 43680 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005303:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3600/0x5c74554e47ceccae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbe4 expref: 6 pid: 43680 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005326:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:2.0:1789130554.005331:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005343:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005356:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005395:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130554.005471:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605230720:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 242us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130554.005480:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00010000:00010000:2.0:1789130554.005514:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.005523:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.008399:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.008429:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.008444:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130554.010263:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789130554.014016:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe8:0x0], index 1: 0 00010000:00010000:3.0:1789130554.014399:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014423:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014438:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014484:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014493:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014500:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014507:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130554.014513:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014522:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014537:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51800) 00010000:00010000:3.0:1789130554.014540:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130554.014546:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014553:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2600/0x5c74554e47ceccfb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130554.014572:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000051b73a81 reply state 00000000abb80088 transno 34359738639 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130554.014584:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130554.014664:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47ceccf4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 13 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014691:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 12 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.014700:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130554.014702:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130554.014705:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5600, rc 0) 00000100:00100000:3.0:1789130554.014824:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:49559:x1876037605230592:12345-192.168.201.39@tcp:101:dd.0 Request processed in 33406us (33889us total) trans 34359738639 rc 0/0 00000100:00100000:3.0:1789130554.014836:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 306 00010000:00010000:0.0:1789130554.023180:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023215:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023226:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023232:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.023239:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023248:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023270:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b488939600) 00010000:00010000:0.0:1789130554.023273:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.023280:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.023287:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd02 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130554.062558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130554.063022:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230848 00000100:00100000:3.0:1789130554.063038:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230848 00000100:00100000:3.0:1789130554.063155:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789130554.063169:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:49559:x1876037605230848:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1789130554.063209:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130554.063243:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc00 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130554.063278:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789130554.063311:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=1717s v=(0 0) 00010000:00010000:3.0:1789130554.063317:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130554.063330:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.063356:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 9 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.063373:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4e00, rc 0) 00000100:00100000:3.0:1789130554.063464:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:49559:x1876037605230848:12345-192.168.201.39@tcp:101:dd.0 Request processed in 298us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130554.063473:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00080000:1.0:1789130554.064406:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130554.091497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130554.093334:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605230976 00000100:00100000:0.0:1789130554.093356:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605230976 00002000:00100000:0.0:1789130554.093459:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe8:0x0] (0->1048575) req@ffff90b386f6a580 x1876037605230976/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/0 e 0 to 0 dl 1789130565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130554.093473:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f6a580 with x1876037605230976 ext(0->1048575) 00002000:00010000:0.0:1789130554.093481:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386f6a580 00000100:00100000:0.0:1789130554.093527:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789130554.093539:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605230976:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130554.157472:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605230976:12345-192.168.201.39@tcp:4:dd.0 Request processed in 63917us (65974us total) trans 34359738391 rc 0/0 00000100:00100000:2.0:1789130554.157491:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00002000:00100000:2.0:1789130554.157507:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe8:0x0] (0->1048575) req@ffff90b386f6a580 x1876037605230976/t34359738391(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/448 e 0 to 0 dl 1789130565 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130554.157520:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f6a580 with x1876037605230976 ext(0->1048575) 00002000:00010000:2.0:1789130554.157530:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386f6a580 00000100:00100000:0.0:1789130554.159626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.159806:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605231104 00000100:00100000:2.0:1789130554.159822:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605231104 00002000:00100000:2.0:1789130554.159888:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe8:0x0] (1048576->2097151) req@ffff90b386c6cb40 x1876037605231104/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/0 e 0 to 0 dl 1789130565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130554.159902:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386c6cb40 with x1876037605231104 ext(1048576->2097151) 00002000:00010000:2.0:1789130554.159909:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386c6cb40 00000100:00100000:2.0:1789130554.159950:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789130554.159962:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2370:x1876037605231104:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130554.179313:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605231104:12345-192.168.201.39@tcp:4:dd.0 Request processed in 19335us (19700us total) trans 34359738392 rc 0/0 00000100:00100000:2.0:1789130554.179331:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00002000:00100000:2.0:1789130554.179348:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe8:0x0] (1048576->2097151) req@ffff90b386c6cb40 x1876037605231104/t34359738392(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/448 e 0 to 0 dl 1789130565 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130554.179359:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386c6cb40 with x1876037605231104 ext(1048576->2097151) 00002000:00010000:2.0:1789130554.179367:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386c6cb40 00000100:00100000:0.0:1789130554.205384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.205949:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605231232 00000100:00100000:2.0:1789130554.205963:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605231232 00002000:00100000:2.0:1789130554.206039:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe8:0x0] (2097152->3145727) req@ffff90b386c6d2c0 x1876037605231232/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/0 e 0 to 0 dl 1789130565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130554.206053:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386c6d2c0 with x1876037605231232 ext(2097152->3145727) 00002000:00010000:2.0:1789130554.206076:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386c6d2c0 00000100:00100000:2.0:1789130554.206120:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789130554.206133:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:2368:x1876037605231232:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130554.234478:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:2368:x1876037605231232:12345-192.168.201.39@tcp:4:dd.0 Request processed in 28332us (29097us total) trans 34359738393 rc 0/0 00000100:00100000:2.0:1789130554.234496:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00002000:00100000:2.0:1789130554.234513:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe8:0x0] (2097152->3145727) req@ffff90b386c6d2c0 x1876037605231232/t34359738393(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/448 e 0 to 0 dl 1789130565 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130554.234524:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386c6d2c0 with x1876037605231232 ext(2097152->3145727) 00002000:00010000:2.0:1789130554.234533:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386c6d2c0 00000100:00100000:1.0:1789130554.254009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.254101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.254204:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605231616 00000100:00100000:2.0:1789130554.254218:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605231616 00000100:00100000:2.0:1789130554.254308:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789130554.254316:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605231360 00000100:00100000:2.0:1789130554.254321:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:49559:x1876037605231616:12345-192.168.201.39@tcp:35:dd.0 00000100:00100000:0.0:1789130554.254322:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605231360 00002000:00100000:0.0:1789130554.254369:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe8:0x0] (3145728->4194303) req@ffff90b386f6b480 x1876037605231360/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/0 e 0 to 0 dl 1789130565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130554.254380:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f6b480 with x1876037605231360 ext(3145728->4194303) 00002000:00010000:0.0:1789130554.254389:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386f6b480 00000100:00100000:0.0:1789130554.254418:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789130554.254426:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:2369:x1876037605231360:12345-192.168.201.39@tcp:4:dd.0 00000100:00100000:2.0:1789130554.254933:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:49559:x1876037605231616:12345-192.168.201.39@tcp:35:dd.0 Request processed in 611us (936us total) trans 34359738640 rc 0/0 00000100:00100000:2.0:1789130554.254942:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130554.268546:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605231360:12345-192.168.201.39@tcp:4:dd.0 Request processed in 14107us (14431us total) trans 34359738394 rc 0/0 00000100:00100000:1.0:1789130554.268565:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00002000:00100000:1.0:1789130554.268580:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe8:0x0] (3145728->4194303) req@ffff90b386f6b480 x1876037605231360/t34359738394(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:270/0 lens 488/448 e 0 to 0 dl 1789130565 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130554.268592:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f6b480 with x1876037605231360 ext(3145728->4194303) 00002000:00010000:1.0:1789130554.268599:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386f6b480 00000100:00100000:0.0:1789130554.350447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.350562:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605231744 00000100:00100000:1.0:1789130554.350573:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605231744 00000100:00100000:1.0:1789130554.350672:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:1.0:1789130554.350682:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:49565:x1876037605231744:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130554.350711:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130554.350736:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc07 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.350889:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.350969:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.350985:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130554.351049:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130554.351053:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130554.351088:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.351113:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc07 expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.351133:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc07 expref: 14 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.351142:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130554.351144:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130554.351148:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130554.351207:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:49565:x1876037605231744:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 526us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130554.351215:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:0.0:1789130554.354839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130554.355230:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232000 00000100:00100000:3.0:1789130554.355242:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232000 00000100:00100000:3.0:1789130554.355357:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:3.0:1789130554.355369:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:49565:x1876037605232000:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130554.355388:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130554.355411:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc0e expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.355531:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecd33 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.355545:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecd33 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.355557:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecd33 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130554.355569:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 4194304 00010000:00010000:3.0:1789130554.355747:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc0e expref: 17 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.355770:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecd33 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc0e expref: 16 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.355779:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130554.355783:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130554.355787:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5800, rc 0) 00000100:00100000:3.0:1789130554.355954:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:49565:x1876037605232000:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 587us (1124us total) trans 34359738641 rc 0/0 00000100:00100000:3.0:1789130554.355962:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:0.0:1789130554.362784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130554.363088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.363175:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232384 00000100:00100000:1.0:1789130554.363185:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232384 00000100:00100000:1.0:1789130554.363255:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:1.0:1789130554.363267:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:49565:x1876037605232384:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130554.363293:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130554.363321:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd41 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc15 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.363428:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.363445:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.363457:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130554.363469:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 4194304 00010000:00010000:1.0:1789130554.365758:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd41 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc15 expref: 19 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.365786:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc15 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.366212:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:1.0:1789130554.366216:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130554.366220:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130554.366391:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:49565:x1876037605232384:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3069us (3246us total) trans 34359738642 rc 0/0 00000100:00100000:1.0:1789130554.366399:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:3.0:1789130554.366490:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232128 00000100:00100000:3.0:1789130554.366498:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232128 00000100:00100000:3.0:1789130554.366562:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789130554.366572:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:2370:x1876037605232128:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130554.366586:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130554.366635:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cecd33 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc0e expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.366648:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130554.366651:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130554.366673:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2370:x1876037605232128:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 103us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130554.366681:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789130554.396563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.396708:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232512 00000100:00100000:1.0:1789130554.396718:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232512 00000100:00100000:1.0:1789130554.396787:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:1.0:1789130554.396800:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605232512:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130554.396882:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605232512:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130554.396890:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789130554.463157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.463253:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232640 00000100:00100000:1.0:1789130554.463263:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232640 00000100:00100000:1.0:1789130554.463316:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130554.463325:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:2370:x1876037605232640:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789130554.463374:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.463396:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 17 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.463405:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130554.463409:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130554.463414:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.463451:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 17 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.463465:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 17 pid: 44367 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130554.463485:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626923648:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130554.463576:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b58223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130554.474859:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626923648:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130554.474894:0:44365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130554.485475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.486031:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605232768 00000100:00100000:2.0:1789130554.486044:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605232768 00010000:00010000:2.0:1789130554.486099:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 18 pid: 44367 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130554.486146:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1789130554.486157:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:2367:x1876037605232768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130554.486174:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789130554.486195:0:45795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe8:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789130554.486198:0:45795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe8:0x0] updating lvb mtime from disk: 0 -> 1789130553 00002000:00010000:2.0:1789130554.486201:0:45795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe8:0x0] updating lvb ctime from disk: 0 -> 1789130553 00010000:00010000:2.0:1789130554.486209:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 18 pid: 44367 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.486226:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 18 pid: 44367 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.486254:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008191a274/0x5c74554e47cecd17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc00 expref: 18 pid: 44367 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.486275:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130554.486281:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130554.486287:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.486297:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.486339:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130554.486422:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:2367:x1876037605232768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 267us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130554.486432:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00010000:00010000:1.0:1789130554.486896:0:44365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486908:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486940:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486949:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486958:0:44365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486966:0:44365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130554.486971:0:44365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.486987:0:44365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.487000:0:44365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.487008:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a3b04c3/0x5c74554e47cecd56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130554.487091:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:2370:x1876037605232640:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 23766us (23943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130554.487102:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130554.492093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.492178:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233024 00000100:00100000:2.0:1789130554.492190:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233024 00000100:00100000:2.0:1789130554.492253:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789130554.492263:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:49565:x1876037605233024:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1789130554.492341:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc15 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130554.492591:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738643 00000001:00080000:2.0:1789130554.492681:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738644 00000001:00080000:2.0:1789130554.494198:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738645 00010000:00010000:2.0:1789130554.494277:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.494297:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.494307:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.494349:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.494365:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 21 pid: 45555 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130554.494380:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626923776:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130554.494527:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130554.499204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.499294:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626923776:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130554.499328:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130554.499927:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233152 00000100:00100000:3.0:1789130554.499936:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233152 00010000:00010000:3.0:1789130554.499989:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 22 pid: 45555 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130554.500031:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1789130554.500041:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+22:2370:x1876037605233152:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130554.500069:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130554.500076:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 22 pid: 45555 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500090:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 22 pid: 45555 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500113:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cecd09 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acbf9 expref: 22 pid: 45555 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500129:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:3.0:1789130554.500134:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500144:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500152:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.500180:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130554.500242:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:2370:x1876037605233152:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130554.500249:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00010000:00010000:1.0:1789130554.500447:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.500456:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130554.500577:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738646 00000001:00080000:1.0:1789130554.500831:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738647 00000100:00100000:1.0:1789130554.500947:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626923904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130554.501000:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130554.501026:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130554.501898:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626923904 00000100:00100000:3.0:1789130554.502561:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626923904 00000100:00100000:3.0:1789130554.502826:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130554.502837:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626923904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789130554.503000:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130554.503385:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626923904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 550us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130554.503395:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130554.503514:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626923904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130554.504316:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738648 00000100:00100000:1.0:1789130554.504402:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626924032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130554.504449:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130554.504483:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b58223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130554.505110:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626924032 00000100:00100000:3.0:1789130554.505120:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626924032 00000100:00100000:3.0:1789130554.505166:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130554.505175:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626924032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130554.505355:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626924032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (904us total) trans 34359738395 rc 0/0 00000100:00100000:3.0:1789130554.505362:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130554.505469:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626924032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130554.505528:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738649 00010000:00010000:1.0:1789130554.505566:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505576:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505584:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505591:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130554.505595:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505831:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505849:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:1.0:1789130554.505853:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789130554.505858:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.505865:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2200/0x5c74554e47cecd5d lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130554.506281:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789130554.506381:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].8, 64 off8776 00000004:00080000:1.0:1789130554.506392:0:43683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1717603789728ns, next at 1718603787008ns, rc = 0 00000001:00080000:1.0:1789130554.506399:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738650 00010000:00010000:1.0:1789130554.506433:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939200) 00010000:00010000:1.0:1789130554.506436:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130554.506444:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd48 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc15 expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130554.506549:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+24:49565:x1876037605233024:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 14287us (14468us total) trans 34359738651 rc 0/0 00000100:00100000:1.0:1789130554.506557:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000020:00080000:1.0:1789130554.506561:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789130554.509167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130554.509327:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233280 00000100:00100000:3.0:1789130554.509336:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233280 00000100:00100000:3.0:1789130554.509386:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:3.0:1789130554.509397:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:49565:x1876037605233280:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130554.509423:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130554.509447:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc1c expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.509508:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.509521:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 25 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130554.509544:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130554.509547:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130554.509551:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:3.0:1789130554.509632:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+25:49565:x1876037605233280:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 237us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130554.509652:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:3.0:1789130554.513210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.513310:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233536 00000100:00100000:1.0:1789130554.513320:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233536 00000100:00100000:1.0:1789130554.513370:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1789130554.513379:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+25:49565:x1876037605233536:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130554.513776:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:49565:x1876037605233536:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 395us (572us total) trans 34359738652 rc 0/0 00000100:00100000:1.0:1789130554.513784:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130554.646339:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130554.653183:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233664 00000100:00100000:0.0:1789130554.653202:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233664 00000100:00100000:0.0:1789130554.653300:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:0.0:1789130554.653312:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:49571:x1876037605233664:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130554.653394:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653411:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653424:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653443:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653450:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653457:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653563:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653572:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653579:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130554.653677:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653691:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653698:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653705:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653712:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.653716:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653725:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653738:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130554.653741:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.653745:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653751:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecd6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653764:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653770:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653776:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653781:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.653784:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653790:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653797:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b497c01400) 00010000:00010000:0.0:1789130554.653800:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.653803:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653813:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653826:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653832:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653838:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653843:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.653846:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653852:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653859:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130554.653862:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.653864:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.653869:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd79 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130554.653959:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:49571:x1876037605233664:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 649us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130554.653967:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:3.0:1789130554.761342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.761534:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233792 00000100:00100000:2.0:1789130554.761548:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233792 00000100:00100000:1.0:1789130554.762438:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:1.0:1789130554.762460:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:49581:x1876037605233792:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130554.762591:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762644:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762660:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762681:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762688:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762703:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762849:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762858:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762866:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130554.762920:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762936:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762944:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762957:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762965:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130554.762970:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762979:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.762993:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130554.762996:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130554.763002:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763009:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecd80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763024:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763029:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763035:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763040:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130554.763043:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763063:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763072:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b4909bda00) 00010000:00010000:1.0:1789130554.763074:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130554.763077:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763084:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecd87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763100:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763107:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763112:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763117:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130554.763120:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763126:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763134:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130554.763136:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130554.763139:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.763150:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecd8e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130554.763261:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+26:49581:x1876037605233792:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 809us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130554.763272:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:3.0:1789130554.891923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130554.896846:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605233920 00000100:00100000:0.0:1789130554.896869:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605233920 00000100:00100000:0.0:1789130554.896981:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:0.0:1789130554.896995:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+26:49587:x1876037605233920:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130554.897037:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130554.897077:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc23 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897178:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897196:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897212:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897231:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897239:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897246:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897387:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897397:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897408:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130554.897454:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 4194304 00000004:00200000:0.0:1789130554.897460:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130554.897484:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897498:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897507:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897514:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897521:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897527:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.897532:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897540:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897554:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130554.897558:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.897565:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897576:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecd9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897591:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897597:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897674:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897680:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130554.897683:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897689:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897697:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b497c01400) 00010000:00010000:0.0:1789130554.897700:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130554.897703:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897710:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecda3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897747:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecd95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897768:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 27 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130554.897776:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130554.897779:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130554.897782:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130554.897885:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:49587:x1876037605233920:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 893us (5977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130554.897895:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:2.0:1789130554.905469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130554.910770:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605234176 00000100:00100000:1.0:1789130554.910791:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605234176 00000100:00100000:1.0:1789130554.910891:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:1.0:1789130554.910907:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:49587:x1876037605234176:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130554.910936:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130554.910968:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc2a expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.911128:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecdb8 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.911148:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecdb8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.911165:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecdb8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130554.911192:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 4194304 00010000:00010000:1.0:1789130554.911368:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc2a expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.911391:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecdb8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc2a expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130554.911401:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130554.911404:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130554.911409:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130554.911502:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:49587:x1876037605234176:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 600us (6048us total) trans 34359738653 rc 0/0 00000100:00100000:1.0:1789130554.911780:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:3.0:1789130554.923296:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130554.923430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130554.924374:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605234560 00000100:00100000:2.0:1789130554.924387:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605234560 00000100:00100000:2.0:1789130554.924466:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1789130554.924479:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+29:2369:x1876037605234560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130554.924495:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130554.924520:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecdb8 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc2a expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130554.924551:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130554.924557:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130554.924652:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:2369:x1876037605234560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 176us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130554.924659:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789130554.930771:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605234432 00000100:00100000:1.0:1789130554.930795:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605234432 00000100:00100000:2.0:1789130554.931244:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789130554.931257:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:49587:x1876037605234432:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130554.931553:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:49587:x1876037605234432:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 298us (9016us total) trans 34359738654 rc 0/0 00000100:00100000:2.0:1789130554.931561:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00010000:00010000:0.0:1789130555.014033:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130555.129000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130555.129425:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605234688 00000100:00100000:1.0:1789130555.129436:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605234688 00000100:00100000:1.0:1789130555.129595:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:1.0:1789130555.129653:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:49595:x1876037605234688:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130555.129675:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130555.129701:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc31 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129767:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129780:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129792:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130555.129848:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130555.129852:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130555.129877:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129900:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc31 expref: 7 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129917:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc31 expref: 6 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.129926:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130555.129929:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130555.129933:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130555.129991:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605234688:12345-192.168.201.39@tcp:101:dd.0 Request processed in 387us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130555.130059:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:3.0:1789130555.140300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130555.140397:0:43688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605234816 00000100:00100000:1.0:1789130555.140405:0:43688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605234816 00000100:00100000:1.0:1789130555.140449:0:43688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:1.0:1789130555.140456:0:43688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605234816:12345-192.168.201.39@tcp:700:dd.0 00000100:00100000:1.0:1789130555.140575:0:43688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605234816:12345-192.168.201.39@tcp:700:dd.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130555.140582:0:43688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789130555.141929:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626924160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130555.141985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130555.142112:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626924160 00000100:00100000:0.0:1789130555.142119:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626924160 00000100:00100000:0.0:1789130555.142166:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130555.142173:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626924160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130555.142199:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789130555.142232:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626924160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130555.142237:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130555.142268:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626924160:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789130555.142322:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130555.148694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130555.148923:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235072 00000100:00100000:0.0:1789130555.148935:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235072 00000100:00100000:0.0:1789130555.149056:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 316 00000100:00100000:0.0:1789130555.149067:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605235072:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789130555.149088:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130555.149091:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130555.149118:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecdcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc31 expref: 6 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149138:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130555.149144:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130555.149158:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecdd4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc38 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149309:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149323:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149333:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149348:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149355:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149361:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149430:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecde9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149439:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecde9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149450:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecde9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130555.149458:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 4194304 00010000:00010000:0.0:1789130555.149732:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149740:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149747:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149753:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130555.149758:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149765:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149774:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130555.149786:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130555.149790:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149796:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149807:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149817:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149823:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149828:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130555.149831:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149837:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149845:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b497c01400) 00010000:00010000:0.0:1789130555.149848:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130555.149851:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149857:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecde2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149897:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecdd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc38 expref: 8 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149911:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecde9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc38 expref: 7 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.149918:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130555.149921:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130555.149924:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130555.150442:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:49595:x1876037605235072:12345-192.168.201.39@tcp:101:dd.0 Request processed in 1374us (1757us total) trans 34359738655 rc 0/0 00000100:00100000:0.0:1789130555.150452:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 316 00000100:00100000:3.0:1789130555.156126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130555.156626:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235328 00000100:00100000:0.0:1789130555.156638:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235328 00000100:00100000:0.0:1789130555.156702:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 317 00000100:00100000:0.0:1789130555.156714:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:49595:x1876037605235328:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:0.0:1789130555.156789:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130555.156817:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecde9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc38 expref: 7 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.156837:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130555.156842:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130555.157041:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.157066:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.157074:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.157108:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 28 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.157123:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 28 pid: 43680 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130555.157143:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626924288:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130555.157221:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130555.163379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130555.163698:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626924288:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130555.163734:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130555.163949:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235456 00000100:00100000:2.0:1789130555.163957:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235456 00010000:00010000:2.0:1789130555.164062:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 29 pid: 43680 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130555.164098:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789130555.164108:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:2370:x1876037605235456:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130555.164125:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130555.164132:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 29 pid: 43680 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164145:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 29 pid: 43680 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164167:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47cecdaa lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc23 expref: 29 pid: 43680 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164185:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130555.164190:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164199:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164206:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.164238:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130555.164290:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:2370:x1876037605235456:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 182us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130555.164297:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00010000:00010000:0.0:1789130555.164641:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130555.164650:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130555.164778:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738656 00000004:00010000:0.0:1789130555.164830:0:43680:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d5a8e18f reply state 000000008df313f0 transno 34359738657 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130555.164840:0:43680:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130555.164922:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49595:x1876037605235328:12345-192.168.201.39@tcp:36:dd.0 Request processed in 8211us (8804us total) trans 34359738657 rc 0/0 00000100:00100000:0.0:1789130555.164930:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 317 00000020:00080000:0.0:1789130555.164935:0:43680:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1789130555.165436:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130555.167432:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167448:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167459:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167465:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130555.167469:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167476:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167490:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130555.167493:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130555.167498:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.167504:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecdf7 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130555.167988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130555.168105:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235584 00000100:00100000:1.0:1789130555.168114:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235584 00000100:00100000:1.0:1789130555.168161:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 318 00000100:00100000:1.0:1789130555.168171:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:49595:x1876037605235584:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130555.168193:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130555.168209:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdfe lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc3f expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.168261:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdfe lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc3f expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.168278:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdfe lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc3f expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.168296:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130555.168299:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130555.168301:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e200, rc 0) 00000100:00100000:1.0:1789130555.168359:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49595:x1876037605235584:12345-192.168.201.39@tcp:101:dd.0 Request processed in 190us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130555.168367:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 318 00000100:00100000:3.0:1789130555.173234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130555.173365:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235840 00000100:00100000:2.0:1789130555.173375:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235840 00000100:00100000:2.0:1789130555.173483:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130555.173493:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49595:x1876037605235840:12345-192.168.201.39@tcp:103:dd.0 00010000:00010000:2.0:1789130555.173575:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130555.173631:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecdfe lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc3f expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130555.173649:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130555.173654:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130555.173724:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:49595:x1876037605235840:12345-192.168.201.39@tcp:103:dd.0 Request processed in 225us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130555.173736:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789130555.176233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130555.176336:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605235968 00000100:00100000:3.0:1789130555.176346:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605235968 00000100:00100000:3.0:1789130555.176437:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:3.0:1789130555.176448:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:49595:x1876037605235968:12345-192.168.201.39@tcp:58:dd.0 00010000:00010000:3.0:1789130555.176644:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.176661:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.176674:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.176711:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 27 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.176735:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 27 pid: 45555 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130555.176750:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f04f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626924416:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130555.176905:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130555.178467:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f04f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626924416:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130555.178497:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130555.182330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130555.182545:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236096 00000100:00100000:3.0:1789130555.182556:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236096 00010000:00010000:3.0:1789130555.182598:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 28 pid: 45555 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130555.182676:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789130555.182686:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:2368:x1876037605236096:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130555.182701:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130555.182708:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 28 pid: 45555 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182723:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 28 pid: 45555 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182745:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cecd64 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc1c expref: 28 pid: 45555 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182761:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130555.182767:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182777:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182782:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130555.182806:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130555.182842:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.182849:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130555.182871:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:2368:x1876037605236096:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 186us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130555.182879:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000040:00080000:1.0:1789130555.183214:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].7, 136 off9144 00000100:00100000:1.0:1789130555.183319:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:49595:x1876037605235968:12345-192.168.201.39@tcp:58:dd.0 Request processed in 6872us (7093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130555.183329:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:2.0:1789130555.186895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130555.187008:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236224 00000100:00100000:1.0:1789130555.187018:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236224 00000100:00100000:1.0:1789130555.187134:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 320 00000100:00100000:1.0:1789130555.187145:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:49595:x1876037605236224:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789130555.187167:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130555.187186:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc46 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187240:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187252:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187270:0:43679:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187282:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187293:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130555.187296:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130555.187300:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 9 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130555.187308:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130555.187373:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49595:x1876037605236224:12345-192.168.201.39@tcp:101:dd.0 Request processed in 230us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130555.187380:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 320 00000040:00080000:2.0:1789130555.974934:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130555.974943:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130555.974986:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 8 count 7 00000040:00080000:2.0:1789130555.974993:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130555.975134:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f79a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626924544:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130555.975267:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911300 going to sleep for 11 seconds 00000100:00100000:1.0:1789130555.983007:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f79a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626924544:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130555.985287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130555.988111:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236352 00000100:00100000:0.0:1789130555.988128:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236352 00000100:00100000:0.0:1789130555.988270:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:0.0:1789130555.988282:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:49596:x1876037605236352:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130555.988321:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130555.988436:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:49596:x1876037605236352:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 156us (3158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130555.988446:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:2.0:1789130555.996006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.009547:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236480 00000100:00100000:1.0:1789130556.009563:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236480 00000100:00100000:1.0:1789130556.009660:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 322 00000100:00100000:1.0:1789130556.009671:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:49596:x1876037605236480:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130556.009747:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.009764:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.009777:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.009793:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.009800:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.010816:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011080:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011091:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011098:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130556.011145:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1048576 00000004:00200000:1.0:1789130556.011151:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130556.011168:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011179:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011185:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011191:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011197:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130556.011202:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011210:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011221:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:1.0:1789130556.011224:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130556.011228:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011234:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011248:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011255:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011260:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011266:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130556.011269:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011274:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011281:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x231127a9 (ffff90b4909bda00) 00010000:00010000:1.0:1789130556.011284:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130556.011286:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011292:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011307:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011313:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011317:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011321:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130556.011323:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011329:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011339:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130556.011341:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130556.011343:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.011348:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece21 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130556.012556:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:49596:x1876037605236480:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 2877us (16551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130556.012571:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 322 00000100:00100000:3.0:1789130556.028998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.034840:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236736 00000100:00100000:1.0:1789130556.034856:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236736 00000100:00100000:1.0:1789130556.034936:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 323 00000100:00100000:1.0:1789130556.034956:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+27:49596:x1876037605236736:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130556.034977:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130556.034998:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cece28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc4d expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035105:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035121:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035133:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130556.035144:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1048576 00010000:00010000:1.0:1789130556.035242:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035250:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035257:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035264:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130556.035268:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035274:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035286:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130556.035289:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130556.035293:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035299:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece2f lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035339:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cece28 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc4d expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035348:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:1.0:1789130556.035351:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130556.035354:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cece28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc4d expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.035367:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130556.035438:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605236736:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 485us (6504us total) trans 34359738658 rc 301/301 00000100:00100000:1.0:1789130556.035446:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 323 00010000:00010000:3.0:1789130556.038177:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130556.044843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130556.045066:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605236864 00000100:00100000:0.0:1789130556.045079:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605236864 00000100:00100000:0.0:1789130556.045148:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 324 00000100:00100000:0.0:1789130556.045159:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605236864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130556.045198:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130556.045306:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605236864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 148us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130556.045315:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 324 00000100:00100000:0.0:1789130556.052817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.053132:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605237120 00000100:00100000:1.0:1789130556.053142:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605237120 00000100:00100000:1.0:1789130556.053201:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:1.0:1789130556.053212:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605237120:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130556.053234:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130556.053237:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130556.053264:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecd25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc07 expref: 28 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.053283:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130556.053294:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130556.053308:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc54 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130556.053805:0:43681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe8:0x0], index 0: 0 00010000:00010000:1.0:1789130556.054216:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece44 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.054230:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece44 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.054241:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece44 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.054292:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cece3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc54 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.054311:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece44 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc54 expref: 29 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.054319:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789130556.054321:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130556.054324:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130556.054387:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+29:49596:x1876037605237120:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1177us (1581us total) trans 34359738659 rc 0/0 00000100:00100000:1.0:1789130556.054394:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:1.0:1789130556.073085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130556.073274:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605237248 00000100:00100000:0.0:1789130556.073284:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605237248 00000100:00100000:0.0:1789130556.073405:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 326 00000100:00100000:0.0:1789130556.073416:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:49596:x1876037605237248:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130556.073444:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130556.073469:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cece52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc5b expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074106:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074121:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074132:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130556.074198:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130556.074202:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130556.074228:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074251:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cece52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc5b expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074264:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc5b expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.074270:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01400) 00010000:00010000:0.0:1789130556.074272:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130556.074275:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130556.076055:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:49596:x1876037605237248:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2632us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130556.076068:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 326 00000100:00100000:2.0:1789130556.087496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130556.087775:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605237504 00000100:00100000:3.0:1789130556.087786:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605237504 00000100:00100000:3.0:1789130556.088070:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:3.0:1789130556.088082:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+30:49596:x1876037605237504:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130556.088135:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789130556.088163:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cece44 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc54 expref: 30 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088182:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:3.0:1789130556.088200:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cece59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc5b expref: 29 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088215:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01400) 00010000:00010000:3.0:1789130556.088222:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130556.088247:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088260:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088270:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088282:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088289:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088294:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088370:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088378:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088386:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088391:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130556.088395:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088404:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088413:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130556.088486:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130556.088491:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088498:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088515:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088595:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088778:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088784:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130556.088787:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088794:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088814:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a80493e (ffff90b488939400) 00010000:00010000:3.0:1789130556.088817:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130556.088821:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.088839:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a80493e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130556.088952:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605237504:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 870us (1464us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130556.088960:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:3.0:1789130556.092389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130556.092493:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605237632 00000100:00100000:0.0:1789130556.092503:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605237632 00000100:00100000:0.0:1789130556.092573:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 328 00000100:00100000:0.0:1789130556.092583:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:49596:x1876037605237632:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130556.092634:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130556.092656:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cece6e lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc62 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092691:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092704:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092714:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092951:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cece6e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 30 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092972:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 29 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.092981:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130556.092984:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130556.092987:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130556.093088:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+29:49596:x1876037605237632:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 506us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130556.093096:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 328 00000100:00100000:2.0:1789130556.102484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130556.102798:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605237888 00000100:00100000:3.0:1789130556.102810:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605237888 00000100:00100000:3.0:1789130556.102880:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:3.0:1789130556.102933:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:49596:x1876037605237888:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130556.103023:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.103051:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.103063:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130556.105565:0:43679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].9, 88 off8816 00000004:00080000:2.0:1789130556.105582:0:43679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1719202979505ns, next at 1720202976766ns, rc = 0 00000004:00010000:2.0:1789130556.105718:0:43679:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a973652a reply state 00000000cf3106e3 transno 34359738660 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130556.105730:0:43679:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130556.107631:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:49596:x1876037605237888:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 4732us (5149us total) trans 34359738660 rc 0/0 00000100:00100000:2.0:1789130556.107643:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:2.0:1789130556.118679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130556.118779:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238016 00000100:00100000:3.0:1789130556.118790:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238016 00000100:00100000:3.0:1789130556.118872:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 330 00000100:00100000:3.0:1789130556.118882:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:49596:x1876037605238016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130556.118908:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130556.118930:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc69 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.119315:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.119328:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 32 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130556.119348:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130556.119351:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130556.119355:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5e00, rc 0) 00000100:00100000:3.0:1789130556.119425:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:49596:x1876037605238016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 544us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130556.119432:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 330 00000100:00100000:2.0:1789130556.125890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130556.126100:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238144 00000100:00100000:3.0:1789130556.126110:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238144 00000100:00100000:3.0:1789130556.126155:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789130556.126164:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037605238144:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789130556.126200:0:44367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp t0 exp 0000000000000000 cur 1719 last 0 00000020:00000080:3.0:1789130556.126234:0:44367:0:(genops.c:1385:class_connect()) connect: client 6f164769-cccd-48c1-b7fa-967be7565442, cookie 0x5c74554e47cece8a 00002000:00100000:3.0:1789130556.126247:0:44367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6f164769-cccd-48c1-b7fa-967be7565442/ffff90b482b89000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 10223616 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789130556.126258:0:44367:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789130556.126522:0:44367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789130556.126555:0:44367:0:(import.c:65:import_set_state_nolock()) ffff90b3879e6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130556.127107:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2366:x1876037605238144:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 Request processed in 942us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130556.127121:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:0.0:1789130556.129795:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129829:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129838:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129844:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130556.129848:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129857:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129876:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130556.129878:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130556.129883:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.129889:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5800/0x5c74554e47cece7c lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130556.145219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130556.145651:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238272 00000100:00100000:0.0:1789130556.145729:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238272 00000100:00100000:0.0:1789130556.145880:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130556.145891:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:0:x1876037605238272:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789130556.154304:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130556.306738:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:0:x1876037605238272:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 160834us (161513us total) trans 34359738389 rc 0/0 00000100:00100000:3.0:1789130556.306753:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000001:00080000:1.0:1789130556.306989:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738389 is committed 00000001:00100000:1.0:1789130556.307004:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f164769-cccd-48c1-b7fa-967be7565442 00000100:00100000:1.0:1789130556.324721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.325659:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238528 00000100:00100000:2.0:1789130556.325673:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238528 00000100:00100000:2.0:1789130556.325736:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130556.325748:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:49596:x1876037605238528:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130556.326059:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:49596:x1876037605238528:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 312us (1348us total) trans 34359738661 rc 0/0 00000100:00100000:2.0:1789130556.326068:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130556.332225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.332425:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238784 00000100:00100000:1.0:1789130556.332435:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238784 00000100:00100000:1.0:1789130556.332502:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:1.0:1789130556.332514:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:49596:x1876037605238784:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130556.332672:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:49596:x1876037605238784:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 159us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130556.332681:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:3.0:1789130556.339729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.341786:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605238912 00000100:00100000:1.0:1789130556.341800:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605238912 00000100:00100000:1.0:1789130556.341876:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 332 00000100:00100000:1.0:1789130556.341887:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:49596:x1876037605238912:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130556.341908:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130556.341933:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece91 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc70 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342037:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342052:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342065:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130556.342101:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130556.342119:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342147:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cece91 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc70 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342166:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc70 expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130556.342175:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130556.342177:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130556.342181:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e200, rc 0) 00000100:00100000:1.0:1789130556.342253:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:49596:x1876037605238912:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 368us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130556.342261:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 332 00000100:00100000:3.0:1789130556.357746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.357928:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239040 00000100:00100000:2.0:1789130556.357938:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239040 00000100:00100000:2.0:1789130556.358007:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1789130556.358016:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605239040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130556.358042:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130556.358063:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc77 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130556.358089:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f73b, blocks: 0x1 00010000:00010000:2.0:1789130556.358110:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=1719s v=(0 0) 00010000:00010000:2.0:1789130556.358115:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130556.358124:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.358143:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.358156:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc2200, rc 0) 00000100:00100000:2.0:1789130556.358208:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605239040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 193us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130556.358216:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1789130556.368335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.368415:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239296 00000100:00100000:1.0:1789130556.368424:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239296 00000100:00100000:1.0:1789130556.368488:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:1.0:1789130556.368499:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:49596:x1876037605239296:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130556.368632:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:49596:x1876037605239296:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130556.368640:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:1.0:1789130556.391952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.392572:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239424 00000100:00100000:2.0:1789130556.392584:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239424 00000100:00100000:2.0:1789130556.392701:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789130556.392714:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:49596:x1876037605239424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130556.392734:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130556.392756:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc7e expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.392792:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.392802:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130556.392806:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130556.392811:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.392847:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.392862:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 1819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130556.392876:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626924672:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130556.392973:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130556.402742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.403075:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626924672:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130556.403117:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130556.403141:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc3400, rc 0) 00000100:00100000:2.0:1789130556.403204:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:49596:x1876037605239424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 10493us (11274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130556.403214:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:0.0:1789130556.406346:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239552 00000100:00100000:0.0:1789130556.406363:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239552 00010000:00010000:0.0:1789130556.406439:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 1819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130556.406487:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789130556.406498:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bbdae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605239552:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130556.406515:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130556.406538:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 1819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.406553:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 1819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.406577:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027922b89/0x5c74554e47cece9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc77 expref: 7 pid: 44793 timeout: 1819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.406594:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130556.406599:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130556.406668:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.406679:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.406717:0:43665:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130556.406732:0:43665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:43665:1876037626924800:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130556.406819:0:43665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130556.428346:0:43665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:43665:1876037626924800:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130556.428380:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130556.428463:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bbdae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605239552:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 21967us (25731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130556.428475:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789130556.477910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.479400:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239680 00000100:00100000:2.0:1789130556.479424:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239680 00002000:00100000:2.0:1789130556.479490:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (0->1048575) req@ffff90b498ac5e00 x1876037605239680/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/0 e 0 to 0 dl 1789130567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130556.479501:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5e00 with x1876037605239680 ext(0->1048575) 00002000:00010000:2.0:1789130556.479508:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac5e00 00000100:00100000:2.0:1789130556.479543:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789130556.479554:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605239680:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130556.539050:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2367:x1876037605239680:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 59485us (61138us total) trans 34359738390 rc 0/0 00000100:00100000:2.0:1789130556.539066:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00002000:00100000:2.0:1789130556.539082:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (0->1048575) req@ffff90b498ac5e00 x1876037605239680/t34359738390(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/448 e 0 to 0 dl 1789130567 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130556.539093:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac5e00 with x1876037605239680 ext(0->1048575) 00002000:00010000:2.0:1789130556.539100:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac5e00 00000100:00100000:3.0:1789130556.609826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.610182:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239808 00000100:00100000:1.0:1789130556.610193:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239808 00002000:00100000:1.0:1789130556.610248:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->2097151) req@ffff90b498ac4b40 x1876037605239808/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/0 e 0 to 0 dl 1789130567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130556.610259:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4b40 with x1876037605239808 ext(1048576->2097151) 00002000:00010000:1.0:1789130556.610265:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac4b40 00000100:00100000:1.0:1789130556.610299:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789130556.610309:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605239808:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130556.709231:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605239808:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 98911us (99404us total) trans 34359738391 rc 0/0 00000100:00100000:0.0:1789130556.709247:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00002000:00100000:0.0:1789130556.709261:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->2097151) req@ffff90b498ac4b40 x1876037605239808/t34359738391(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/448 e 0 to 0 dl 1789130567 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130556.709270:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac4b40 with x1876037605239808 ext(1048576->2097151) 00002000:00010000:0.0:1789130556.709278:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac4b40 00000100:00100000:3.0:1789130556.712810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130556.718828:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605239936 00000100:00100000:2.0:1789130556.718848:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605239936 00002000:00100000:2.0:1789130556.718940:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (2097152->3145727) req@ffff90b498ac7480 x1876037605239936/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/0 e 0 to 0 dl 1789130567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130556.718953:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac7480 with x1876037605239936 ext(2097152->3145727) 00002000:00010000:2.0:1789130556.719169:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac7480 00000100:00100000:2.0:1789130556.719213:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789130556.719225:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605239936:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130556.746514:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605239936:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 27276us (33701us total) trans 34359738392 rc 0/0 00000100:00100000:2.0:1789130556.746530:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00002000:00100000:2.0:1789130556.746546:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (2097152->3145727) req@ffff90b498ac7480 x1876037605239936/t34359738392(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/448 e 0 to 0 dl 1789130567 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130556.746558:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac7480 with x1876037605239936 ext(2097152->3145727) 00002000:00010000:2.0:1789130556.746568:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac7480 00000100:00100000:3.0:1789130556.770162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130556.770324:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240064 00000100:00100000:0.0:1789130556.770337:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240064 00002000:00100000:0.0:1789130556.770403:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (3145728->4194303) req@ffff90b498ac6d00 x1876037605240064/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/0 e 0 to 0 dl 1789130567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130556.770417:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac6d00 with x1876037605240064 ext(3145728->4194303) 00002000:00010000:0.0:1789130556.770424:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac6d00 00000100:00100000:0.0:1789130556.770461:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789130556.770472:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2367:x1876037605240064:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130556.812307:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:2367:x1876037605240064:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 41821us (42145us total) trans 34359738393 rc 0/0 00000100:00100000:0.0:1789130556.812325:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00002000:00100000:0.0:1789130556.812342:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (3145728->4194303) req@ffff90b498ac6d00 x1876037605240064/t34359738393(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:272/0 lens 488/448 e 0 to 0 dl 1789130567 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130556.812354:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac6d00 with x1876037605240064 ext(3145728->4194303) 00002000:00010000:0.0:1789130556.812363:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b498ac6d00 00000100:00100000:3.0:1789130556.821592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130556.821864:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240192 00000100:00100000:1.0:1789130556.821880:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240192 00000100:00100000:1.0:1789130556.821953:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 334 00000100:00100000:1.0:1789130556.821974:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:49596:x1876037605240192:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130556.938366:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738657 is committed 00000001:00080000:2.0:1789130556.938392:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738659 is committed 00000004:00080000:2.0:1789130556.938411:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789130556.938434:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4be62de40 refcount 2 committed 0 result 0 batchid 30064771685 00000020:00080000:2.0:1789130556.938440:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4be62d900 00000020:00080000:2.0:1789130556.938444:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386f82000 00000001:00080000:2.0:1789130556.938465:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738661 is committed 00000004:00080000:2.0:1789130556.938473:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:2.0:1789130556.938510:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771685 committed batchid 30064771684 00000020:00080000:2.0:1789130556.938773:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771684 00000100:00100000:2.0:1789130556.938930:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626924928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130556.939288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130556.939403:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626924928 00000100:00100000:2.0:1789130556.939412:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626924928 00000100:00100000:2.0:1789130556.939481:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130556.939493:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626924928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789130556.939725:0:44793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789130556.939729:0:44793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb mtime from disk: 0 -> 1789130556 00002000:00010000:2.0:1789130556.939732:0:44793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789130556.939734:0:44793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb ctime from disk: 1789130555 -> 1789130556 00002000:00010000:2.0:1789130556.939737:0:44793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130556.940292:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:49596:x1876037605240192:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 118324us (118708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130556.940306:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 334 00000100:00100000:0.0:1789130556.942414:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130556.942440:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626925056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789130556.942520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130556.942584:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626925056 00000100:00100000:0.0:1789130556.942592:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626925056 00000100:00100000:0.0:1789130556.942683:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130556.942692:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626925056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789130556.942723:0:44366:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:232 count 1 00002000:00010000:0.0:1789130556.942765:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe8:0x0] initial LVB size: 4194304, mtime: 0x6aa3f739, atime: 0x0, ctime: 0x6aa3f739, blocks: 0x1 00010000:00010000:0.0:1789130556.942775:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.942795:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=1720s v=(0 0) 00010000:00010000:0.0:1789130556.942800:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130556.942820:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.942841:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.942853:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.942862:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.942884:0:44366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130556.947412:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626924928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7909us (8112us total) trans 34359738394 rc 0/0 00000100:00100000:2.0:1789130556.947431:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000004:00080000:2.0:1789130556.947529:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b384b17480/2, rc 0, transno 34359738394 00000100:00100000:2.0:1789130556.947537:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626924928:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789130556.949776:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130556.949918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130556.950840:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240320 00000100:00100000:3.0:1789130556.950855:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240320 00000100:00100000:3.0:1789130556.950932:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130556.950945:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:2369:x1876037605240320:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789130556.951243:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130556.951255:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.951269:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789130556.951276:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.951289:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.951313:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.951322:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47cecead lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130556.951350:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130556.951351:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130556.951353:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130556.951694:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626925056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9000us (9171us total) trans 34359738396 rc 0/0 00000100:00100000:0.0:1789130556.951705:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000004:00080000:3.0:1789130556.957048:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386c6f840/2, rc 0, transno 34359738396 00000100:00100000:3.0:1789130556.957071:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626925056:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789130557.062654:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130557.087368:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738393 is committed 00000001:00080000:1.0:1789130557.087401:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738394 is committed 00000100:00100000:3.0:1789130557.089193:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605240320:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 138234us (139266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130557.089211:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:1.0:1789130557.098299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.099701:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240576 00000100:00100000:3.0:1789130557.099720:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240576 00000100:00100000:3.0:1789130557.099834:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00100000:3.0:1789130557.099846:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:49596:x1876037605240576:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130557.099931:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130557.100296:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cece98 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc70 expref: 12 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.100324:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130557.100331:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130557.100370:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.100388:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.100399:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130557.100689:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000085b21d43 reply state 00000000d1aa00f0 transno 34359738662 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.100700:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130557.100844:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:49596:x1876037605240576:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1000us (2559us total) trans 34359738662 rc 0/0 00000100:00100000:3.0:1789130557.100853:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00080000:1.0:1789130557.101398:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130557.104529:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104552:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104561:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104573:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130557.104579:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104589:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104657:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130557.104661:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130557.104667:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.104674:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ceceb4 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130557.104929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.105286:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240704 00000100:00100000:2.0:1789130557.105299:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240704 00000100:00100000:2.0:1789130557.105373:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130557.105385:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605240704:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130557.105753:0:44365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1789130557.105758:0:44365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb mtime from disk: 1789130556 -> 1789130554 00002000:00010000:2.0:1789130557.105761:0:44365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb atime from disk: 0 -> 1789130554 00002000:00010000:2.0:1789130557.105765:0:44365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb ctime from disk: 1789130556 -> 1789130554 00002000:00010000:2.0:1789130557.105767:0:44365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb blocks from disk: 1 -> 8199 00000100:00100000:2.0:1789130557.105847:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605240704:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 463us (922us total) trans 34359738395 rc 0/0 00000100:00100000:2.0:1789130557.105856:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789130557.129547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.129657:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605240960 00000100:00100000:3.0:1789130557.129669:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605240960 00000100:00100000:3.0:1789130557.129735:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 336 00000100:00100000:3.0:1789130557.129746:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:49596:x1876037605240960:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789130557.129845:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.129867:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 12 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.129878:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.129921:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 12 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.129939:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 12 pid: 45555 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.130109:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626925184:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130557.130230:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130557.133209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.133351:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626925184:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130557.133389:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130557.137948:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241088 00000100:00100000:0.0:1789130557.138088:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241088 00010000:00010000:0.0:1789130557.138159:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 13 pid: 45555 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130557.138280:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1789130557.138291:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:2369:x1876037605241088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130557.138311:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130557.138319:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 13 pid: 45555 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138335:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 13 pid: 45555 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138362:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47cece75 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc62 expref: 13 pid: 45555 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138382:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:0.0:1789130557.138388:0:43666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138399:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138408:0:43666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130557.138450:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130557.138525:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+12:2369:x1876037605241088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 236us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130557.138533:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:3.0:1789130557.138617:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138627:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138672:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138680:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138688:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138695:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130557.138700:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138709:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138719:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:3.0:1789130557.138723:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789130557.138727:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.138734:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecebb lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.138777:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:49596:x1876037605240960:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 9033us (9247us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789130557.138787:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 336 00000100:00100000:3.0:1789130557.144548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.144656:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241216 00000100:00100000:3.0:1789130557.144668:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241216 00000100:00100000:3.0:1789130557.144728:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130557.144739:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605241216:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789130557.144798:0:44367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.144822:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.144839:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789130557.144844:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130557.144850:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.144896:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.144920:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 7 pid: 44365 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.144938:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626925312:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130557.146343:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130557.152041:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:44367:1876037626925312:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130557.152092:0:44367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.165659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.165919:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241344 00000100:00100000:2.0:1789130557.165933:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241344 00010000:00010000:2.0:1789130557.166002:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 8 pid: 44365 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130557.166060:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789130557.166071:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605241344:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130557.166090:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130557.166117:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 8 pid: 44365 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.166132:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 8 pid: 44365 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.166159:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47cecea6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc7e expref: 8 pid: 44365 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.166186:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130557.166191:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130557.166197:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.166208:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.166239:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130557.166319:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605241344:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 249us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.166327:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00010000:00010000:3.0:1789130557.167132:0:44367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167147:0:44367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167182:0:44367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167191:0:44367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167200:0:44367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167214:0:44367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130557.167218:0:44367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167229:0:44367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167246:0:44367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.167254:0:44367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47cecec2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.167355:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2367:x1876037605241216:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 22615us (22820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130557.167365:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1789130557.171762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.171873:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241600 00000100:00100000:1.0:1789130557.171886:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241600 00000100:00100000:2.0:1789130557.172094:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:2.0:1789130557.172109:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:49596:x1876037605241600:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130557.172214:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172234:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172249:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172553:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172566:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172577:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172640:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.172656:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 12 pid: 43680 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130557.172673:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626925440:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130557.173471:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130557.178551:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b384b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626925440:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130557.178596:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130557.181451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.181572:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241728 00000100:00100000:2.0:1789130557.181584:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241728 00010000:00010000:2.0:1789130557.181692:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 13 pid: 43680 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130557.181733:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1789130557.181743:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:2370:x1876037605241728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130557.181760:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130557.181767:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 13 pid: 43680 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181782:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 13 pid: 43680 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181809:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5e00/0x5c74554e47cece83 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc69 expref: 13 pid: 43680 timeout: 1820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181830:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:2.0:1789130557.181836:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181847:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181855:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.181899:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130557.181977:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605241728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 235us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.181985:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:1.0:1789130557.182273:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.182282:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130557.182513:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738663 00000001:00080000:1.0:1789130557.182708:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738664 00000001:00080000:1.0:1789130557.182751:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738665 00000100:00100000:1.0:1789130557.182856:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626925568:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130557.182930:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130557.182983:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4897dfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130557.184731:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626925568 00000100:00100000:2.0:1789130557.184750:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626925568 00000100:00100000:2.0:1789130557.184840:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130557.184853:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626925568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130557.185001:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626925568:12345-0@lo:1000:mdt00_000.0 Request processed in 151us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.185019:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789130557.185785:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130557.186030:0:43679:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738394 gen 2 00000004:00080000:1.0:1789130557.186040:0:43679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b384b17480, transno 34359738394 00000100:00100000:1.0:1789130557.186059:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626925568:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789130557.186656:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738666 00000100:00100000:1.0:1789130557.186762:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626925696:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130557.186833:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130557.186869:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130557.187128:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626925696 00000100:00100000:3.0:1789130557.187136:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626925696 00000100:00100000:3.0:1789130557.187186:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130557.187196:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626925696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789130557.187441:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626925696:12345-0@lo:1000:mdt00_000.0 Request processed in 245us (606us total) trans 34359738396 rc 0/0 00000100:00100000:3.0:1789130557.187452:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130557.189387:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d08780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626925696:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789130557.189457:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189469:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189479:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189485:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130557.189491:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189500:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189518:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b497c01800) 00010000:00010000:1.0:1789130557.189522:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130557.189527:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189535:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3200/0x5c74554e47ceced0 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189575:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189582:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189589:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189626:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130557.189630:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189636:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189645:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130557.189648:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130557.189657:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189670:0:43679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189680:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.189725:0:43679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 5 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130557.189743:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626925824:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130557.189846:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130557.202895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.203777:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626925824:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789130557.203923:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.203937:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5600/0x5c74554e47cece05 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.203988:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204007:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204031:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204043:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204050:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204057:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204064:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130557.204067:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204075:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204088:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130557.204091:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130557.204095:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204102:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc2800/0x5c74554e47ceced7 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204112:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204119:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204125:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204131:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130557.204134:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204141:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204147:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130557.204149:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130557.204151:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.204157:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3400/0x5c74554e47cecec9 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130557.204490:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130557.204496:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130557.204524:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 8 count 7 00000040:00080000:2.0:1789130557.204529:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130557.204685:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:49596:x1876037605241600:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 32577us (32932us total) trans 34359738667 rc 0/0 00000100:00100000:2.0:1789130557.204702:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 337 00000020:00080000:2.0:1789130557.204709:0:43679:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789130557.206103:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605241856 00000100:00100000:0.0:1789130557.206121:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605241856 00000100:00100000:0.0:1789130557.206223:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:0.0:1789130557.206235:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605241856:12345-192.168.201.39@tcp:49:dd.0 00000100:00100000:0.0:1789130557.206413:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605241856:12345-192.168.201.39@tcp:49:dd.0 Request processed in 179us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130557.206422:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00080000:3.0:1789130557.206654:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130557.212507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.212556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.212592:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605242240 00000100:00100000:1.0:1789130557.212626:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605242240 00000100:00100000:1.0:1789130557.212686:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789130557.212697:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037605242240:12345-192.168.201.39@tcp:8:dd.0 00010000:00080000:1.0:1789130557.212738:0:44365:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp t0 exp 0000000000000000 cur 1720 last 0 00000020:00000080:1.0:1789130557.212778:0:44365:0:(genops.c:1385:class_connect()) connect: client ab440178-5f2c-43fa-b0e2-24b6c08464d6, cookie 0x5c74554e47cecede 00002000:00100000:1.0:1789130557.212802:0:44365:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab440178-5f2c-43fa-b0e2-24b6c08464d6/ffff90b386e92000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130557.212831:0:44365:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789130557.212944:0:44365:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789130557.212992:0:44365:0:(import.c:65:import_set_state_nolock()) ffff90b386e94800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130557.213078:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2366:x1876037605242240:12345-192.168.201.39@tcp:8:dd.0 Request processed in 382us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130557.213087:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130557.216350:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605242112 00000100:00100000:2.0:1789130557.216370:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605242112 00000100:00100000:2.0:1789130557.216453:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130557.216466:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:49596:x1876037605242112:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789130557.217700:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130557.218825:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738668 00010000:00010000:2.0:1789130557.218918:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.218941:0:43682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.218954:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.219450:0:43682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.219460:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.219468:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.219494:0:43682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130557.219717:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130557.219726:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.219735:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386fc3000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130557.219739:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.219749:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.219765:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1f:0x0].0x0 (ffff90b482b51900) 00010000:00010000:3.0:1789130557.219769:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130557.219775:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.219781:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386fc3000/0x5c74554e47cecee5 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.219973:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130557.219976:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130557.219978:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130557.222030:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:49596:x1876037605242112:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 5539us (9509us total) trans 34359738669 rc 0/0 00000100:00100000:2.0:1789130557.222054:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000020:00080000:2.0:1789130557.222066:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789130557.222356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.222669:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605242368 00000100:00100000:2.0:1789130557.222681:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605242368 00000100:00100000:2.0:1789130557.222746:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789130557.222756:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605242368:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789130557.222778:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130557.222805:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc85 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130557.222841:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe8:0x0] initial LVB size: 4194304, mtime: 0x6aa3f73a, atime: 0x6aa3f73a, ctime: 0x6aa3f73a, blocks: 0x2007 00010000:00010000:2.0:1789130557.222878:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=1720s v=(0 0) 00010000:00010000:2.0:1789130557.222884:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130557.222895:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.222914:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 7 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.222931:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386fc3400, rc 0) 00000100:00100000:2.0:1789130557.223019:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:49595:x1876037605242368:12345-192.168.201.39@tcp:101:dd.0 Request processed in 253us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.223026:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00080000:2.0:1789130557.223046:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130557.227314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.237171:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605242496 00000100:00100000:2.0:1789130557.237190:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605242496 00002000:00010000:2.0:1789130557.237251:0:44371:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/232 (1048576->18446744073709551615) 00002000:00100000:2.0:1789130557.237257:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ea8000 with x1876037605242496 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1789130557.237273:0:44371:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386ea8000. 00000100:00100000:2.0:1789130557.237310:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789130557.237320:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:2370:x1876037605242496:12345-192.168.201.39@tcp:10:dd.0 00000001:00080000:2.0:1789130557.270922:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738396 is committed 00000001:00080000:2.0:1789130557.270941:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738391 is committed 00000001:00080000:2.0:1789130557.270972:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738394 is committed 00000001:00100000:0.0:1789130557.299926:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000001:00080000:0.0:1789130557.300248:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738397 is committed 00000001:00080000:0.0:1789130557.300258:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738395 is committed 00000001:00080000:0.0:1789130557.300266:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738396 is committed 00002000:00010000:3.0:1789130557.300365:0:44371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb size from disk: 4194304 -> 1048576 00002000:00010000:3.0:1789130557.300370:0:44371:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb mtime from disk: 1789130554 -> 1789130554 00002000:00010000:3.0:1789130557.300373:0:44371:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb atime from disk: 1789130554 -> 1789130554 00002000:00010000:3.0:1789130557.300376:0:44371:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb ctime from disk: 1789130554 -> 1789130554 00002000:00010000:3.0:1789130557.300378:0:44371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb blocks from disk: 8199 -> 2055 00000100:00100000:3.0:1789130557.300511:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605242496:12345-192.168.201.39@tcp:10:dd.0 Request processed in 63184us (73546us total) trans 34359738397 rc 0/0 00000100:00100000:3.0:1789130557.300525:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00002000:00010000:3.0:1789130557.300531:0:44371:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/232 (1048576->18446744073709551615) 00002000:00100000:3.0:1789130557.300535:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ea8000 with x1876037605242496 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1789130557.300543:0:44371:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386ea8000. 00000100:00100000:1.0:1789130557.304459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130557.304577:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605242752 00000100:00100000:0.0:1789130557.304591:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605242752 00000100:00100000:0.0:1789130557.307220:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 338 00000100:00100000:0.0:1789130557.307257:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:49595:x1876037605242752:12345-192.168.201.39@tcp:55:dd.0 00010000:00010000:1.0:1789130557.307469:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307492:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307506:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307768:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307778:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307786:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307793:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130557.307798:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307820:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307833:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130557.307837:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789130557.307843:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.307849:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47cecef3 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130557.308032:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:49595:x1876037605242752:12345-192.168.201.39@tcp:55:dd.0 Request processed in 793us (3585us total) trans 34359738670 rc 0/0 00000100:00100000:1.0:1789130557.308042:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 338 00000100:00100000:2.0:1789130557.321673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.322632:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243008 00000100:00100000:3.0:1789130557.322648:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243008 00000100:00100000:3.0:1789130557.322739:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789130557.322751:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:49595:x1876037605243008:12345-192.168.201.39@tcp:35:dd.0 00000001:00080000:3.0:1789130557.323122:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738671 00000100:00100000:3.0:1789130557.323267:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49595:x1876037605243008:12345-192.168.201.39@tcp:35:dd.0 Request processed in 516us (1663us total) trans 34359738672 rc 0/0 00000100:00100000:3.0:1789130557.323275:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000020:00080000:3.0:1789130557.323281:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789130557.365325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.365444:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243136 00000100:00100000:1.0:1789130557.365458:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243136 00000100:00100000:1.0:1789130557.365543:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:1.0:1789130557.365556:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+9:49599:x1876037605243136:12345-192.168.201.39@tcp:101:md5sum.0 00010000:00010000:1.0:1789130557.365588:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130557.365637:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecefa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc8c expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.365715:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.365737:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.365751:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130557.366077:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130557.366082:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130557.366189:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.366218:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47cecefa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 11 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.366237:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 10 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.366248:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130557.366251:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130557.366256:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f600, rc 0) 00000100:00100000:1.0:1789130557.366358:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+10:49599:x1876037605243136:12345-192.168.201.39@tcp:101:md5sum.0 Request processed in 805us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130557.366366:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:1.0:1789130557.372494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.372696:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243392 00000100:00100000:3.0:1789130557.372710:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243392 00000100:00100000:3.0:1789130557.372783:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 340 00000100:00100000:3.0:1789130557.372802:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+10:49599:x1876037605243392:12345-192.168.201.39@tcp:101:md5sum.0 00010000:00010000:3.0:1789130557.372829:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130557.372856:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cecf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc93 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.372945:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373144:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373159:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373177:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373184:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373191:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373559:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373569:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373576:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130557.373587:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:3.0:1789130557.373735:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373743:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373752:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373759:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130557.373764:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373773:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373787:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:3.0:1789130557.373791:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130557.373796:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373803:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4200/0x5c74554e47cecf0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373816:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373822:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373828:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373833:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130557.373836:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373842:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373853:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b488939000) 00010000:00010000:3.0:1789130557.373855:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130557.373858:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373864:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47cecf16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373924:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47cecf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 13 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.373938:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130557.374391:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130557.374396:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130557.374399:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:3.0:1789130557.374496:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+12:49599:x1876037605243392:12345-192.168.201.39@tcp:101:md5sum.0 Request processed in 1701us (2013us total) trans 34359738673 rc 0/0 00000100:00100000:3.0:1789130557.374507:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 340 00000100:00100000:3.0:1789130557.382082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130557.389357:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243520 00000100:00100000:0.0:1789130557.389379:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243520 00002000:00100000:0.0:1789130557.389468:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (0->32767) req@ffff90b386eab840 x1876037605243520/t0(0) o3->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:273/0 lens 488/0 e 0 to 0 dl 1789130568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130557.389481:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386eab840 with x1876037605243520 ext(0->32767) 00002000:00010000:0.0:1789130557.389488:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386eab840 00000100:00100000:0.0:1789130557.389528:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789130557.389539:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605243520:12345-192.168.201.39@tcp:3:md5sum.0 00000100:00100000:0.0:1789130557.395791:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605243520:12345-192.168.201.39@tcp:3:md5sum.0 Request processed in 6236us (13706us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1789130557.395816:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00002000:00100000:0.0:1789130557.395832:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (0->32767) req@ffff90b386eab840 x1876037605243520/t0(0) o3->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:273/0 lens 488/440 e 0 to 0 dl 1789130568 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130557.395851:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386eab840 with x1876037605243520 ext(0->32767) 00002000:00010000:0.0:1789130557.395861:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386eab840 00000100:00100000:2.0:1789130557.407404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.407502:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243648 00000100:00100000:3.0:1789130557.407515:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243648 00002000:00100000:3.0:1789130557.407579:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (32768->1048575) req@ffff90b384b15a40 x1876037605243648/t0(0) o3->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:273/0 lens 488/0 e 0 to 0 dl 1789130568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130557.407592:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15a40 with x1876037605243648 ext(32768->1048575) 00002000:00010000:3.0:1789130557.407599:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15a40 00000100:00100000:3.0:1789130557.407672:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789130557.407682:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605243648:12345-192.168.201.39@tcp:3:md5sum.0 00000100:00100000:3.0:1789130557.478688:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605243648:12345-192.168.201.39@tcp:3:md5sum.0 Request processed in 70991us (71283us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1789130557.478705:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00002000:00100000:3.0:1789130557.478722:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (32768->1048575) req@ffff90b384b15a40 x1876037605243648/t0(0) o3->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:273/0 lens 488/440 e 0 to 0 dl 1789130568 ref 1 fl Complete:/600/0 rc 1015808/1015808 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130557.478734:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b384b15a40 with x1876037605243648 ext(32768->1048575) 00002000:00010000:3.0:1789130557.478743:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b384b15a40 00000100:00100000:2.0:1789130557.492270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130557.492374:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605243904 00000100:00100000:3.0:1789130557.492385:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605243904 00000100:00100000:3.0:1789130557.492454:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130557.492465:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+12:49599:x1876037605243904:12345-192.168.201.39@tcp:35:md5sum.0 00000100:00100000:3.0:1789130557.493079:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+13:49599:x1876037605243904:12345-192.168.201.39@tcp:35:md5sum.0 Request processed in 612us (819us total) trans 34359738674 rc 0/0 00000100:00100000:3.0:1789130557.493089:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1789130557.566758:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.567089:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244032 00000100:00100000:1.0:1789130557.567102:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244032 00000100:00100000:1.0:1789130557.567181:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:1.0:1789130557.567193:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:49604:x1876037605244032:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130557.567229:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130557.567255:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecf2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acc9a expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.567340:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.567357:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.567371:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130557.567651:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130557.567656:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130557.567732:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.567760:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecf2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc9a expref: 19 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.567779:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc9a expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130557.568403:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130557.568410:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130557.568415:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130557.568506:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:49604:x1876037605244032:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1313us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130557.568515:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:1.0:1789130557.588404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130557.590014:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244160 00000100:00100000:2.0:1789130557.590033:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244160 00000100:00100000:2.0:1789130557.590124:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 342 00000100:00100000:2.0:1789130557.590136:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:49604:x1876037605244160:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130557.590163:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130557.590192:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecf39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acca1 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590273:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590291:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590310:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590327:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590334:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590341:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590739:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590751:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590759:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130557.590809:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00000004:00200000:2.0:1789130557.590814:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130557.590836:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590849:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590858:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590869:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590877:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590884:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130557.590888:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590896:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590910:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:2.0:1789130557.590914:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130557.590919:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590926:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1200/0x5c74554e47cecf40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590952:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590960:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590966:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590970:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b383ce1000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130557.590975:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590981:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.590988:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b482b51500) 00010000:00010000:2.0:1789130557.590990:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130557.590993:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.591000:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce1000/0x5c74554e47cecf47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.591047:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0600/0x5c74554e47cecf39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.591062:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 19 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130557.591069:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130557.591072:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130557.591075:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce0c00, rc 0) 00000100:00100000:2.0:1789130557.591177:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+19:49604:x1876037605244160:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1042us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.591186:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 342 00000100:00100000:3.0:1789130557.702175:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626926080:0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.702540:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626925952:0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.702586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130557.702680:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130557.702686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626926336:0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.702722:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626925952 00000100:00100000:1.0:1789130557.702730:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626925952 00000100:00100000:1.0:1789130557.702789:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789130557.702799:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626925952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.702855:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626925952:12345-0@lo:400:kworker.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130557.702864:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789130557.702929:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626926208:0@lo:400:kworker.0 00000100:00100000:2.0:1789130557.703289:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130557.703300:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626926464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130557.703336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130557.703425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130557.703516:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626926464 00000100:00100000:0.0:1789130557.703522:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626926464 00000100:00100000:0.0:1789130557.703571:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130557.703579:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626926464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130557.703639:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1789130557.703682:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626926464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130557.703689:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130557.703725:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738396 gen 2 00000004:00080000:0.0:1789130557.703731:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738395 committed transno 34359738396 00000004:00080000:0.0:1789130557.703757:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386c6f840, transno 34359738396 00000100:00100000:0.0:1789130557.703775:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626926464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130557.704344:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626926080 00000100:00100000:2.0:1789130557.704350:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626926080 00000100:00100000:2.0:1789130557.704395:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789130557.704402:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626926080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130557.704453:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626926080:12345-0@lo:400:kworker.0 Request processed in 51us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130557.704460:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130557.706322:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626926080:0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.706429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130557.706502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130557.706537:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626925952:0@lo:400:kworker.0 00000100:00100000:3.0:1789130557.706641:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626926208 00000100:00100000:3.0:1789130557.706649:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626926208 00000100:00100000:3.0:1789130557.706713:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626926336 00000100:00100000:3.0:1789130557.706716:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626926336 00000100:00100000:3.0:1789130557.706738:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130557.706747:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626926208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130557.706846:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626926208:12345-0@lo:400:kworker.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130557.706854:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130557.706872:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130557.706878:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626926336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130557.706909:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626926336:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130557.706915:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789130557.707118:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626926208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130557.707144:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626926336:0@lo:400:kworker.0 00000100:00080000:0.0:1789130557.708074:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130557.995665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130557.995806:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244288 00000100:00100000:1.0:1789130557.995822:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244288 00000100:00100000:1.0:1789130557.995917:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789130557.995929:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605244288:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130557.995959:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130557.995986:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d8c159/0x5c74554e47cecf55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acca8 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130557.996083:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626926592:192.168.201.39@tcp:106: 00000100:00100000:1.0:1789130557.996213:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55b40 going to sleep for 11 seconds 00002000:00010000:1.0:1789130558.000798:0:44365:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb size: 1048576 -> 1049600 00002000:00010000:1.0:1789130558.000814:0:44365:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb mtime: 1789130554 -> 1789130557 00002000:00010000:1.0:1789130558.000817:0:44365:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb atime: 1789130554 -> 1789130557 00002000:00010000:1.0:1789130558.000819:0:44365:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xe8:0x0] updating lvb ctime: 1789130554 -> 1789130557 00000100:00100000:1.0:1789130558.000860:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828eb840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626926592:192.168.201.39@tcp:106: 00010000:00010000:1.0:1789130558.000932:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090d8c159/0x5c74554e47cecf55 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acca8 expref: 6 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.000965:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d8c159/0x5c74554e47cecf55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acca8 expref: 6 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.000981:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130558.001080:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2370:x1876037605244288:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5153us (5430us total) trans 0 rc 301/301 00000100:00100000:1.0:1789130558.006702:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789130558.014264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130558.015078:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244544 00000100:00100000:3.0:1789130558.015092:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244544 00000100:00100000:3.0:1789130558.015167:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:3.0:1789130558.015180:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+19:49632:x1876037605244544:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130558.015209:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130558.015237:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecf5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accaf expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015391:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015409:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015416:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015425:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 5/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015475:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.015490:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 20 pid: 45555 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130558.015505:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaa580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626926720:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130558.017683:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 12 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.017704:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 12 pid: 43680 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130558.017721:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386ea83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626926848:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130558.017840:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130558.035293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.035325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130558.035449:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaa580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626926720:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130558.035463:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386ea83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626926848:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130558.035510:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.035822:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244672 00000100:00100000:2.0:1789130558.035830:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244672 00010000:00010000:2.0:1789130558.035883:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 21 pid: 45555 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.035922:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605244800 00000100:00100000:2.0:1789130558.035925:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605244800 00010000:00010000:2.0:1789130558.035938:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 13 pid: 43680 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.035973:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130558.035983:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:2369:x1876037605244672:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130558.036010:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130558.036018:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 21 pid: 45555 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036030:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 21 pid: 45555 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036060:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b383ce0c00/0x5c74554e47cecf4e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acca1 expref: 21 pid: 45555 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036081:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130558.036086:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036096:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036104:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130558.036169:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:2369:x1876037605244672:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 188us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130558.036177:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789130558.036196:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1789130558.036203:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+13:2369:x1876037605244800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130558.036210:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130558.036215:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 13 pid: 43680 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036225:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 13 pid: 43680 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036237:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47cecf1d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc93 expref: 13 pid: 43680 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036248:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:2.0:1789130558.036251:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036263:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036272:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.036291:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130558.036311:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+12:2369:x1876037605244800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 109us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130558.036317:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00010000:00010000:3.0:1789130558.036506:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.036514:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130558.036541:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:3.0:1789130558.036786:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47cecf5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accaf expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.036803:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accaf expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130558.036810:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:3.0:1789130558.036813:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130558.036815:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:3.0:1789130558.036849:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:49632:x1876037605244544:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 21672us (22601us total) trans 34359738675 rc 0/0 00000100:00100000:3.0:1789130558.036857:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:0.0:1789130558.046664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.048229:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245056 00000100:00100000:1.0:1789130558.048247:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245056 00000100:00100000:1.0:1789130558.048335:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 344 00000100:00100000:1.0:1789130558.048356:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+20:49632:x1876037605245056:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130558.048387:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130558.048391:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130558.048427:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47cecf63 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accaf expref: 20 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048449:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130558.048456:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130558.048473:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecf71 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accb6 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048592:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048653:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048666:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130558.048681:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:1.0:1789130558.048851:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47cecf71 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accb6 expref: 22 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048867:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accb6 expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.048874:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130558.048877:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130558.048879:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130558.048984:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:49632:x1876037605245056:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 639us (2336us total) trans 34359738676 rc 0/0 00000100:00100000:1.0:1789130558.049006:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 344 00000100:00100000:2.0:1789130558.056801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.056904:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245184 00000100:00100000:0.0:1789130558.056916:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245184 00000100:00100000:0.0:1789130558.057041:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:0.0:1789130558.057054:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+21:49632:x1876037605245184:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130558.057085:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130558.057114:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accbd expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.057198:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 22 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.057214:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 22 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.057235:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130558.057238:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130558.057244:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130558.057322:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+22:49632:x1876037605245184:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 271us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.057330:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:3.0:1789130558.065329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130558.065670:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245312 00000100:00100000:2.0:1789130558.065682:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245312 00000100:00100000:2.0:1789130558.065771:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789130558.065784:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:49632:x1876037605245312:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130558.065814:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130558.065846:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accc4 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.065890:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 5 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.065900:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130558.065905:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130558.065911:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 4/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 6 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.066319:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 5 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.066339:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 5 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.066358:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626926976:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130558.066476:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789130558.066548:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130558.072808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.073291:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626926976:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130558.073336:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 3/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 6 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.073366:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b383ce1800, rc 0) 00000100:00100000:0.0:1789130558.073444:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:49632:x1876037605245312:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 7664us (8132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.073455:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130558.073725:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245440 00000100:00100000:1.0:1789130558.073734:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245440 00002000:00100000:1.0:1789130558.073809:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->1049599) req@ffff90b386eaa580 x1876037605245440/t0(0) o4->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:274/0 lens 1512/0 e 0 to 0 dl 1789130569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130558.073819:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386eaa580 with x1876037605245440 ext(1048576->1049599) 00010000:00010000:1.0:1789130558.073828:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 6 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.073842:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 6 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130558.073852:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386eaa580 00000100:00100000:1.0:1789130558.073888:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789130558.073899:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2370:x1876037605245440:12345-192.168.201.39@tcp:4:md5sum.0 00000100:00100000:0.0:1789130558.078347:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:2370:x1876037605245440:12345-192.168.201.39@tcp:4:md5sum.0 Request processed in 4434us (5543us total) trans 34359738398 rc 0/0 00000100:00100000:0.0:1789130558.078366:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00100000:0.0:1789130558.078382:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->1049599) req@ffff90b386eaa580 x1876037605245440/t34359738398(0) o4->ab440178-5f2c-43fa-b0e2-24b6c08464d6@192.168.201.39@tcp:274/0 lens 1512/448 e 0 to 0 dl 1789130569 ref 1 fl Complete:H/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130558.078395:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386eaa580 with x1876037605245440 ext(1048576->1049599) 00010000:00010000:0.0:1789130558.078408:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.078437:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130558.078446:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b386eaa580 00010000:00010000:2.0:1789130558.087651:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130558.104707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.105266:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245568 00000100:00100000:1.0:1789130558.105280:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245568 00010000:00010000:1.0:1789130558.105342:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.105393:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789130558.105405:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+8:2370:x1876037605245568:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130558.105423:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130558.105451:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.105469:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.105497:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e24a98b7/0x5c74554e47ceceec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc85 expref: 8 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.105530:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130558.105535:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130558.105546:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 5 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.105557:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 5 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.105655:0:45795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 5 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.105673:0:45795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:45795:1876037626927104:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130558.105784:0:45795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130558.119388:0:45795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:45795:1876037626927104:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130558.119431:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130558.119506:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:2370:x1876037605245568:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 14101us (14810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.119519:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:2.0:1789130558.127952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130558.129506:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245696 00000100:00100000:3.0:1789130558.129527:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245696 00002000:00100000:2.0:1789130558.129775:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (0->1048575) req@ffff90b4bae78f00 x1876037605245696/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:274/0 lens 488/0 e 0 to 0 dl 1789130569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130558.129855:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bae78f00 with x1876037605245696 ext(0->1048575) 00002000:00010000:2.0:1789130558.129864:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bae78f00 00000100:00100000:2.0:1789130558.129967:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789130558.129980:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605245696:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:3.0:1789130558.170782:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605245696:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 40783us (42842us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789130558.170814:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00002000:00100000:3.0:1789130558.170832:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe8:0x0] (0->1048575) req@ffff90b4bae78f00 x1876037605245696/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:274/0 lens 488/440 e 0 to 0 dl 1789130569 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130558.170845:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bae78f00 with x1876037605245696 ext(0->1048575) 00002000:00010000:3.0:1789130558.170855:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b4bae78f00 00000100:00100000:0.0:1789130558.197842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130558.199365:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245824 00000100:00100000:2.0:1789130558.199385:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245824 00002000:00100000:2.0:1789130558.199470:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->1052671) req@ffff90b386f68780 x1876037605245824/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:274/0 lens 488/0 e 0 to 0 dl 1789130569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130558.199484:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f68780 with x1876037605245824 ext(1048576->1052671) 00002000:00010000:2.0:1789130558.199492:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386f68780 00000100:00100000:2.0:1789130558.199539:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789130558.199551:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605245824:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:2.0:1789130558.199889:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2370:x1876037605245824:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 339us (2062us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789130558.199898:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00002000:00100000:2.0:1789130558.199906:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe8:0x0] (1048576->1052671) req@ffff90b386f68780 x1876037605245824/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:274/0 lens 488/4536 e 0 to 0 dl 1789130569 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130558.199915:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386f68780 with x1876037605245824 ext(1048576->1052671) 00002000:00010000:2.0:1789130558.199919:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b386f68780 00000100:00100000:2.0:1789130558.246776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.246896:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605245952 00000100:00100000:0.0:1789130558.246919:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605245952 00000100:00100000:0.0:1789130558.247029:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789130558.247048:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605245952:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:0.0:1789130558.247121:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.247149:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 6 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.247159:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130558.247164:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130558.247169:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.247213:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 6 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.247231:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 6 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.247249:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f06580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626927232:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130558.247391:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4afaef480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130558.263380:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f06580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626927232:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130558.263426:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.268281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.268443:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246080 00000100:00100000:0.0:1789130558.268455:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246080 00010000:00010000:0.0:1789130558.268513:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 7 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.268565:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789130558.268577:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605246080:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130558.268596:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130558.268755:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 7 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.268773:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 7 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.268808:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1b9c20e/0x5c74554e47cecf8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592accc4 expref: 7 pid: 44793 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.268829:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130558.268835:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130558.268842:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.268853:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.269095:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130558.269174:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605246080:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 598us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.269183:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00010000:00010000:1.0:1789130558.276216:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276247:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276400:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276411:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276422:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276430:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130558.276435:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276445:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276471:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.276479:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a99f2f/0x5c74554e47cecf94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.276803:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605245952:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 29756us (30035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.276818:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130558.293966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.296063:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246336 00000100:00100000:0.0:1789130558.296085:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246336 00000100:00100000:0.0:1789130558.296180:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1789130558.296194:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:49632:x1876037605246336:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789130558.296291:0:43682:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accb6 expref: 22 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130558.296598:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738677 00000001:00080000:0.0:1789130558.298259:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738678 00010000:00010000:0.0:1789130558.298363:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298389:0:43682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 11 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298400:0:43682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298411:0:43682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298462:0:43682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 25 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298483:0:43682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 25 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.298500:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f06580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626927360:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130558.298678:0:43682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 11 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.298689:0:43682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 11 pid: 43679 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.298698:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626927488:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130558.298725:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130558.315076:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f06580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626927360:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130558.315110:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:43682:1876037626927488:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130558.315156:0:43682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130558.315712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130558.315758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.315853:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246592 00000100:00100000:1.0:1789130558.315862:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246592 00010000:00010000:1.0:1789130558.315918:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 12 pid: 43679 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.315955:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246464 00000100:00100000:1.0:1789130558.315958:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246464 00010000:00010000:1.0:1789130558.315975:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 26 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.316020:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1789130558.316031:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+12:2369:x1876037605246592:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130558.316051:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130558.316059:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 12 pid: 43679 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316071:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 12 pid: 43679 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316100:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cece0c lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc46 expref: 12 pid: 43679 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316119:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130558.316127:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316137:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316144:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130558.316203:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+11:2369:x1876037605246592:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 174us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.316211:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1789130558.316232:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:1.0:1789130558.316239:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+26:2370:x1876037605246464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130558.316247:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130558.316253:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 26 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316281:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 26 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316294:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47cecf86 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accbd expref: 26 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316305:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:1.0:1789130558.316309:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316317:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316330:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.316353:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130558.316372:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+25:2370:x1876037605246464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 134us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.316379:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00010000:00010000:0.0:1789130558.317471:0:43682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.317488:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789130558.317717:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738679 00000001:00080000:0.0:1789130558.318034:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738680 00000100:00100000:0.0:1789130558.318179:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626927616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789130558.319414:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130558.319466:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789130558.319650:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626927616 00000100:00100000:3.0:1789130558.319661:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626927616 00000100:00100000:3.0:1789130558.319725:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789130558.319736:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626927616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130558.319851:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626927616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130558.319872:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130558.321531:0:43682:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738396 gen 2 00000004:00080000:1.0:1789130558.321559:0:43682:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738396 committed transno 34359738396 00000100:00100000:1.0:1789130558.321598:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626927616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789130558.326725:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738681 00000100:00100000:1.0:1789130558.327286:0:43682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626927744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789130558.328232:0:43682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130558.328290:0:43682:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130558.328852:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626927744 00000100:00100000:3.0:1789130558.328871:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626927744 00000100:00100000:3.0:1789130558.328949:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130558.328961:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43682:x1876037626927744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130558.332671:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43682:x1876037626927744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 3079us (3809us total) trans 34359738399 rc 0/0 00000100:00100000:1.0:1789130558.332905:0:43682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:43682:1876037626927744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789130558.333154:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:00080000:1.0:1789130558.334495:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738682 00010000:00010000:0.0:1789130558.334801:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334816:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334824:0:43682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334831:0:43682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130558.334837:0:43682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334847:0:43682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334882:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130558.334887:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789130558.334893:0:43682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.334900:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecf9b lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130558.335542:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x20:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789130558.335786:0:43682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].10, 64 off8880 00000004:00080000:0.0:1789130558.335801:0:43682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1721433197795ns, next at 1722433194932ns, rc = 0 00000001:00080000:0.0:1789130558.335810:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738683 00010000:00010000:0.0:1789130558.335871:0:43682:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b488939f00) 00010000:00010000:0.0:1789130558.335874:0:43682:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130558.335885:0:43682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47cecf78 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accb6 expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.336065:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:49632:x1876037605246336:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 39873us (42113us total) trans 34359738684 rc 0/0 00000100:00100000:0.0:1789130558.336076:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000020:00080000:0.0:1789130558.336083:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1789130558.341331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.341443:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246720 00000100:00100000:1.0:1789130558.341456:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246720 00000100:00100000:1.0:1789130558.341541:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 346 00000100:00100000:1.0:1789130558.341652:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:49632:x1876037605246720:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130558.341687:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130558.341720:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cecfa2 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acccb expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.342495:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cecfa2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acccb expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.342520:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cecfa2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acccb expref: 29 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.342708:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130558.342712:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130558.342717:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130558.344310:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:49632:x1876037605246720:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2392us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.344461:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 346 00000100:00100000:3.0:1789130558.358319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.358406:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605246976 00000100:00100000:1.0:1789130558.358419:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605246976 00000100:00100000:1.0:1789130558.358500:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789130558.358514:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:49632:x1876037605246976:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130558.358906:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:49632:x1876037605246976:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 395us (601us total) trans 34359738685 rc 0/0 00000100:00100000:1.0:1789130558.358915:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130558.543965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.545396:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605247104 00000100:00100000:0.0:1789130558.545415:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605247104 00000100:00100000:0.0:1789130558.545517:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:0.0:1789130558.545529:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+30:49647:x1876037605247104:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789130558.545561:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130558.545592:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accd2 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545733:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545751:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545765:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545782:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545789:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.545796:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547738:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547759:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547771:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130558.547824:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00000004:00200000:0.0:1789130558.547830:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130558.547887:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547907:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547917:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547925:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547933:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547940:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130558.547944:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547952:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.547978:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130558.547981:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130558.547997:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.548005:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.548019:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.548026:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.548033:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552257:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130558.552267:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552281:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552306:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a7a9c8 (ffff90b497c01300) 00010000:00010000:0.0:1789130558.552310:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130558.552316:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552325:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91a7a9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552408:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552425:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 31 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.552433:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130558.552435:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130558.552438:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130558.552543:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:49647:x1876037605247104:12345-192.168.201.39@tcp:101:stat.0 Request processed in 7014us (8593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.552560:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:2.0:1789130558.654750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.654973:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605247360 00000100:00100000:0.0:1789130558.654996:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605247360 00000100:00100000:0.0:1789130558.655087:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:0.0:1789130558.655101:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+31:49656:x1876037605247360:12345-192.168.201.39@tcp:101:md5sum.0 00010000:00010000:0.0:1789130558.655131:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130558.655161:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accd9 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.655588:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfcc lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.655667:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfcc lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.655682:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfcc lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130558.655696:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:0.0:1789130558.655878:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd9 expref: 34 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.655900:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfcc lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd9 expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.655910:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130558.655914:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789130558.655918:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130558.656015:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:49656:x1876037605247360:12345-192.168.201.39@tcp:101:md5sum.0 Request processed in 917us (1280us total) trans 34359738686 rc 0/0 00000100:00100000:0.0:1789130558.656025:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:3.0:1789130558.741185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.741366:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605247616 00000100:00100000:0.0:1789130558.741379:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605247616 00000100:00100000:0.0:1789130558.741461:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 349 00000100:00100000:0.0:1789130558.741474:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:49662:x1876037605247616:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130558.741506:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130558.741534:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acce0 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.741716:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.741733:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.741742:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.741785:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.741800:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 34 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.741816:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626927872:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130558.742007:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130558.749059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.750043:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605247744 00000100:00100000:1.0:1789130558.750055:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605247744 00010000:00010000:1.0:1789130558.750117:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 35 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130558.750163:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789130558.750174:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:2369:x1876037605247744:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130558.750198:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130558.750206:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 35 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.750223:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 35 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.750252:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130558.750257:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.750269:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.750278:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130558.750302:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130558.750380:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:2369:x1876037605247744:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 207us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130558.750389:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:0.0:1789130558.750544:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecfbe lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592accd2 expref: 34 pid: 43681 timeout: 1821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130558.750563:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626927872:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130558.750591:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.750644:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.750651:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130558.750684:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:0.0:1789130558.750863:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce0 expref: 35 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.750878:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2c00/0x5c74554e47cecfe1 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce0 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.750887:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130558.750890:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789130558.750893:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2c00, rc 0) 00000100:00100000:0.0:1789130558.750948:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:49662:x1876037605247616:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 9478us (9779us total) trans 34359738687 rc 0/0 00000100:00100000:0.0:1789130558.750956:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 349 00000100:00100000:3.0:1789130558.760599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130558.760768:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248128 00000100:00100000:1.0:1789130558.760791:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248128 00000100:00100000:1.0:1789130558.760864:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130558.760878:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:49662:x1876037605248128:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130558.761284:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:49662:x1876037605248128:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 408us (697us total) trans 34359738688 rc 0/0 00000100:00100000:1.0:1789130558.761293:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789130558.764289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130558.764419:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248256 00000100:00100000:2.0:1789130558.764432:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248256 00000100:00100000:2.0:1789130558.764517:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789130558.764529:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:49662:x1876037605248256:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1789130558.764549:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789130558.764581:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47cecfcc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accd9 expref: 35 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.764656:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47cecfa2 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acccb expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130558.764675:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:2.0:1789130558.764681:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130558.764750:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:49662:x1876037605248256:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 223us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130558.764759:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1789130558.771895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.772177:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248384 00000100:00100000:0.0:1789130558.772191:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248384 00000100:00100000:0.0:1789130558.772276:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 350 00000100:00100000:0.0:1789130558.772289:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:49662:x1876037605248384:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:0.0:1789130558.772425:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.772446:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.772461:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130558.773116:0:45555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].8, 136 off9280 00000100:00100000:0.0:1789130558.773240:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:49662:x1876037605248384:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 950us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.773250:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 350 00000100:00100000:3.0:1789130558.775759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130558.776496:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248512 00000100:00100000:0.0:1789130558.776509:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248512 00000100:00100000:0.0:1789130558.776594:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 351 00000100:00100000:0.0:1789130558.776654:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:49662:x1876037605248512:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130558.776682:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130558.776711:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acce7 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776803:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776815:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776841:0:43681:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776857:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776875:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130558.776879:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130558.776883:0:43681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 34 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130558.776892:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f2200, rc 0) 00000100:00100000:0.0:1789130558.776993:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:49662:x1876037605248512:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 379us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130558.777001:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 351 00010000:00010000:3.0:1789130559.113222:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130559.239172:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130559.239186:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130559.239251:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 9 count 8 00000040:00080000:2.0:1789130559.239260:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130559.239439:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626928000:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130559.239582:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130559.244511:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626928000:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130559.245858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.248551:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248640 00000100:00100000:0.0:1789130559.248567:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248640 00000100:00100000:0.0:1789130559.248801:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 352 00000100:00100000:0.0:1789130559.248818:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:49663:x1876037605248640:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130559.248854:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130559.248987:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:49663:x1876037605248640:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 176us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.248995:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 352 00000100:00100000:3.0:1789130559.255455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.255827:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605248768 00000100:00100000:0.0:1789130559.255836:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605248768 00000100:00100000:0.0:1789130559.255886:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 353 00000100:00100000:0.0:1789130559.255894:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:49663:x1876037605248768:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.255966:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.255991:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256003:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256026:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256033:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256039:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256064:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256072:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256078:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130559.256115:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00000004:00200000:0.0:1789130559.256120:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130559.256132:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256142:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256151:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256157:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256162:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.256166:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256173:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256184:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130559.256187:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130559.256191:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256196:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47cecffd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256207:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256213:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256218:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256223:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.256226:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256231:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256237:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x231127a9 (ffff90b497c01300) 00010000:00010000:0.0:1789130559.256240:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130559.256242:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256248:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced004 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x231127a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256262:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256268:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256477:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256482:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.256485:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256490:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.256498:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130559.256500:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130559.256504:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789130559.256509:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130559.256509:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced00b lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.256744:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:49663:x1876037605248768:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 849us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.256753:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 353 00000100:00100000:3.0:1789130559.259237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.259544:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249024 00000100:00100000:0.0:1789130559.259552:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249024 00000100:00100000:0.0:1789130559.259635:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 354 00000100:00100000:0.0:1789130559.259646:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:49663:x1876037605249024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.259668:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130559.259689:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced012 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accee expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259795:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259811:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259824:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130559.259836:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:0.0:1789130559.259933:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259941:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259948:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259954:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.259957:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259965:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.259988:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:0.0:1789130559.259991:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130559.259996:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.260001:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced019 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.260037:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced012 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accee expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.260044:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130559.260045:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789130559.260048:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced012 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accee expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.260054:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130559.260105:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605249024:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 463us (877us total) trans 34359738689 rc 301/301 00000100:00100000:0.0:1789130559.260114:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 354 00000100:00100000:2.0:1789130559.263926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.264056:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249152 00000100:00100000:3.0:1789130559.264065:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249152 00000100:00100000:3.0:1789130559.264152:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 355 00000100:00100000:3.0:1789130559.264161:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605249152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789130559.264200:0:43680:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789130559.264299:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605249152:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.264307:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 355 00000100:00100000:3.0:1789130559.272522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.272570:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249408 00000100:00100000:0.0:1789130559.272581:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249408 00000100:00100000:0.0:1789130559.272965:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 356 00000100:00100000:0.0:1789130559.272990:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605249408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.273013:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130559.273016:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130559.273042:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47cecf32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc9a expref: 35 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.273061:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130559.273066:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130559.273080:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced027 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accf5 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789130559.274020:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe9:0x0], index 1: 0 00010000:00010000:0.0:1789130559.274184:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced02e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.274196:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced02e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.274203:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced02e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.274241:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced027 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accf5 expref: 37 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.274255:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced02e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accf5 expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.274260:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b497c01300) 00010000:00010000:0.0:1789130559.274262:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130559.274264:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130559.274368:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:49663:x1876037605249408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1394us (1853us total) trans 34359738690 rc 0/0 00000100:00100000:0.0:1789130559.274376:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 356 00000100:00100000:1.0:1789130559.277080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.277233:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249536 00000100:00100000:0.0:1789130559.277243:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249536 00000100:00100000:0.0:1789130559.277365:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 357 00000100:00100000:0.0:1789130559.277373:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:49663:x1876037605249536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.277393:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130559.277409:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced03c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592accfc expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277459:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277468:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277476:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130559.277665:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130559.277669:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130559.277751:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277800:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced03c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accfc expref: 38 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277818:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accfc expref: 37 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.277826:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:0.0:1789130559.277829:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130559.277832:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130559.277883:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+37:49663:x1876037605249536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 511us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.277888:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 357 00000100:00100000:2.0:1789130559.280258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.280348:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249792 00000100:00100000:1.0:1789130559.280357:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249792 00000100:00100000:1.0:1789130559.280401:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 358 00000100:00100000:1.0:1789130559.280408:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+37:49663:x1876037605249792:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.280451:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130559.280472:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced02e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accf5 expref: 37 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280487:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b497c01300) 00010000:00010000:1.0:1789130559.280498:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced043 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592accfc expref: 36 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280503:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130559.280505:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130559.280521:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280529:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 10 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280535:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280561:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 10 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.280570:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 10 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.280580:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626928128:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130559.281133:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130559.283245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130559.283568:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626928128:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130559.283595:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.285631:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605249920 00000100:00100000:3.0:1789130559.285644:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605249920 00010000:00010000:3.0:1789130559.285711:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 11 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.285752:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789130559.285762:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+11:2369:x1876037605249920:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130559.285785:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130559.285792:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 11 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285805:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 11 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285828:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47cecf01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acc8c expref: 11 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285843:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:3.0:1789130559.285849:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285857:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285865:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.285899:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130559.285966:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+10:2369:x1876037605249920:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 206us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.285983:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:1.0:1789130559.286427:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286436:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286460:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286470:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286478:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286757:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286855:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286862:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286866:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.286869:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286875:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286885:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd300) 00010000:00010000:1.0:1789130559.286887:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130559.286889:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286893:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced04a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286903:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286908:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286913:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286918:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.286979:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286987:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.286996:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xecc236f9 (ffff90b4909bd500) 00010000:00010000:1.0:1789130559.286998:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130559.287001:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.287006:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced051 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xecc236f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.287081:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605249792:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 6671us (6829us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130559.287089:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 358 00000100:00080000:2.0:1789130559.287473:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130559.293809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.293900:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605250048 00000100:00100000:3.0:1789130559.293909:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605250048 00000100:00100000:3.0:1789130559.293984:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 359 00000100:00100000:3.0:1789130559.293993:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:49663:x1876037605250048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130559.294010:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130559.294027:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced058 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd03 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294062:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294073:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294082:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294173:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced058 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294186:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.294194:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130559.294197:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130559.294201:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:3.0:1789130559.294269:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:49663:x1876037605250048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 277us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.294801:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 359 00000100:00100000:3.0:1789130559.297960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.298063:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605250304 00000100:00100000:0.0:1789130559.298075:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605250304 00000100:00100000:0.0:1789130559.298145:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 360 00000100:00100000:0.0:1789130559.298155:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:49663:x1876037605250304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.298241:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.298258:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.298270:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130559.298665:0:45555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].9, 88 off8864 00000004:00080000:0.0:1789130559.298676:0:45555:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1722396073075ns, next at 1723396070242ns, rc = 0 00000004:00010000:0.0:1789130559.298754:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003d851c45 reply state 0000000049623bca transno 34359738691 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.298761:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130559.298836:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+38:49663:x1876037605250304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 683us (885us total) trans 34359738691 rc 0/0 00000100:00100000:0.0:1789130559.298841:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 360 00000100:00100000:3.0:1789130559.310727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.312484:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605250432 00000100:00100000:1.0:1789130559.312497:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605250432 00000100:00100000:1.0:1789130559.312555:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 361 00000100:00100000:1.0:1789130559.312563:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+38:49663:x1876037605250432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.312584:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130559.312640:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd0a expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.312705:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 39 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.312721:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 39 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.312737:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130559.312739:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130559.312743:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130559.312803:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+39:49663:x1876037605250432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 241us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.312809:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 361 00010000:00010000:0.0:1789130559.313442:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313452:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313458:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313464:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.313468:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313475:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313487:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130559.313490:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789130559.313493:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.313498:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced066 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.316999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.317844:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605250560 00000100:00100000:3.0:1789130559.317856:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605250560 00000100:00100000:3.0:1789130559.317936:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:3.0:1789130559.317946:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605250560:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789130559.318245:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605250560:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 301us (1256us total) trans 34359738397 rc 0/0 00000100:00100000:3.0:1789130559.318251:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00080000:2.0:1789130559.318329:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130559.330967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.332645:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605250816 00000100:00100000:0.0:1789130559.332660:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605250816 00000100:00100000:0.0:1789130559.332737:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130559.332749:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:49663:x1876037605250816:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130559.333015:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:49663:x1876037605250816:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 267us (2059us total) trans 34359738692 rc 0/0 00000100:00100000:0.0:1789130559.333024:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:1.0:1789130559.335842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.336043:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251072 00000100:00100000:0.0:1789130559.336052:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251072 00000100:00100000:1.0:1789130559.336231:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 362 00000100:00100000:1.0:1789130559.336247:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:49663:x1876037605251072:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789130559.336580:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:49663:x1876037605251072:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 338us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.336588:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 362 00000100:00100000:2.0:1789130559.347560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.348529:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251200 00000100:00100000:1.0:1789130559.348539:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251200 00000100:00100000:1.0:1789130559.348819:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 363 00000100:00100000:1.0:1789130559.348832:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+39:49663:x1876037605251200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.348853:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130559.348874:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced074 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd11 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.348955:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.348968:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.348989:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130559.349024:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130559.349042:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.349069:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced074 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd11 expref: 41 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.349087:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd11 expref: 40 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.349096:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130559.349099:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130559.349103:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130559.349185:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+40:49663:x1876037605251200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 357us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.349193:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 363 00000100:00100000:2.0:1789130559.356022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.356304:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251328 00000100:00100000:1.0:1789130559.356314:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251328 00000100:00100000:1.0:1789130559.356380:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130559.356391:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605251328:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.356410:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130559.356430:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd18 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130559.356458:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f73f, blocks: 0x1 00010000:00010000:1.0:1789130559.356478:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=1722s v=(0 0) 00010000:00010000:1.0:1789130559.356483:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130559.356492:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 10 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.356508:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 10 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.356521:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130559.356580:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605251328:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 191us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.356588:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789130559.372552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.373194:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251584 00000100:00100000:0.0:1789130559.373204:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251584 00000100:00100000:0.0:1789130559.373261:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 364 00000100:00100000:0.0:1789130559.373269:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:49663:x1876037605251584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789130559.373390:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:49663:x1876037605251584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 121us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.373396:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 364 00000100:00100000:2.0:1789130559.385881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.386075:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251712 00000100:00100000:3.0:1789130559.386085:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251712 00000100:00100000:3.0:1789130559.386144:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130559.386155:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:49663:x1876037605251712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130559.386174:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130559.386195:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd1f expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.386226:0:44367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.386237:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130559.386241:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130559.386247:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.386283:0:44367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.386299:0:44367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 1822 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.386313:0:44367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626928256:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130559.387136:0:44367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130559.400590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.400755:0:44367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:44367:1876037626928256:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130559.400808:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.400834:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5200, rc 0) 00000100:00100000:3.0:1789130559.400898:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:49663:x1876037605251712:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 14745us (15027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.400907:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789130559.404867:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251840 00000100:00100000:0.0:1789130559.404883:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251840 00010000:00010000:0.0:1789130559.404943:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 1822 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.405021:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130559.405032:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605251840:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130559.405049:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130559.405075:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 1822 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.405090:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 1822 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.405115:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d8c159/0x5c74554e47ced082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd18 expref: 11 pid: 44365 timeout: 1822 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.405133:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130559.405136:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130559.405143:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.405153:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.405193:0:43666:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.405214:0:43666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626928384:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130559.405469:0:43666:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130559.408292:0:43666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:43666:1876037626928384:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130559.408331:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130559.408391:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605251840:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3361us (7810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.408406:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130559.438041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.438137:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605251968 00000100:00100000:3.0:1789130559.438146:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605251968 00002000:00100000:3.0:1789130559.438199:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe9:0x0] (0->1048575) req@ffff90b3897d1680 x1876037605251968/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:275/0 lens 488/0 e 0 to 0 dl 1789130570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789130559.438210:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d1680 with x1876037605251968 ext(0->1048575) 00002000:00010000:3.0:1789130559.438217:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d1680 00000100:00100000:3.0:1789130559.438251:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789130559.438261:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605251968:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789130559.457872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.460253:0:44372:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789130559.460273:0:44372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789130559.460393:0:44372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252096 00000100:00100000:1.0:1789130559.460404:0:44372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252096 00002000:00100000:1.0:1789130559.460454:0:44372:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe9:0x0] (1048576->1049599) req@ffff90b4bfcd5680 x1876037605252096/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:275/0 lens 1512/0 e 0 to 0 dl 1789130570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130559.460466:0:44372:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd5680 with x1876037605252096 ext(1048576->1049599) 00002000:00010000:1.0:1789130559.460472:0:44372:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd5680 00000100:00100000:1.0:1789130559.461409:0:47023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789130559.461420:0:47023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605252096:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789130559.464548:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605251968:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 26277us (26506us total) trans 34359738399 rc 0/0 00000100:00100000:0.0:1789130559.464562:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00002000:00100000:0.0:1789130559.464576:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe9:0x0] (0->1048575) req@ffff90b3897d1680 x1876037605251968/t34359738399(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:275/0 lens 488/448 e 0 to 0 dl 1789130570 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130559.464586:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3897d1680 with x1876037605251968 ext(0->1048575) 00002000:00010000:0.0:1789130559.464594:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3897d1680 00000100:00100000:1.0:1789130559.467412:0:47023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605252096:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 5982us (9538us total) trans 34359738398 rc 0/0 00000100:00100000:1.0:1789130559.467428:0:47023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00002000:00100000:1.0:1789130559.467440:0:47023:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xe9:0x0] (1048576->1049599) req@ffff90b4bfcd5680 x1876037605252096/t34359738398(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:275/0 lens 1512/448 e 0 to 0 dl 1789130570 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789130559.467450:0:47023:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd5680 with x1876037605252096 ext(1048576->1049599) 00002000:00010000:1.0:1789130559.467456:0:47023:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd5680 00000100:00100000:3.0:1789130559.469958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.470124:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252224 00000100:00100000:0.0:1789130559.470133:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252224 00000100:00100000:0.0:1789130559.470188:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 365 00000100:00100000:0.0:1789130559.470198:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+40:49663:x1876037605252224:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789130559.516677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.516753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.516788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.516867:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252480 00000100:00100000:3.0:1789130559.516877:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252480 00000100:00100000:3.0:1789130559.516930:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252608 00000100:00100000:3.0:1789130559.516934:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252608 00000100:00100000:3.0:1789130559.516965:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789130559.516987:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605252480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130559.517064:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2367:x1876037605252480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.517070:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789130559.517082:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789130559.517087:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:2368:x1876037605252608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130559.517101:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+7:2368:x1876037605252608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 15us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.517105:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00080000:3.0:1789130559.517118:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130559.520140:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252352 00000100:00100000:2.0:1789130559.520156:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252352 00000100:00100000:2.0:1789130559.520222:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789130559.520232:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605252352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130559.520407:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605252352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 175us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130559.520416:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000001:00080000:1.0:1789130559.520952:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738692 is committed 00000004:00080000:1.0:1789130559.520963:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1789130559.521001:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:1.0:1789130559.521045:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487d55300 refcount 2 committed 0 result 0 batchid 30064771687 00000020:00080000:1.0:1789130559.521050:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487d55480 00000020:00080000:1.0:1789130559.521054:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386d89400 00000001:00080000:1.0:1789130559.521068:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738670 is committed 00000020:00080000:1.0:1789130559.521076:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4b5ab1000 refcount 2 committed 0 result 0 batchid 30064771686 00000020:00080000:1.0:1789130559.521079:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5ab1b40 00000020:00080000:1.0:1789130559.521082:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b387fa6400 00000020:00080000:1.0:1789130559.521105:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771685 batchid updated 00000001:00080000:1.0:1789130559.521114:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738674 is committed 00000020:00080000:1.0:1789130559.521133:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771687 committed batchid 30064771685 00000020:00080000:1.0:1789130559.521314:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771685 00000100:00100000:1.0:1789130559.521404:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130559.521419:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626928512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789130559.521469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130559.521857:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626928512 00000100:00100000:3.0:1789130559.521864:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626928512 00000100:00100000:3.0:1789130559.521924:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130559.521932:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626928512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130559.521954:0:44365:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:232 count 1 00002000:00010000:3.0:1789130559.521995:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe8:0x0] initial LVB size: 1049600, mtime: 0x6aa3f73d, atime: 0x6aa3f73d, ctime: 0x6aa3f73d, blocks: 0x807 00010000:00010000:3.0:1789130559.522004:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522028:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=1722s v=(0 0) 00010000:00010000:3.0:1789130559.522033:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130559.522038:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522054:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522065:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522073:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522090:0:44365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789130559.522430:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130559.522524:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130559.522536:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626928640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789130559.522576:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130559.522696:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626928640 00000100:00100000:3.0:1789130559.522697:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626928512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 764us (1226us total) trans 34359738400 rc 0/0 00000100:00100000:0.0:1789130559.522701:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626928640 00000100:00100000:3.0:1789130559.522704:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1789130559.522725:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130559.522732:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.522735:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00010000:00010000:3.0:1789130559.522742:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4c00 already unused, calling callback (ffffffffc162b550) 00000100:00100000:0.0:1789130559.522742:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626928640:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789130559.522746:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522755:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522770:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522778:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c05b1203/0x5c74554e47ced090 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.522795:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130559.522797:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130559.522798:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130559.522863:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b387aa0b40/2, rc 0, transno 34359738400 00000100:00100000:2.0:1789130559.522870:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626928512:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1789130559.522914:0:44366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb size from disk: 0 -> 1049600 00002000:00010000:0.0:1789130559.522917:0:44366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb mtime from disk: 0 -> 1789130559 00002000:00010000:0.0:1789130559.522919:0:44366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789130559.522922:0:44366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb ctime from disk: 1789130559 -> 1789130559 00002000:00010000:0.0:1789130559.522933:0:44366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789130559.522979:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626928640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (403us total) trans 34359738400 rc 0/0 00000100:00100000:0.0:1789130559.522986:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789130559.523003:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130559.523061:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:49663:x1876037605252224:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 52865us (53110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.523069:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 365 00000004:00080000:3.0:1789130559.523327:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386f07480/2, rc 0, transno 34359738400 00000100:00100000:3.0:1789130559.523333:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626928640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789130559.526695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.526761:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252736 00000100:00100000:0.0:1789130559.526771:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252736 00000100:00100000:0.0:1789130559.526911:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789130559.526933:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:2367:x1876037605252736:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789130559.564191:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738400 is committed 00000001:00080000:1.0:1789130559.564209:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738399 is committed 00000100:00100000:2.0:1789130559.564428:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605252736:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 37502us (37737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130559.564441:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130559.568018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.568109:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605252992 00000100:00100000:0.0:1789130559.568119:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605252992 00000100:00100000:0.0:1789130559.568179:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 366 00000100:00100000:0.0:1789130559.568188:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:49663:x1876037605252992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130559.568239:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130559.568267:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced07b lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd11 expref: 14 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.568284:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130559.568289:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130559.568316:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.568330:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.568339:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130559.568501:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e260f2ab reply state 000000007a367de1 transno 34359738693 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.568509:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130559.568594:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+15:49663:x1876037605252992:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 407us (584us total) trans 34359738693 rc 0/0 00000100:00100000:0.0:1789130559.568974:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 366 00000100:00100000:0.0:1789130559.571874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.572051:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605253120 00000100:00100000:1.0:1789130559.572061:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605253120 00000100:00100000:1.0:1789130559.572125:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130559.572136:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605253120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789130559.572377:0:44793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb size from disk: 1049600 -> 1049600 00002000:00010000:1.0:1789130559.572381:0:44793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb mtime from disk: 1789130559 -> 1789130557 00002000:00010000:1.0:1789130559.572383:0:44793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb atime from disk: 0 -> 1789130557 00002000:00010000:1.0:1789130559.572385:0:44793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb ctime from disk: 1789130559 -> 1789130558 00002000:00010000:1.0:1789130559.572388:0:44793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe9:0x0] updating lvb blocks from disk: 1 -> 4103 00000100:00100000:1.0:1789130559.572503:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605253120:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 369us (637us total) trans 34359738401 rc 0/0 00000100:00100000:1.0:1789130559.572512:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00010000:00010000:3.0:1789130559.575153:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575171:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575178:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575185:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130559.575190:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575198:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575215:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130559.575218:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130559.575224:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.575230:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced097 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.577398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.577496:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605253376 00000100:00100000:1.0:1789130559.577508:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605253376 00000100:00100000:1.0:1789130559.577574:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 367 00000100:00100000:1.0:1789130559.577585:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:49663:x1876037605253376:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.577700:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.577716:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.577725:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.577757:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 14 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.577771:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 14 pid: 43680 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.577785:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626928768:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130559.577887:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789130559.582302:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626928768:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130559.582339:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.582447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.582542:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605253504 00000100:00100000:1.0:1789130559.582548:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605253504 00010000:00010000:1.0:1789130559.582583:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 15 pid: 43680 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.582805:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:1.0:1789130559.582817:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387bba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+15:2369:x1876037605253504:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130559.582832:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130559.582840:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 15 pid: 43680 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582852:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 15 pid: 43680 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582875:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced05f lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd03 expref: 15 pid: 43680 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582889:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130559.582894:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582903:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582911:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.582949:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130559.583014:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387bba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+14:2369:x1876037605253504:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 199us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.583024:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00010000:00010000:0.0:1789130559.583356:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583365:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583392:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583399:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583406:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583412:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3ee00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130559.583416:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583424:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583438:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:0.0:1789130559.583441:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789130559.583445:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130559.583451:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced09e lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130559.583509:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:49663:x1876037605253376:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 5927us (6120us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789130559.583519:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 367 00000100:00100000:2.0:1789130559.587481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130559.587577:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605253632 00000100:00100000:0.0:1789130559.587586:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605253632 00000100:00100000:2.0:1789130559.590163:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130559.590179:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2367:x1876037605253632:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130559.590227:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.590249:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.590259:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130559.590264:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130559.590268:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.590303:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.590318:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 10 pid: 44367 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.590332:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626928896:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130559.590423:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49106bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130559.595846:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626928896:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130559.595887:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.597013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.597087:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605253760 00000100:00100000:1.0:1789130559.597096:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605253760 00010000:00010000:1.0:1789130559.597142:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.597186:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1789130559.597197:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+11:2368:x1876037605253760:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130559.597212:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130559.597236:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.597251:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.597275:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ada6f84/0x5c74554e47ced089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd1f expref: 11 pid: 44367 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.597292:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130559.597296:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130559.597302:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.597312:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.597352:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130559.597406:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2368:x1876037605253760:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 211us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130559.597414:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00010000:00010000:2.0:1789130559.597938:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.597950:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.597985:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.597995:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.598004:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.598011:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789130559.598016:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.598025:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.598039:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130559.598047:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ca38bf2/0x5c74554e47ced0a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.598145:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605253632:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7970us (10671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130559.598154:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789130559.602727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.603047:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254016 00000100:00100000:1.0:1789130559.603058:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254016 00000100:00100000:1.0:1789130559.603119:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 368 00000100:00100000:1.0:1789130559.603129:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:49663:x1876037605254016:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789130559.603203:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603220:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603232:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603432:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603444:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 14 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603451:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603483:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 14 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.603504:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 14 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.603519:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626929024:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130559.604060:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130559.605508:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626929024:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130559.605534:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130559.606224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.606293:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254144 00000100:00100000:3.0:1789130559.606300:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254144 00010000:00010000:3.0:1789130559.606428:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 15 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.606467:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789130559.606478:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:2370:x1876037605254144:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130559.606493:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130559.606500:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 15 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606514:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 15 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606538:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced06d lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd0a expref: 15 pid: 43681 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606557:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:3.0:1789130559.606562:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606572:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606580:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.606850:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130559.606906:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605254144:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 429us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.606914:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:1.0:1789130559.608770:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.608786:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130559.609150:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738694 00000001:00080000:1.0:1789130559.609311:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738695 00000001:00080000:1.0:1789130559.609361:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738696 00000100:00100000:1.0:1789130559.609458:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626929152:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130559.609521:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130559.610178:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130559.610277:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626929152 00000100:00100000:0.0:1789130559.610285:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626929152 00000100:00100000:0.0:1789130559.610401:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130559.610411:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626929152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789130559.610509:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626929152:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.610518:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130559.610579:0:43679:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738400 gen 2 00000004:00080000:1.0:1789130559.610585:0:43679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386f07480, transno 34359738400 00000100:00100000:1.0:1789130559.610646:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626929152:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789130559.611677:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738697 00000100:00100000:1.0:1789130559.611748:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626929280:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789130559.611793:0:43679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130559.612300:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130559.612329:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626929280 00000100:00100000:2.0:1789130559.612339:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626929280 00000100:00100000:2.0:1789130559.612389:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130559.612398:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43679:x1876037626929280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789130559.613194:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43679:x1876037626929280:12345-0@lo:1000:mdt00_000.0 Request processed in 796us (1399us total) trans 34359738402 rc 0/0 00000100:00100000:2.0:1789130559.613205:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130559.614067:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:43679:1876037626929280:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789130559.614180:0:43679:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738698 00010000:00010000:1.0:1789130559.614223:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614234:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614242:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614248:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.614253:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614261:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614278:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b488939000) 00010000:00010000:1.0:1789130559.614282:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130559.614287:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614293:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0b3 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614328:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614334:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614340:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614345:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.614348:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614354:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614362:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130559.614365:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130559.614372:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614383:0:43679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614391:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.614428:0:43679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2200/0x5c74554e47cecff6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acce7 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130559.614442:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626929408:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130559.614569:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b487d55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130559.619406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130559.619465:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254272 00000100:00100000:3.0:1789130559.619475:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254272 00000100:00100000:3.0:1789130559.619526:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1789130559.619535:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:49662:x1876037605254272:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:1.0:1789130559.619759:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626929408:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130559.619800:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619811:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47cecfef lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619843:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619858:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619870:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619879:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619885:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619892:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619898:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.619902:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619910:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619926:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130559.619929:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130559.619933:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619939:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0ba lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619949:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619955:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619961:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619976:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130559.619980:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619986:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.619994:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130559.619996:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130559.619999:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.620005:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced0ac lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130559.621301:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:49662:x1876037605254272:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 1758us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130559.621313:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1789130559.621386:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:49663:x1876037605254016:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 18258us (18670us total) trans 34359738699 rc 0/0 00000100:00100000:1.0:1789130559.621399:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 368 00000020:00080000:1.0:1789130559.621403:0:43679:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1789130559.621534:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130559.621539:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130559.621573:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 9 count 8 00000040:00080000:1.0:1789130559.621579:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130559.624908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130559.624955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130559.625038:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254784 00000100:00100000:1.0:1789130559.625048:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254784 00000100:00100000:1.0:1789130559.625109:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789130559.625119:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:49663:x1876037605254784:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130559.625821:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254528 00000100:00100000:0.0:1789130559.625827:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254528 00000100:00100000:0.0:1789130559.625873:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 369 00000100:00100000:0.0:1789130559.625882:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:49662:x1876037605254528:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:0.0:1789130559.626138:0:43680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].9, 136 off9416 00000100:00100000:0.0:1789130559.626223:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:49662:x1876037605254528:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 341us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130559.626232:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 369 00000004:00080000:1.0:1789130559.628041:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789130559.628153:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738700 00010000:00010000:1.0:1789130559.628217:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628235:0:43683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628246:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628255:0:43683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628261:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628267:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130559.628296:0:43683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130559.628384:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:49663:x1876037605254784:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 3263us (3425us total) trans 34359738701 rc 0/0 00000100:00100000:1.0:1789130559.628394:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000020:00080000:1.0:1789130559.628399:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789130559.628895:0:43667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130559.628902:0:43667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.628925:0:43667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130559.628929:0:43667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.628937:0:43667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.628950:0:43667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x21:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789130559.628953:0:43667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789130559.628957:0:43667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.628963:0:43667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced0c1 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130559.628989:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130559.628990:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130559.628992:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130560.133886:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130560.263229:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130560.263255:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626929536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130560.263340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130560.263408:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626929536 00000100:00100000:3.0:1789130560.263418:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626929536 00000100:00100000:3.0:1789130560.263486:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130560.263496:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626929536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130560.263533:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 57868288 pending 1703936 free 3703570432 avail 3701473280 00000100:00100000:3.0:1789130560.263580:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626929536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130560.263589:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130560.263794:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626929536:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789130560.646317:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130560.646325:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130560.649522:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 10 count 6 00000040:00080000:1.0:1789130560.649538:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:1.0:1789130560.650097:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626929664:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130560.650266:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130560.680494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130560.680559:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626929664:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130560.680793:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605254912 00000100:00100000:2.0:1789130560.680800:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605254912 00000100:00100000:2.0:1789130560.680866:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 370 00000100:00100000:2.0:1789130560.680878:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:49749:x1876037605254912:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789130560.680922:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789130560.681035:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+20:49749:x1876037605254912:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 159us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130560.681043:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 370 00000100:00100000:0.0:1789130560.700405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130560.700460:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605255168 00000100:00100000:1.0:1789130560.700478:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605255168 00000100:00100000:1.0:1789130560.700544:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 371 00000100:00100000:1.0:1789130560.700554:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:49749:x1876037605255168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130560.700575:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130560.700595:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd26 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130560.700706:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0cf lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130560.700717:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0cf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130560.700726:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0cf lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130560.700734:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x1d:0x0]: returning size 1049600 00010000:00010000:1.0:1789130560.700844:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd26 expref: 23 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130560.700859:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e600/0x5c74554e47ced0cf lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x1d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd26 expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130560.700865:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:1.0:1789130560.700867:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130560.700869:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e600, rc 0) 00000100:00100000:1.0:1789130560.700928:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b384b16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+22:49749:x1876037605255168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 376us (532us total) trans 34359738702 rc 0/0 00000100:00100000:1.0:1789130560.700935:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 371 00000100:00100000:3.0:1789130560.715467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130560.718557:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605255424 00000100:00100000:2.0:1789130560.718574:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605255424 00000100:00100000:2.0:1789130560.718835:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 372 00000100:00100000:2.0:1789130560.718849:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+22:49749:x1876037605255424:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130560.718954:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.718972:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.718985:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719279:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719287:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719294:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719300:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130560.719305:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719313:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719327:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x1d:0x0].0x0 (ffff90b4909bda00) 00010000:00010000:2.0:1789130560.719329:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130560.719334:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130560.719340:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced0dd lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130560.719555:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+23:49749:x1876037605255424:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 710us (4098us total) trans 34359738703 rc 0/0 00000100:00100000:2.0:1789130560.719564:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 372 00000040:00080000:3.0:1789130560.720538:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1789130560.720546:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130560.721448:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 64768 count 6 00000040:00080000:3.0:1789130560.721458:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:3.0:1789130560.725899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130560.726206:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605255680 00000100:00100000:0.0:1789130560.726216:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605255680 00000100:00100000:0.0:1789130560.726315:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789130560.726327:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:49749:x1876037605255680:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789130560.726740:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+24:49749:x1876037605255680:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 414us (887us total) trans 34359738704 rc 0/0 00000100:00100000:0.0:1789130560.726749:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00010000:00010000:3.0:1789130561.159757:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130562.184269:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130562.437010:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738398 is committed 00000001:00080000:3.0:1789130562.437033:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738400 is committed 00000100:00100000:2.0:1789130562.824727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130562.824761:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626929792:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.824880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.824970:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626929792 00000100:00100000:2.0:1789130562.824980:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626929792 00000100:00100000:2.0:1789130562.825050:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130562.825066:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626929792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.825132:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3868e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626929792:12345-0@lo:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130562.825141:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130562.825207:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626929792:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.825256:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130562.825264:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626929920:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.825301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.825333:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626929920 00000100:00100000:2.0:1789130562.825336:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626929920 00000100:00100000:3.0:1789130562.825368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130562.825379:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130562.825386:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626929920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.825389:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626930048:0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.825418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.825420:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626929920:12345-0@lo:400:kworker.0 Request processed in 36us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130562.825427:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130562.830573:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930048 00000100:00100000:3.0:1789130562.830596:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930048 00000100:00080000:2.0:1789130562.830611:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130562.830681:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738400 gen 2 00000004:00080000:2.0:1789130562.830689:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738399 committed transno 34359738400 00000004:00080000:2.0:1789130562.830718:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b387aa0b40, transno 34359738400 00000100:00100000:3.0:1789130562.830724:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130562.830735:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626930048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.830740:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626929920:0@lo:400:kworker.0 00000100:00080000:2.0:1789130562.830771:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130562.830867:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626930048:12345-0@lo:400:kworker.0 Request processed in 133us (5446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130562.830875:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130562.830929:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626930048:0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.830993:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130562.831007:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626930176:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.831443:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130562.831453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626930304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130562.831473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.831485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130562.831515:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930176 00000100:00100000:2.0:1789130562.831515:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930304 00000100:00100000:3.0:1789130562.831520:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930176 00000100:00100000:2.0:1789130562.831520:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930304 00000100:00100000:2.0:1789130562.831554:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130562.831562:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626930304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130562.831564:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130562.831569:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626930176:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789130562.831594:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 61276160 pending 0 free 3765436416 avail 3763339264 00000100:00100000:3.0:1789130562.831624:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626930176:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130562.831631:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130562.831647:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626930304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130562.831654:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130562.831661:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626930176:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.831685:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3897d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626930304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130562.831698:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130562.831705:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626930432:0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.831732:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.831758:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930432 00000100:00100000:2.0:1789130562.831761:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930432 00000100:00100000:3.0:1789130562.831784:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130562.831791:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626930560:0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.831820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130562.832087:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930560 00000100:00100000:2.0:1789130562.832092:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930560 00000100:00100000:2.0:1789130562.832130:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789130562.832138:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626930432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.832169:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789130562.832173:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626930432:12345-0@lo:400:kworker.0 Request processed in 37us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130562.832177:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626930560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130562.832180:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1789130562.832197:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130562.832211:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626930560:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130562.832215:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626930432:0@lo:400:kworker.0 00000100:00100000:3.0:1789130562.832218:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130562.832239:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626930560:0@lo:400:kworker.0 00010000:00010000:3.0:1789130563.215454:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130564.229913:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130564.636805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.636867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.636911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.636942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.636962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.637017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130564.637052:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256064 00000100:00100000:2.0:1789130564.637064:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256064 00000100:00100000:2.0:1789130564.637137:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256192 00000100:00100000:2.0:1789130564.637141:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256192 00000100:00100000:2.0:1789130564.637158:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256448 00000100:00100000:2.0:1789130564.637160:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256448 00000100:00100000:2.0:1789130564.637191:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789130564.637201:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605256064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130564.637374:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256320 00000100:00100000:3.0:1789130564.637379:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256320 00000100:00100000:3.0:1789130564.637416:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605255936 00000100:00100000:3.0:1789130564.637419:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605255936 00000100:00100000:3.0:1789130564.637451:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130564.637469:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605256320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130564.637548:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605256320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 80us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130564.637556:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130564.637576:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130564.637583:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:2368:x1876037605255936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130564.637657:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+24:2368:x1876037605255936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130564.637663:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130564.637691:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789130564.637698:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605256192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130564.637724:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605256192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130564.637730:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789130564.637747:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789130564.637753:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605256448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130564.637777:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605256448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130564.637783:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00080000:3.0:1789130564.637991:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130564.637998:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130564.638001:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130564.638163:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605256064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 962us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130564.638172:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789130564.638450:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605255808 00000100:00100000:0.0:1789130564.638458:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605255808 00000100:00100000:0.0:1789130564.638513:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1789130564.638521:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605255808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789130564.638572:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605255808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 52us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130564.638579:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000001:00080000:3.0:1789130564.946419:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738401 is committed 00000001:00080000:3.0:1789130564.946454:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738402 is committed 00000001:00080000:1.0:1789130564.986162:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738704 is committed 00000020:00080000:1.0:1789130564.986210:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b487d55000 refcount 2 committed 0 result 0 batchid 30064771688 00000020:00080000:1.0:1789130564.986217:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b487676f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b487d556c0 00000020:00080000:1.0:1789130564.986221:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b382954500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b388e49800 00000020:00080000:1.0:1789130564.986250:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771687 batchid updated 00000020:00080000:3.0:1789130564.987715:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771688 committed batchid 30064771687 00000020:00080000:3.0:1789130564.988214:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771687 00010000:00010000:3.0:1789130565.258676:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130565.384021:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130565.384055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626930688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130565.384168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130565.384253:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930688 00000100:00100000:3.0:1789130565.384265:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930688 00000100:00100000:3.0:1789130565.384336:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130565.384348:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626930688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130565.384405:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130565.384474:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626930688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130565.384482:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789130565.384510:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130565.385721:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626930688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130566.077523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130566.084273:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256576 00000100:00100000:2.0:1789130566.084302:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256576 00000100:00100000:3.0:1789130566.084756:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 373 00000100:00100000:3.0:1789130566.084777:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+12:50086:x1876037605256576:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:3.0:1789130566.084808:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130566.084995:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced0e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd2d expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085103:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085121:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085138:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130566.085401:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1789130566.085406:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:3.0:1789130566.085912:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085950:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced0e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd2d expref: 14 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085971:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd2d expref: 13 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130566.085981:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130566.085985:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130566.085989:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4c00, rc 0) 00000100:00100000:3.0:1789130566.086135:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:50086:x1876037605256576:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 1366us (8626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130566.086144:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 373 00000100:00080000:0.0:1789130566.086269:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130566.207909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130566.208106:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256704 00000100:00100000:3.0:1789130566.208119:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256704 00000100:00100000:3.0:1789130566.208198:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 374 00000100:00100000:3.0:1789130566.208210:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:49539:x1876037605256704:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789130566.208354:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+13:49539:x1876037605256704:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 146us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130566.208363:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 374 00000100:00100000:1.0:1789130566.231166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130566.231295:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605256960 00000100:00100000:2.0:1789130566.231309:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605256960 00000100:00100000:2.0:1789130566.231393:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789130566.231406:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+13:49539:x1876037605256960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130566.232557:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+14:49539:x1876037605256960:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1147us (1403us total) trans 34359738705 rc 0/0 00000100:00100000:2.0:1789130566.232568:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00010000:00010000:3.0:1789130566.278460:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130566.659487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130566.659655:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257088 00000100:00100000:1.0:1789130566.659667:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257088 00000100:00100000:1.0:1789130566.659760:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 375 00000100:00100000:1.0:1789130566.659770:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:50104:x1876037605257088:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:1.0:1789130566.659806:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130566.659833:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd34 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.660088:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.660108:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.660234:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130566.660523:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130566.660527:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130566.663401:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.665374:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 7 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.665414:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 6 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130566.665425:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130566.665429:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130566.665434:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3ee00, rc 0) 00000100:00080000:3.0:1789130566.665734:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130566.665944:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:50104:x1876037605257088:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 6171us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130566.665956:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 375 00010000:00010000:3.0:1789130567.303264:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130567.941996:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130567.942033:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626930816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130567.942135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.942497:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626931072:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.942542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.942586:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789130567.942593:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.942655:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.942681:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.942712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.942746:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930944 00000100:00100000:1.0:1789130567.942754:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930944 00000100:00100000:1.0:1789130567.942830:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789130567.942841:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626930944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.942899:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3309:x1876037626930944:12345-0@lo:400:kworker.0 Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130567.942908:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789130567.942947:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626931456 00000100:00100000:1.0:1789130567.942951:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626931456 00000100:00100000:1.0:1789130567.942996:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789130567.943003:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943040:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626931456:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130567.943046:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1789130567.943069:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130567.943081:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.943130:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130567.943135:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626931200:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130567.943186:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626931328 00000100:00100000:1.0:1789130567.943191:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626931328 00000100:00100000:1.0:1789130567.943217:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626931200 00000100:00100000:1.0:1789130567.943225:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626931200 00000100:00100000:1.0:1789130567.943246:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789130567.943252:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943288:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626931328:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130567.943294:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789130567.943308:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789130567.943313:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626931200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943342:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626931200:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130567.943347:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789130567.943363:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130567.943394:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626931200:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943445:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3309:1876037626930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789130567.943456:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626931456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130567.943721:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626931072 00000100:00100000:0.0:1789130567.943728:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626931072 00000100:00100000:0.0:1789130567.943799:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789130567.943813:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626931072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130567.943888:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626931072:12345-0@lo:400:kworker.0 Request processed in 82us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130567.943896:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789130567.943926:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626931072:0@lo:400:kworker.0 00000100:00100000:2.0:1789130567.944187:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626930816 00000100:00100000:2.0:1789130567.944194:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626930816 00000100:00100000:2.0:1789130567.944240:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789130567.944250:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626930816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130567.944288:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 61276160 pending 0 free 3765436416 avail 3763339264 00000100:00100000:2.0:1789130567.944346:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626930816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130567.944353:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130567.944813:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738402 gen 2 00000004:00080000:0.0:1789130567.944830:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738402 committed transno 34359738402 00000100:00100000:0.0:1789130567.944865:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626930816:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789130567.948939:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130567.948955:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130568.327261:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130569.351630:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130569.765144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130569.765217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130569.765346:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257216 00000100:00100000:3.0:1789130569.765364:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257216 00000100:00100000:3.0:1789130569.765455:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130569.765469:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605257216:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130569.765637:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2370:x1876037605257216:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 136us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130569.765649:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1789130569.765912:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257344 00000100:00100000:3.0:1789130569.765917:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257344 00000100:00100000:3.0:1789130569.765977:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789130569.765986:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605257344:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130569.766041:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:2370:x1876037605257344:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 56us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130569.766049:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00080000:3.0:1789130569.766069:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130569.767158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130569.767197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130569.767217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130569.767255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130569.767290:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257600 00000100:00100000:2.0:1789130569.767298:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257600 00000100:00100000:2.0:1789130569.767376:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257856 00000100:00100000:2.0:1789130569.767379:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257856 00000100:00100000:2.0:1789130569.767398:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257472 00000100:00100000:2.0:1789130569.767401:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257472 00000100:00100000:2.0:1789130569.767914:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130569.767926:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605257600:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130569.768015:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605257600:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 92us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130569.768024:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130569.768045:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130569.768051:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605257856:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130569.768083:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605257856:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130569.768090:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789130569.768115:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130569.768123:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605257472:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130569.768149:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605257472:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130569.768156:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789130569.768187:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605257728 00000100:00100000:2.0:1789130569.768192:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605257728 00000100:00100000:2.0:1789130569.768236:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789130569.768243:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605257728:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130569.768276:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605257728:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130569.768283:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00080000:3.0:1789130569.768631:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130569.768638:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130569.768641:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789130570.080424:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738705 is committed 00000020:00080000:1.0:1789130570.080453:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771688 batchid updated 00000020:00080000:2.0:1789130570.080588:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771688 00000020:00080000:2.0:1789130570.080634:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771688 00010000:00010000:1.0:1789130570.385338:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130570.517414:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130570.517448:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626931584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130570.517553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130570.517677:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626931584 00000100:00100000:3.0:1789130570.517686:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626931584 00000100:00100000:3.0:1789130570.517766:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130570.517799:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626931584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130570.517853:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130570.517915:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626931584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130570.517927:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789130570.517955:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130570.518009:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626931584:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789130570.730643:0:47213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 19: Verify the file re-attach works as expected ========================================================== 08:42:48 (1789130568) 00000040:00080000:2.0:1789130570.960030:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130570.960041:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130570.960098:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 10 count 6 00000040:00080000:2.0:1789130570.960107:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:3.0:1789130571.398158:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130572.423252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130572.423545:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258112 00000100:00100000:0.0:1789130572.423556:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258112 00000100:00100000:0.0:1789130572.423763:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 376 00000100:00100000:0.0:1789130572.423784:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+13:50364:x1876037605258112:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130572.423810:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130572.423841:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced100 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd3b expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.423937:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.423957:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.423975:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424000:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424018:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424043:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424581:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced115 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424592:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced115 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424629:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced115 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130572.424641:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789130572.424915:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424928:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424940:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424951:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130572.424958:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424969:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.424994:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:0.0:1789130572.424998:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130572.425005:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425015:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced107 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425032:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425043:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425049:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425054:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130572.425057:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425064:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425075:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b497c01700) 00010000:00010000:0.0:1789130572.425079:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130572.425083:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425091:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced10e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425673:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced100 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd3b expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425704:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced115 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd3b expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.425717:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130572.425721:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130572.425724:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3e00, rc 0) 00000100:00100000:0.0:1789130572.425831:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605258112:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2053us (2584us total) trans 34359738706 rc 0/0 00000100:00100000:0.0:1789130572.425844:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 376 00000100:00080000:3.0:1789130572.426095:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130572.429495:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130572.430584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130572.431170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.431508:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258240 00000100:00100000:2.0:1789130572.431523:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258240 00000100:00100000:2.0:1789130572.431686:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 377 00000100:00100000:2.0:1789130572.431729:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605258240:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130572.431918:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605258240:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 194us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130572.433812:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258368 00000100:00100000:0.0:1789130572.433830:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258368 00000100:00100000:0.0:1789130572.433940:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789130572.433958:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:2367:x1876037605258368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130572.433978:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130572.434013:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced115 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd3b expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.434037:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130572.434055:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130572.435148:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:2367:x1876037605258368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1191us (3972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130572.435160:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:2.0:1789130572.451857:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 377 00000100:00100000:2.0:1789130572.570146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130572.570247:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258624 00000100:00100000:0.0:1789130572.570259:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258624 00000100:00100000:0.0:1789130572.570383:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 378 00000100:00100000:0.0:1789130572.570397:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+14:50378:x1876037605258624:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789130572.570424:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130572.570428:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789130572.570465:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced0eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd2d expref: 14 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.570487:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130572.570493:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130572.570511:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced123 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd42 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.571170:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.571188:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.571199:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.571243:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.571259:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 5 pid: 43680 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130572.571280:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387f7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626931712:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130572.573231:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130572.577142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.577240:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258752 00000100:00100000:2.0:1789130572.577255:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258752 00010000:00010000:2.0:1789130572.577342:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 6 pid: 43680 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130572.577490:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789130572.577504:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605258752:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130572.577525:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130572.577534:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 6 pid: 43680 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.577552:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 6 pid: 43680 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.577582:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:2.0:1789130572.577589:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.577625:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.577635:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.577677:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130572.577925:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605258752:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 423us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130572.577935:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00080000:0.0:1789130572.578001:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130572.578164:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced0f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd34 expref: 5 pid: 43680 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.578185:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387f7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626931712:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130572.578217:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.578228:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.578234:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.578262:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.578272:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.578281:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130572.579536:0:43681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe9:0x0], index 0: 0 00010000:00010000:3.0:1789130572.579886:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579901:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579912:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579958:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579965:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579973:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579979:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130572.579984:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.579992:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.580005:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130572.580008:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130572.580013:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.580024:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced12a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130572.580039:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003be50226 reply state 000000002f87b3ff transno 34359738707 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.580050:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789130572.580090:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced123 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.580114:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 15 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.580123:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:3.0:1789130572.580125:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130572.580127:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:3.0:1789130572.580202:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:50378:x1876037605258624:12345-192.168.201.39@tcp:101:bash.0 Request processed in 9808us (10070us total) trans 34359738707 rc 0/0 00000100:00100000:3.0:1789130572.580211:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 378 00000100:00100000:0.0:1789130572.585695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130572.585802:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605258880 00000100:00100000:1.0:1789130572.585820:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605258880 00000100:00100000:1.0:1789130572.585923:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789130572.585942:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605258880:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130572.585970:0:44793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130572.586004:0:44793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd49 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130572.586044:0:44793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789130572.586071:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=1735s v=(0 0) 00010000:00010000:1.0:1789130572.586078:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130572.586090:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.586113:0:44793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 6 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.586130:0:44793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130572.586208:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605258880:12345-192.168.201.39@tcp:101:bash.0 Request processed in 274us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130572.586217:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00080000:0.0:1789130572.587434:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130572.590227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130572.590324:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605259008 00000100:00100000:3.0:1789130572.590339:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605259008 00000100:00100000:3.0:1789130572.590527:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1789130572.590541:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:50378:x1876037605259008:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789130572.590567:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130572.590597:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd50 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.590706:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.590717:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130572.590723:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130572.590729:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 7 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.590786:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 7 pid: 44793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.590803:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 7 pid: 44793 timeout: 1835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.590822:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626931840:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130572.590933:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568840 going to sleep for 11 seconds 00010000:00010000:2.0:1789130572.591120:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591134:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591143:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591151:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130572.591157:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591166:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591187:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8996d334 (ffff90b488939200) 00010000:00010000:2.0:1789130572.591191:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130572.591197:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.591204:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced131 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.595439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130572.595493:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605259136 00000100:00100000:3.0:1789130572.595505:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605259136 00010000:00010000:3.0:1789130572.595560:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 8 pid: 44793 timeout: 1835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.595633:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789130572.595644:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605259136:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130572.595686:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130572.595719:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 8 pid: 44793 timeout: 1835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.595743:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 8 pid: 44793 timeout: 1835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.595779:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130572.595785:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130572.595795:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.595808:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.595853:0:43666:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 8 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.595870:0:43666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:43666:1876037626931968:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130572.597133:0:43666:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130572.599305:0:43666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:43666:1876037626931968:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130572.599345:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130572.599431:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605259136:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3788us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130572.599445:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00010000:00010000:2.0:1789130572.601206:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002108c322/0x5c74554e47ced146 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd49 expref: 7 pid: 44793 timeout: 1835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130572.601244:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:44365:1876037626931840:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130572.601293:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.601315:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130572.601427:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:50378:x1876037605259008:12345-192.168.201.39@tcp:101:bash.0 Request processed in 10889us (11214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130572.601438:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789130572.606148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.606238:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605259392 00000100:00100000:2.0:1789130572.606253:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605259392 00000100:00100000:2.0:1789130572.606330:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1789130572.606343:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:50378:x1876037605259392:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789130572.606936:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:50378:x1876037605259392:12345-192.168.201.39@tcp:35:bash.0 Request processed in 593us (801us total) trans 34359738708 rc 0/0 00000100:00100000:2.0:1789130572.606946:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789130572.636242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130572.636698:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605259520 00000100:00100000:1.0:1789130572.636714:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605259520 00000100:00100000:1.0:1789130572.636826:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 379 00000100:00100000:1.0:1789130572.636840:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+16:50381:x1876037605259520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130572.636882:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130572.636914:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd57 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637009:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637028:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637043:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130572.637135:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130572.637140:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130572.637170:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637202:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd57 expref: 18 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637225:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd57 expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.637235:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:1.0:1789130572.637238:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130572.637243:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f000, rc 0) 00000100:00100000:1.0:1789130572.637325:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:50381:x1876037605259520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 488us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130572.637333:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 379 00000100:00100000:3.0:1789130572.933388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.933581:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605259776 00000100:00100000:2.0:1789130572.933598:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605259776 00000100:00100000:2.0:1789130572.933754:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 380 00000100:00100000:2.0:1789130572.933769:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+17:50397:x1876037605259776:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130572.933821:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130572.933861:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71200/0x5c74554e47ced162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd5e expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.934036:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71600/0x5c74554e47ced169 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.934057:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71600/0x5c74554e47ced169 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.934074:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71600/0x5c74554e47ced169 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130572.934091:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:2.0:1789130572.934300:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71200/0x5c74554e47ced162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd5e expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.934327:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71600/0x5c74554e47ced169 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd5e expref: 19 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.934340:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:2.0:1789130572.934344:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130572.934350:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71600, rc 0) 00000100:00100000:2.0:1789130572.934452:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:50397:x1876037605259776:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 686us (1084us total) trans 34359738709 rc 0/0 00000100:00100000:2.0:1789130572.934460:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 380 00000100:00100000:0.0:1789130572.950453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130572.950664:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260032 00000100:00100000:1.0:1789130572.950686:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260032 00000100:00100000:1.0:1789130572.950782:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 381 00000100:00100000:1.0:1789130572.950806:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+19:50397:x1876037605260032:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130572.950840:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130572.950874:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced177 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd65 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.951019:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.951041:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.951056:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130572.951073:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:1.0:1789130572.951530:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced177 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd65 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.951557:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd65 expref: 21 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130572.951567:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130572.951571:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789130572.951575:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3e400, rc 0) 00000100:00100000:1.0:1789130572.953707:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:50397:x1876037605260032:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2899us (3253us total) trans 34359738710 rc 0/0 00000100:00100000:1.0:1789130572.953737:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 381 00000100:00100000:3.0:1789130572.959166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130572.966964:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260160 00000100:00100000:0.0:1789130572.966990:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260160 00000100:00100000:0.0:1789130572.967130:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1789130572.967144:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:2367:x1876037605260160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130572.967168:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130572.967243:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71600/0x5c74554e47ced169 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd5e expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.967273:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:0.0:1789130572.967281:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130572.967489:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:2367:x1876037605260160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 348us (8335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130572.967499:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789130572.968691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.968757:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260288 00000100:00100000:2.0:1789130572.968767:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260288 00000100:00100000:2.0:1789130572.968836:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789130572.968848:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605260288:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789130572.968910:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.968935:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.968946:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789130572.968952:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130572.968957:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.969074:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 6 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.969092:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 6 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130572.969110:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626932096:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130572.969225:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130572.973444:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626932096:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130572.973491:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130572.982289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130572.982402:0:44370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260416 00000100:00100000:2.0:1789130572.982419:0:44370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260416 00002000:00100000:2.0:1789130572.982495:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe9:0x0] (0->4) req@ffff90b394c4bc00 x1876037605260416/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:288/0 lens 496/0 e 0 to 0 dl 1789130583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130572.982508:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b394c4bc00 with x1876037605260416 ext(0->4) 00010000:00010000:2.0:1789130572.982521:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 7 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.982541:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 7 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130572.982557:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b394c4bc00 00000100:00100000:2.0:1789130572.982599:0:44370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789130572.982661:0:44370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605260416:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789130572.983441:0:44370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605260416:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 780us (1168us total) trans 34359738401 rc 0/0 00000100:00100000:2.0:1789130572.983451:0:44370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:2.0:1789130572.983459:0:44370:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe9:0x0] (0->4) req@ffff90b394c4bc00 x1876037605260416/t34359738401(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:288/0 lens 496/448 e 0 to 0 dl 1789130583 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130572.983468:0:44370:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b394c4bc00 with x1876037605260416 ext(0->4) 00010000:00010000:2.0:1789130572.983477:0:44370:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130572.983493:0:44370:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130572.983500:0:44370:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b394c4bc00 00000100:00100000:1.0:1789130572.993209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130572.993648:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260544 00000100:00100000:0.0:1789130572.993664:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260544 00010000:00010000:0.0:1789130572.993769:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130572.993833:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:0.0:1789130572.993848:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605260544:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130572.993873:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789130572.994372:0:45795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe9:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1789130572.994377:0:45795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe9:0x0] updating lvb mtime from disk: 0 -> 1789130572 00002000:00010000:0.0:1789130572.994380:0:45795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xe9:0x0] updating lvb atime from disk: 0 -> 1789130572 00002000:00010000:0.0:1789130572.994383:0:45795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe9:0x0] updating lvb ctime from disk: 0 -> 1789130572 00010000:00010000:0.0:1789130572.994392:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.994412:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.994448:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adb19b6f/0x5c74554e47ced14d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd50 expref: 9 pid: 44365 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.994472:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130572.994478:0:45795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130572.994485:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.994497:0:45795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130572.994561:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130572.995075:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995087:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995121:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995130:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995138:0:44793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995146:0:44793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130572.995152:0:44793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995161:0:44793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995183:0:44793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130572.995203:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0951e62/0x5c74554e47ced18c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130572.995290:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605260288:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 26443us (26609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130572.995301:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1789130572.995466:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2368:x1876037605260544:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1619us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130572.995475:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000040:00080000:2.0:1789130572.998849:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130572.998867:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130572.998916:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 10 count 6 00000040:00080000:2.0:1789130572.998924:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:0.0:1789130572.999286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130572.999536:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260800 00000100:00100000:1.0:1789130572.999558:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260800 00000100:00100000:1.0:1789130572.999655:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789130572.999668:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:50397:x1876037605260800:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:1.0:1789130573.000149:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd65 expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130573.003798:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738711 00000001:00080000:1.0:1789130573.004513:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738712 00000001:00080000:1.0:1789130573.006546:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738713 00010000:00010000:1.0:1789130573.007539:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.007579:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 24 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.007590:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.008161:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 24 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.008295:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 24 pid: 43681 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130573.008325:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa0b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626932224:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130573.008566:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d07c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130573.015540:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa0b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626932224:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130573.015641:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130573.017380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130573.018568:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605260928 00000100:00100000:1.0:1789130573.018584:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605260928 00010000:00010000:1.0:1789130573.018980:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 25 pid: 43681 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130573.019032:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789130573.019047:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+25:2370:x1876037605260928:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130573.019069:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130573.019078:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 25 pid: 43681 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019094:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 25 pid: 43681 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019119:0:43665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced138 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd42 expref: 25 pid: 43681 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019133:0:43665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130573.019138:0:43665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019146:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019156:0:43665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.019186:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130573.019206:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.019215:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130573.019266:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+24:2370:x1876037605260928:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 223us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.019276:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000001:00080000:2.0:1789130573.019415:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738714 00000001:00080000:2.0:1789130573.020257:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738715 00000100:00100000:2.0:1789130573.020516:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626932352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130573.020597:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130573.020756:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932352 00000100:00100000:0.0:1789130573.020764:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932352 00000100:00100000:2.0:1789130573.020885:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130573.021134:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789130573.021150:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626932352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130573.021245:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626932352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130573.021254:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130573.021374:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626932352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130573.021990:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738716 00000100:00100000:2.0:1789130573.022070:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626932480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130573.022113:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130573.022131:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130573.022201:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932480 00000100:00100000:0.0:1789130573.022207:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932480 00000100:00100000:0.0:1789130573.022248:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789130573.022257:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626932480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130573.022444:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626932480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 187us (328us total) trans 34359738402 rc 0/0 00000100:00100000:0.0:1789130573.022451:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789130573.022950:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626932480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130573.023015:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738717 00010000:00010000:1.0:1789130573.023064:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023076:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023085:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023092:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130573.023097:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023105:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023125:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:1.0:1789130573.023128:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789130573.023135:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.023146:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced193 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130573.023498:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:3.0:1789130573.023933:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789130573.026283:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].11, 64 off8944 00000004:00080000:0.0:1789130573.026315:0:43683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1736123711929ns, next at 1737123705517ns, rc = 0 00000001:00080000:0.0:1789130573.026335:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738718 00010000:00010000:0.0:1789130573.026425:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939b00) 00010000:00010000:0.0:1789130573.026430:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789130573.026442:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced17e lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd65 expref: 28 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130573.026649:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+27:50397:x1876037605260800:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 26983us (27368us total) trans 34359738719 rc 0/0 00000100:00100000:0.0:1789130573.026661:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000020:00080000:0.0:1789130573.026668:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789130573.030954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.031015:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605261056 00000100:00100000:2.0:1789130573.031030:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605261056 00000100:00100000:2.0:1789130573.031112:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 382 00000100:00100000:2.0:1789130573.031124:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+27:50397:x1876037605261056:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130573.031162:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130573.031195:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70000/0x5c74554e47ced19a lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd6c expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.031300:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70000/0x5c74554e47ced19a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd6c expref: 28 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.031325:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70000/0x5c74554e47ced19a lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd6c expref: 28 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.031352:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.031367:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130573.031372:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f70000, rc 0) 00000100:00100000:2.0:1789130573.031469:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:50397:x1876037605261056:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 346us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130573.031478:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 382 00000100:00100000:2.0:1789130573.036073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130573.036388:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605261312 00000100:00100000:0.0:1789130573.036402:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605261312 00000100:00100000:0.0:1789130573.036516:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130573.036529:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+28:50397:x1876037605261312:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130573.036904:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:50397:x1876037605261312:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 377us (847us total) trans 34359738720 rc 0/0 00000100:00100000:0.0:1789130573.036914:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130573.064245:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626932608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130573.064378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130573.064528:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932608 00000100:00100000:2.0:1789130573.064541:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932608 00000100:00100000:2.0:1789130573.064699:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789130573.064712:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626932608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130573.064773:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 1703936 granted 61276160 pending 0 free 3765436416 avail 3763339264 00000100:00100000:2.0:1789130573.064836:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626932608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130573.064845:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789130573.065987:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130573.066074:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626932608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130573.067081:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626932992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.067165:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130573.067218:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130573.067224:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626932864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.067249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130573.067279:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626932736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.067315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130573.067346:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130573.067351:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626933120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.067375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130573.067410:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932736 00000100:00100000:1.0:1789130573.067418:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932736 00000100:00100000:1.0:1789130573.067481:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789130573.067491:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626932736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.067554:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626932736:12345-0@lo:400:kworker.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.067563:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789130573.067660:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626932736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.071989:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932992 00000100:00100000:1.0:1789130573.072017:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932992 00000100:00100000:1.0:1789130573.072112:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626932864 00000100:00100000:1.0:1789130573.072118:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626932864 00000100:00100000:1.0:1789130573.072139:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626933120 00000100:00100000:1.0:1789130573.072142:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626933120 00000100:00100000:1.0:1789130573.072167:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789130573.072180:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.072322:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626932992:12345-0@lo:400:kworker.0 Request processed in 144us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.072331:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789130573.072353:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789130573.072359:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626932864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.072396:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626932864:12345-0@lo:400:kworker.0 Request processed in 38us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.072403:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789130573.072417:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789130573.072425:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626933120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.072462:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626933120:12345-0@lo:400:kworker.0 Request processed in 39us (5085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.072468:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789130573.072528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626933120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.072581:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626932864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130573.072595:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626932992:0@lo:400:kworker.0 00000100:00080000:0.0:1789130573.073887:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130573.155128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130573.156552:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605261440 00000100:00100000:1.0:1789130573.156571:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605261440 00000100:00100000:1.0:1789130573.156940:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 383 00000100:00100000:1.0:1789130573.156955:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:50407:x1876037605261440:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789130573.157064:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157086:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157102:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157122:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157129:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157135:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157271:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157279:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157285:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130573.157338:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157351:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157363:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157370:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157377:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130573.157381:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157389:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157402:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:1.0:1789130573.157405:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130573.157410:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157416:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced1a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157431:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157437:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157443:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157449:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130573.157452:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157458:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157465:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8996d334 (ffff90b4909bde00) 00010000:00010000:1.0:1789130573.157467:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130573.157470:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157476:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157493:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157499:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157506:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157511:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130573.157513:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157519:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157525:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:1.0:1789130573.157527:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130573.157531:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.157538:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1af lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130573.158493:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:50407:x1876037605261440:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1536us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.158507:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 383 00000100:00100000:3.0:1789130573.253130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.253344:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605261568 00000100:00100000:2.0:1789130573.253357:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605261568 00000100:00100000:2.0:1789130573.253436:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 384 00000100:00100000:2.0:1789130573.253448:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:50414:x1876037605261568:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:2.0:1789130573.253477:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130573.253507:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70c00/0x5c74554e47ced1b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd73 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253643:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253662:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253693:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253712:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253720:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253758:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253916:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253926:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.253934:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130573.253985:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00000004:00200000:2.0:1789130573.253991:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130573.254023:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254042:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254052:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254061:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254069:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254076:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130573.254081:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254090:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254104:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:2.0:1789130573.254107:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130573.254114:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254121:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced1bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254138:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254144:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254150:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254156:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130573.254159:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254166:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254174:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8996d334 (ffff90b482b51700) 00010000:00010000:2.0:1789130573.254176:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130573.254179:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254185:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254223:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70c00/0x5c74554e47ced1b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 31 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254238:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.254247:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.254249:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130573.254252:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71a00, rc 0) 00000100:00100000:2.0:1789130573.254345:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+30:50414:x1876037605261568:12345-192.168.201.39@tcp:101:stat.0 Request processed in 898us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130573.254358:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 384 00010000:00010000:3.0:1789130573.451105:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130573.459493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130573.459594:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605261824 00000100:00100000:1.0:1789130573.459737:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605261824 00000100:00100000:1.0:1789130573.459927:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 385 00000100:00100000:1.0:1789130573.459942:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+30:50427:x1876037605261824:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130573.459976:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130573.460009:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd7a expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.460158:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1d9 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.460178:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1d9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.460194:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1d9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130573.460209:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:1.0:1789130573.460396:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced1d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd7a expref: 33 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.460418:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1d9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd7a expref: 32 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.460428:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:1.0:1789130573.460431:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130573.460435:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130573.463433:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+32:50427:x1876037605261824:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3479us (3940us total) trans 34359738721 rc 0/0 00000100:00100000:1.0:1789130573.463452:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 385 00000100:00100000:0.0:1789130573.472090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130573.472214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130573.472337:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605262208 00000100:00100000:3.0:1789130573.472360:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605262208 00000100:00100000:3.0:1789130573.472462:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789130573.472476:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:2370:x1876037605262208:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130573.472498:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130573.472534:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced1d9 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd7a expref: 32 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130573.472561:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130573.472568:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130573.473038:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:2370:x1876037605262208:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 563us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130573.473049:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789130573.473435:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605262080 00000100:00100000:2.0:1789130573.473443:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605262080 00000100:00100000:2.0:1789130573.473528:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789130573.473537:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:50427:x1876037605262080:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789130573.473878:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:50427:x1876037605262080:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 341us (1804us total) trans 34359738722 rc 0/0 00000100:00100000:2.0:1789130573.474004:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789130573.561343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.561545:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605262464 00000100:00100000:2.0:1789130573.561558:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605262464 00000100:00100000:2.0:1789130573.561776:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 386 00000100:00100000:2.0:1789130573.561793:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:50433:x1876037605262464:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130573.561834:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130573.561870:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70c00/0x5c74554e47ced1e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd81 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.562039:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.562057:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.562068:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.562115:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.562133:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 33 pid: 43680 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130573.562153:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626933248:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130573.562336:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130573.566182:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626933248:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130573.566246:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130573.567903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.568254:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605262592 00000100:00100000:2.0:1789130573.568268:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605262592 00010000:00010000:2.0:1789130573.568325:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 34 pid: 43680 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130573.568388:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130573.568399:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:2370:x1876037605262592:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130573.568419:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130573.568428:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 34 pid: 43680 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568444:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 34 pid: 43680 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568472:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1cb lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd73 expref: 34 pid: 43680 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568498:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.568504:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568515:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568524:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.568864:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130573.568946:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:2370:x1876037605262592:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 547us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130573.568956:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00010000:00010000:3.0:1789130573.569889:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130573.569904:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130573.569932:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:3.0:1789130573.570153:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70c00/0x5c74554e47ced1e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd81 expref: 34 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130573.570176:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd81 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130573.570186:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130573.570190:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130573.570193:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71800, rc 0) 00000100:00100000:3.0:1789130573.570250:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605262464:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 8464us (8924us total) trans 34359738723 rc 0/0 00000100:00100000:3.0:1789130573.570259:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 386 00000100:00100000:0.0:1789130573.575865:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.576031:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605262848 00000100:00100000:2.0:1789130573.576045:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605262848 00000100:00100000:2.0:1789130573.576132:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 387 00000100:00100000:2.0:1789130573.576145:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605262848:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130573.576180:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130573.576183:0:43679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130573.576222:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced1ee lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd81 expref: 33 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576245:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.576252:0:43679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130573.576270:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1fc lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd88 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576420:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576437:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576449:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130573.576724:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:2.0:1789130573.576956:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced1fc lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd88 expref: 35 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576973:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd88 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.576983:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.576986:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130573.576989:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71c00, rc 0) 00000100:00100000:2.0:1789130573.577067:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:50433:x1876037605262848:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 923us (1218us total) trans 34359738724 rc 0/0 00000100:00100000:2.0:1789130573.577076:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 387 00000100:00100000:0.0:1789130573.583837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130573.583969:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263104 00000100:00100000:1.0:1789130573.583983:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263104 00000100:00100000:1.0:1789130573.584082:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789130573.584095:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:50433:x1876037605263104:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789130573.584115:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130573.584149:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70000/0x5c74554e47ced19a lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd6c expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.584172:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:1.0:1789130573.584179:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130573.584253:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605263104:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.584262:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789130573.587135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130573.587229:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263232 00000100:00100000:1.0:1789130573.587245:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263232 00000100:00100000:1.0:1789130573.587333:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 388 00000100:00100000:1.0:1789130573.587354:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605263232:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1789130573.587517:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.587540:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130573.587555:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130573.588056:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x32:0x0].10, 136 off9552 00000100:00100000:1.0:1789130573.588170:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605263232:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 826us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130573.588180:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 388 00000100:00100000:0.0:1789130573.591589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130573.591807:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263360 00000100:00100000:2.0:1789130573.591822:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263360 00000100:00100000:2.0:1789130573.591908:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 389 00000100:00100000:2.0:1789130573.591922:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:50433:x1876037605263360:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130573.591955:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130573.591986:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd8f expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592065:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 2/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592078:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 4/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592103:0:43679:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592120:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592136:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130573.592140:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130573.592144:0:43679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130573.592154:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71a00, rc 0) 00000100:00100000:2.0:1789130573.592384:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+34:50433:x1876037605263360:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 464us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130573.592394:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 389 00000040:00080000:2.0:1789130574.023159:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130574.023174:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130574.023232:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 11 count 7 00000040:00080000:2.0:1789130574.023244:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130574.023431:0:43713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626933376:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789130574.023585:0:43713:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130574.033070:0:43713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:43713:1876037626933376:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789130574.039134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.041578:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263488 00000100:00100000:1.0:1789130574.041599:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263488 00000100:00100000:1.0:1789130574.041947:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 390 00000100:00100000:1.0:1789130574.041971:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:50434:x1876037605263488:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130574.042028:0:43681:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x22:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130574.043371:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+34:50434:x1876037605263488:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 1406us (4249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.043387:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 390 00000100:00080000:0.0:1789130574.043466:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130574.057346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.057449:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263616 00000100:00100000:1.0:1789130574.057464:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263616 00000100:00100000:1.0:1789130574.057555:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 391 00000100:00100000:1.0:1789130574.057569:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:50434:x1876037605263616:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.057702:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057734:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057758:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057826:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057835:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057843:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057875:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057885:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057892:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130574.057947:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00000004:00200000:1.0:1789130574.057953:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130574.057971:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057983:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.057990:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058000:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058007:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130574.058012:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058020:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058047:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:1.0:1789130574.058051:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130574.058056:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058063:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced21f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058080:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058095:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058102:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058107:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130574.058110:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058120:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058128:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x381283f7 (ffff90b4909bde00) 00010000:00010000:1.0:1789130574.058131:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130574.058133:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058139:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced226 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x381283f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058156:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058163:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058168:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058174:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130574.058177:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058184:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058192:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:1.0:1789130574.058194:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130574.058197:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.058208:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced22d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.058318:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3897d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:50434:x1876037605263616:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 749us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.058330:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 391 00000100:00100000:0.0:1789130574.074721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.078429:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605263872 00000100:00100000:2.0:1789130574.078453:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605263872 00000100:00100000:2.0:1789130574.078567:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 392 00000100:00100000:2.0:1789130574.078581:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:50434:x1876037605263872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130574.078671:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130574.078703:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced234 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd96 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.078865:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/1,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.078885:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.078900:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130574.078915:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:2.0:1789130574.079077:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/1,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079085:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079254:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079260:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130574.079266:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079275:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079291:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130574.079295:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130574.079301:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079309:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced23b lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079372:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced234 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd96 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079385:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:2.0:1789130574.079387:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130574.079391:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced234 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd96 expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.079402:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71800, rc 0) 00000100:00100000:2.0:1789130574.079487:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605263872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 908us (4790us total) trans 34359738725 rc 301/301 00000100:00100000:2.0:1789130574.079496:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 392 00000100:00100000:3.0:1789130574.091085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.091190:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605264000 00000100:00100000:1.0:1789130574.091204:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605264000 00000100:00100000:1.0:1789130574.091291:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 393 00000100:00100000:1.0:1789130574.091303:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605264000:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130574.091384:0:45555:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200003ab1:0x22:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130574.091521:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605264000:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 219us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.091529:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 393 00000100:00100000:0.0:1789130574.095230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.099183:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605264256 00000100:00100000:2.0:1789130574.099206:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605264256 00000100:00100000:2.0:1789130574.099360:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 394 00000100:00100000:2.0:1789130574.099374:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605264256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130574.099403:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130574.099406:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789130574.099442:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f000/0x5c74554e47ced15b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd57 expref: 35 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.099479:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd700) 00010000:00010000:2.0:1789130574.099492:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130574.099515:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced249 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acd9d expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130574.101684:0:43680:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xea:0x0], index 1: 0 00010000:00010000:2.0:1789130574.103948:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced250 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.103975:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced250 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.103990:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced250 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.104258:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced249 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd9d expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.104293:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced250 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd9d expref: 36 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.104302:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789130574.104306:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130574.104310:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71400, rc 0) 00000100:00100000:2.0:1789130574.104396:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+36:50434:x1876037605264256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5025us (9314us total) trans 34359738726 rc 0/0 00000100:00100000:2.0:1789130574.104407:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 394 00000100:00100000:0.0:1789130574.112694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.115163:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605264384 00000100:00100000:1.0:1789130574.115192:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605264384 00000100:00100000:1.0:1789130574.115311:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 395 00000100:00100000:1.0:1789130574.115329:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+36:50434:x1876037605264384:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.115368:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130574.115414:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced25e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acda4 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.115519:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.115538:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.115552:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130574.115695:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1789130574.115700:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130574.115738:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.115772:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced25e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acda4 expref: 38 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.115794:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acda4 expref: 37 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.117051:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789130574.117063:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130574.117069:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130574.117178:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+37:50434:x1876037605264384:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1851us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.117190:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 395 00000100:00100000:0.0:1789130574.124382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.124514:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605264640 00000100:00100000:1.0:1789130574.124530:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605264640 00000100:00100000:1.0:1789130574.124665:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 396 00000100:00100000:1.0:1789130574.124679:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+37:50434:x1876037605264640:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.124763:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789130574.124809:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71400/0x5c74554e47ced250 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd9d expref: 37 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124837:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789130574.124859:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced265 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acda4 expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124869:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789130574.124876:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130574.124908:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124924:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124936:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124953:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124960:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.124967:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125075:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125083:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125094:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125101:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130574.125106:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125115:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125124:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789130574.125127:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130574.125131:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125137:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced26c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125149:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125156:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125162:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125167:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130574.125170:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125181:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125188:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e42921 (ffff90b4909bd700) 00010000:00010000:1.0:1789130574.125191:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130574.125194:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.125199:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced273 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x21e42921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.125298:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605264640:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 622us (931us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130574.125308:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 396 00000100:00100000:0.0:1789130574.132867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.134098:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605264768 00000100:00100000:2.0:1789130574.134117:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605264768 00000100:00100000:2.0:1789130574.134215:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 397 00000100:00100000:2.0:1789130574.134228:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:50434:x1876037605264768:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130574.134257:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130574.134291:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced27a lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdab expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134345:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134363:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134377:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134544:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71800/0x5c74554e47ced27a lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 37 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134568:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 36 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.134578:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130574.134581:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130574.134586:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f70a00, rc 0) 00000100:00100000:2.0:1789130574.134753:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+36:50434:x1876037605264768:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 527us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.134762:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 397 00000100:00100000:0.0:1789130574.144291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.144438:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265024 00000100:00100000:1.0:1789130574.144454:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265024 00000100:00100000:1.0:1789130574.144572:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 398 00000100:00100000:1.0:1789130574.144590:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+36:50434:x1876037605265024:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.144788:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.144818:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.144834:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130574.146840:0:43681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].10, 88 off8952 00000004:00080000:0.0:1789130574.146864:0:43681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1737244260924ns, next at 1738244255049ns, rc = 0 00000004:00010000:0.0:1789130574.147466:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000232ad3a2 reply state 000000008872fd41 transno 34359738727 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.147482:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130574.147720:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+38:50434:x1876037605265024:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 3123us (3841us total) trans 34359738727 rc 0/0 00000100:00100000:0.0:1789130574.147731:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 398 00010000:00010000:2.0:1789130574.152650:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152690:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152698:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152705:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130574.152720:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152729:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152753:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130574.152756:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130574.152763:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.152770:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced288 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.155135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.155240:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265152 00000100:00100000:2.0:1789130574.155254:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265152 00000100:00100000:2.0:1789130574.155563:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 399 00000100:00100000:2.0:1789130574.155576:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+37:50434:x1876037605265152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130574.155631:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130574.155676:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdb2 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.155777:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 38 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.155796:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 38 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.155821:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130574.155824:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130574.155829:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71e00, rc 0) 00000100:00100000:2.0:1789130574.155926:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:50434:x1876037605265152:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 352us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.155935:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 399 00000100:00100000:0.0:1789130574.164217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.164730:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265280 00000100:00100000:3.0:1789130574.164743:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265280 00000100:00100000:3.0:1789130574.164836:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789130574.164849:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605265280:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789130574.165072:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130574.165814:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605265280:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 963us (1610us total) trans 34359738403 rc 0/0 00000100:00100000:3.0:1789130574.165826:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789130574.174179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.174480:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265536 00000100:00100000:3.0:1789130574.174494:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265536 00000100:00100000:3.0:1789130574.174637:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1789130574.174648:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+38:50434:x1876037605265536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130574.175209:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+39:50434:x1876037605265536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 561us (1044us total) trans 34359738728 rc 0/0 00000100:00100000:3.0:1789130574.175219:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:0.0:1789130574.178166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.178320:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265792 00000100:00100000:2.0:1789130574.178352:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265792 00000100:00100000:2.0:1789130574.178436:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 400 00000100:00100000:2.0:1789130574.178448:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:50434:x1876037605265792:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130574.179629:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+39:50434:x1876037605265792:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 156us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.179644:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 400 00000100:00100000:0.0:1789130574.182863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.183100:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605265920 00000100:00100000:1.0:1789130574.183113:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605265920 00000100:00100000:1.0:1789130574.183200:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 401 00000100:00100000:1.0:1789130574.183212:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+39:50434:x1876037605265920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.183259:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130574.183294:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced296 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdb9 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183393:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183410:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183425:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130574.183473:0:45555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789130574.183497:0:45555:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183530:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced296 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb9 expref: 41 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183551:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb9 expref: 40 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.183560:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130574.183563:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789130574.183567:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3fe00, rc 0) 00000100:00100000:1.0:1789130574.183725:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:50434:x1876037605265920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 511us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.183742:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 401 00000100:00100000:0.0:1789130574.189560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.189846:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266048 00000100:00100000:3.0:1789130574.189864:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266048 00000100:00100000:3.0:1789130574.189986:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789130574.190004:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2368:x1876037605266048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130574.190032:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130574.190065:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdc0 expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130574.190103:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f74d, blocks: 0x1 00010000:00010000:3.0:1789130574.190131:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=1737s v=(0 0) 00010000:00010000:3.0:1789130574.190137:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130574.190149:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 10 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.190171:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 10 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.190189:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4a00, rc 0) 00000100:00100000:3.0:1789130574.190568:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2368:x1876037605266048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 568us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.190583:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1789130574.207033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.207181:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266304 00000100:00100000:3.0:1789130574.207194:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266304 00000100:00100000:3.0:1789130574.207291:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 402 00000100:00100000:3.0:1789130574.207308:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+40:50434:x1876037605266304:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789130574.207490:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+40:50434:x1876037605266304:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 187us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.207499:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 402 00000100:00100000:1.0:1789130574.210977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.211232:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266432 00000100:00100000:2.0:1789130574.211270:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266432 00000100:00100000:2.0:1789130574.211392:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:2.0:1789130574.211410:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:50434:x1876037605266432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130574.211444:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130574.211478:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdc7 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.211526:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 11 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.211537:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130574.211543:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130574.211549:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 11 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.211597:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 11 pid: 44367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.211671:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 11 pid: 44367 timeout: 1837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130574.211694:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626933504:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130574.211861:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130574.220484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.221154:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266560 00000100:00100000:1.0:1789130574.221169:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266560 00010000:00010000:1.0:1789130574.221242:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 12 pid: 44367 timeout: 1837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.221299:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789130574.221312:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605266560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130574.221334:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130574.221381:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 12 pid: 44367 timeout: 1837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.221400:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 12 pid: 44367 timeout: 1837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.221442:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130574.221448:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130574.221460:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 12 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.221472:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 12 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.221534:0:43665:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 12 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.221554:0:43665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:43665:1876037626933632:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789130574.221739:0:43665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d076c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130574.223500:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257aacb0/0x5c74554e47ced2a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc0 expref: 12 pid: 44367 timeout: 1837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130574.223542:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626933504:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130574.223593:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 11 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.223694:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f70e00, rc 0) 00000100:00100000:2.0:1789130574.223785:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:50434:x1876037605266432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 12381us (12825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.223808:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789130574.234227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.234950:0:47023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266688 00000100:00100000:2.0:1789130574.234967:0:47023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266688 00002000:00100000:2.0:1789130574.235049:0:47023:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xea:0x0] (0->4) req@ffff90b386ef7480 x1876037605266688/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:290/0 lens 496/0 e 0 to 0 dl 1789130585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130574.235065:0:47023:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ef7480 with x1876037605266688 ext(0->4) 00002000:00010000:2.0:1789130574.235074:0:47023:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386ef7480 00000100:00100000:2.0:1789130574.235121:0:47023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789130574.235133:0:47023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605266688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789130574.235844:0:47023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+13:2369:x1876037605266688:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 708us (1631us total) trans 34359738404 rc 0/0 00000100:00100000:2.0:1789130574.235856:0:47023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00002000:00100000:2.0:1789130574.235865:0:47023:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xea:0x0] (0->4) req@ffff90b386ef7480 x1876037605266688/t34359738404(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:290/0 lens 496/448 e 0 to 0 dl 1789130585 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130574.235875:0:47023:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b386ef7480 with x1876037605266688 ext(0->4) 00002000:00010000:2.0:1789130574.235880:0:47023:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b386ef7480 00000100:00100000:1.0:1789130574.238694:0:43665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:43665:1876037626933632:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789130574.238744:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130574.238819:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+12:2370:x1876037605266560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 17508us (18352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.238833:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789130574.245845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.246098:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266816 00000100:00100000:1.0:1789130574.246114:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266816 00000100:00100000:1.0:1789130574.246235:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 403 00000100:00100000:1.0:1789130574.246273:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:50434:x1876037605266816:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789130574.338852:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+40:50434:x1876037605266816:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 92583us (93003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.338874:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 403 00000001:00080000:3.0:1789130574.341070:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738727 is committed 00000004:00080000:3.0:1789130574.341088:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789130574.341142:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000020:00080000:3.0:1789130574.341207:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4bad44180 refcount 2 committed 0 result 0 batchid 30064771689 00000020:00080000:3.0:1789130574.341213:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bad44780 00000020:00080000:3.0:1789130574.341216:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b390d06400 00000001:00080000:3.0:1789130574.341246:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738728 is committed 00000020:00080000:3.0:1789130574.341274:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771689 committed batchid 30064771688 00000100:00100000:1.0:1789130574.341745:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626933760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789130574.341876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789130574.344112:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771688 00000100:00100000:1.0:1789130574.344905:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130574.344938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626933888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789130574.345052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130574.345248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.345727:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626933760 00000100:00100000:0.0:1789130574.345741:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626933760 00000100:00100000:0.0:1789130574.345842:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626933888 00000100:00100000:0.0:1789130574.345848:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626933888 00000100:00100000:0.0:1789130574.345871:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605266944 00000100:00100000:0.0:1789130574.345874:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605266944 00000100:00100000:0.0:1789130574.345895:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130574.345905:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626933760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789130574.345946:0:44366:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:233 count 1 00002000:00010000:0.0:1789130574.346007:0:44366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe9:0x0] initial LVB size: 5, mtime: 0x6aa3f74c, atime: 0x6aa3f74c, ctime: 0x6aa3f74c, blocks: 0x1 00010000:00010000:0.0:1789130574.346021:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.346043:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=1737s v=(0 0) 00010000:00010000:0.0:1789130574.346048:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130574.346056:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.346077:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.346088:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.346096:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.346123:0:44366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789130574.346543:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789130574.346558:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626933888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789130574.347082:0:44365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1789130574.347090:0:44365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb mtime from disk: 0 -> 1789130573 00002000:00010000:1.0:1789130574.347093:0:44365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130574.347096:0:44365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb ctime from disk: 1789130573 -> 1789130573 00002000:00010000:1.0:1789130574.347099:0:44365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789130574.347220:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626933888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 666us (2166us total) trans 34359738405 rc 0/0 00000100:00100000:1.0:1789130574.347230:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789130574.347262:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789130574.347272:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+12:2367:x1876037605266944:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.347320:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130574.347329:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130574.348163:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386fe5a40/2, rc 0, transno 34359738405 00000100:00100000:3.0:1789130574.348176:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626933888:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789130574.348891:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f2800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130574.348899:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.348914:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.348940:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.348950:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b048a5/0x5c74554e47ced2b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.349001:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130574.349004:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130574.349008:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130574.350099:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626933760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4188us (8216us total) trans 34359738403 rc 0/0 00000100:00100000:0.0:1789130574.350114:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000004:00080000:1.0:1789130574.353648:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b387aa3c00/2, rc 0, transno 34359738403 00000100:00100000:1.0:1789130574.353675:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626933760:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789130574.420512:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738405 is committed 00000001:00080000:3.0:1789130574.420564:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738404 is committed 00000100:00100000:3.0:1789130574.420885:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605266944:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 73602us (75629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.420903:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789130574.426792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.427840:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267200 00000100:00100000:3.0:1789130574.427861:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267200 00000100:00100000:3.0:1789130574.428190:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 404 00000100:00100000:3.0:1789130574.428210:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:50434:x1876037605267200:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789130574.428309:0:43681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130574.428549:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced29d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb9 expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.428584:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:3.0:1789130574.428594:0:43681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130574.429851:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.429879:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.429895:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130574.430223:0:43681:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ae893894 reply state 0000000049ba7043 transno 34359738729 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.430239:0:43681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130574.434007:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+18:50434:x1876037605267200:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 5781us (7211us total) trans 34359738729 rc 0/0 00000100:00100000:3.0:1789130574.434030:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 404 00000100:00100000:3.0:1789130574.439966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.440105:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267328 00000100:00100000:0.0:1789130574.440121:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267328 00000100:00100000:0.0:1789130574.440227:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130574.440245:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605267328:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789130574.440740:0:44367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1789130574.440745:0:44367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb mtime from disk: 1789130573 -> 1789130572 00002000:00010000:0.0:1789130574.440748:0:44367:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb atime from disk: 0 -> 1789130572 00002000:00010000:0.0:1789130574.440750:0:44367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb ctime from disk: 1789130573 -> 1789130572 00002000:00010000:0.0:1789130574.440752:0:44367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xea:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789130574.440845:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605267328:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 604us (896us total) trans 34359738406 rc 0/0 00000100:00100000:0.0:1789130574.440855:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789130574.444084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.444221:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267584 00000100:00100000:1.0:1789130574.444239:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267584 00000100:00100000:1.0:1789130574.444363:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 405 00000100:00100000:1.0:1789130574.444376:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:50434:x1876037605267584:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789130574.444493:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.444522:0:43679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.444537:0:43679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 4/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.444883:0:43679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.444904:0:43679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.444923:0:43679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626934016:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130574.445047:0:43679:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7d076c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130574.448872:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448898:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448909:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448915:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130574.448922:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448932:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448958:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:2.0:1789130574.448962:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130574.448967:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.448973:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4a00/0x5c74554e47ced2b9 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.449495:0:43679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:43679:1876037626934016:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130574.449545:0:43679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.453548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.454458:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267712 00000100:00100000:1.0:1789130574.454482:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267712 00010000:00010000:1.0:1789130574.454565:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.454723:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789130574.454739:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:2369:x1876037605267712:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130574.454762:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130574.454774:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454796:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454834:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70a00/0x5c74554e47ced281 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdab expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454861:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130574.454870:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454881:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454891:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.454923:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130574.455035:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:2369:x1876037605267712:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 300us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.455045:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:0.0:1789130574.455415:0:43679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455426:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455482:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455494:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455504:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455514:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130574.455521:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455533:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455551:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:0.0:1789130574.455556:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789130574.455562:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.455572:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e200/0x5c74554e47ced2c0 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.455735:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:50434:x1876037605267584:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 11357us (11663us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789130574.455751:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 405 00000100:00100000:1.0:1789130574.460934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.461150:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267840 00000100:00100000:0.0:1789130574.461171:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267840 00000100:00100000:0.0:1789130574.461287:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789130574.461307:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605267840:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789130574.461406:0:44366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.461437:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 10 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.461451:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130574.461458:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130574.461467:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.461528:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 10 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.461552:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 10 pid: 44365 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.461578:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626934144:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789130574.462110:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130574.466369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.466482:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605267968 00000100:00100000:1.0:1789130574.466496:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605267968 00010000:00010000:1.0:1789130574.466557:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 11 pid: 44365 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.466666:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789130574.466683:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2370:x1876037605267968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130574.466727:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130574.466769:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 11 pid: 44365 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.466791:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 11 pid: 44365 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.466829:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130574.466835:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130574.466843:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.466855:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.466883:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130574.466971:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2370:x1876037605267968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 290us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.466985:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00010000:00010000:3.0:1789130574.468199:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019002fc7/0x5c74554e47ced2ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdc7 expref: 10 pid: 44365 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.468225:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:44366:1876037626934144:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130574.468264:0:44366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468276:0:44366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468285:0:44366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468329:0:44366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468363:0:44366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468373:0:44366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468380:0:44366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130574.468385:0:44366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468396:0:44366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468416:0:44366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.468426:0:44366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90723d2/0x5c74554e47ced2c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.468575:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2370:x1876037605267840:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7272us (7654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.468591:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00010000:00010000:3.0:1789130574.470114:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130574.470952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.471067:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268224 00000100:00100000:3.0:1789130574.471083:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268224 00000100:00100000:3.0:1789130574.471252:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 406 00000100:00100000:3.0:1789130574.471266:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:50434:x1876037605268224:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789130574.471387:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471411:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471427:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471874:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471890:0:43680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 17 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471899:0:43680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471954:0:43680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 17 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.471972:0:43680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 17 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.471992:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626934272:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130574.472126:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130574.476298:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626934272:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130574.476360:0:43680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130574.477573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.477958:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268352 00000100:00100000:1.0:1789130574.477977:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268352 00010000:00010000:1.0:1789130574.478046:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.478109:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:1.0:1789130574.478127:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:2370:x1876037605268352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130574.478151:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130574.478163:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478184:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478221:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced28f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdb2 expref: 18 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478245:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:1.0:1789130574.478252:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478264:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478272:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.478317:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130574.478420:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+17:2370:x1876037605268352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 298us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.478430:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00010000:00010000:2.0:1789130574.478786:0:43680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.478806:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130574.479089:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738730 00000001:00080000:2.0:1789130574.479498:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738731 00000001:00080000:2.0:1789130574.479559:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738732 00000100:00100000:2.0:1789130574.479709:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaf840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626934400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130574.479790:0:43680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130574.479831:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130574.479973:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626934400 00000100:00100000:1.0:1789130574.479981:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626934400 00000100:00100000:1.0:1789130574.480037:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130574.480047:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626934400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130574.480163:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626934400:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.480174:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130574.480431:0:43680:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738405 gen 2 00000004:00080000:2.0:1789130574.480439:0:43680:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386fe5a40, transno 34359738405 00000100:00100000:2.0:1789130574.480459:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaf840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626934400:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789130574.482712:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738733 00000100:00100000:2.0:1789130574.482835:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386eaf840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626934528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789130574.484027:0:43680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130574.484078:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789130574.484093:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626934528 00000100:00100000:1.0:1789130574.484103:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626934528 00000100:00100000:1.0:1789130574.484172:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130574.484184:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43680:x1876037626934528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789130574.484588:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43680:x1876037626934528:12345-0@lo:1000:mdt00_001.0 Request processed in 403us (564us total) trans 34359738407 rc 0/0 00000100:00100000:1.0:1789130574.484635:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130574.484971:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386eaf840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:43680:1876037626934528:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789130574.485133:0:43680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738734 00010000:00010000:3.0:1789130574.485186:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485199:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485209:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485218:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130574.485225:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485239:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485261:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51700) 00010000:00010000:3.0:1789130574.485265:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130574.485272:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485278:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced2d5 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485324:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485344:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485350:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485355:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3f600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130574.485358:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485369:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485378:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130574.485381:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130574.485390:0:43680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485403:0:43680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485413:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.485465:0:43680:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 21 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.485488:0:43680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626934656:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789130574.485670:0:43680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130574.489217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.489950:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268480 00000100:00100000:0.0:1789130574.489965:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268480 00000100:00100000:0.0:1789130574.490055:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:0.0:1789130574.490067:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:50433:x1876037605268480:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:0.0:1789130574.490259:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+22:50433:x1876037605268480:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 194us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.490269:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:3.0:1789130574.491371:0:43680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:43680:1876037626934656:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789130574.491416:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491430:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f600/0x5c74554e47ced211 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491488:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491513:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491531:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491547:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491556:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491564:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491573:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130574.491580:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491592:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491669:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130574.491676:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130574.491682:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491691:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced2dc lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491714:0:43680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491722:0:43680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491728:0:43680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491733:0:43680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130574.491737:0:43680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491743:0:43680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 4/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491751:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:3.0:1789130574.491753:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130574.491756:0:43680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.491762:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ce lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.492119:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:50434:x1876037605268224:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 20853us (21173us total) trans 34359738735 rc 0/0 00000100:00100000:3.0:1789130574.492135:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 406 00000020:00080000:3.0:1789130574.492144:0:43680:0:(tgt_main.c:785:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1789130574.492763:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:2.0:1789130574.492772:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789130574.493258:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 64768 count 7 00000040:00080000:2.0:1789130574.493270:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130574.507462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.507813:0:44367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268608 00000100:00100000:0.0:1789130574.507831:0:44367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268608 00000100:00100000:0.0:1789130574.507922:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1789130574.507936:0:44367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+9:50433:x1876037605268608:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130574.507964:0:44367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130574.507995:0:44367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdce expref: -99 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789130574.508031:0:44367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xea:0x0] initial LVB size: 5, mtime: 0x6aa3f74c, atime: 0x6aa3f74c, ctime: 0x6aa3f74c, blocks: 0xb 00010000:00010000:0.0:1789130574.508060:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=1737s v=(0 0) 00010000:00010000:0.0:1789130574.508065:0:44367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130574.508078:0:44367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.508097:0:44367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.508114:0:44367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130574.508304:0:44367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f164769-cccd-48c1-b7fa-967be7565442+10:50433:x1876037605268608:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 371us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.508312:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1789130574.515968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.516096:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268864 00000100:00100000:3.0:1789130574.516112:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268864 00000100:00100000:3.0:1789130574.516207:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:3.0:1789130574.516224:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:50434:x1876037605268864:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789130574.519555:0:43682:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789130574.519872:0:43682:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738736 00010000:00010000:2.0:1789130574.519980:0:43682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520000:0:43682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520013:0:43682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520022:0:43682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520034:0:43682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520040:0:43682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.520069:0:43682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130574.520228:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+23:50434:x1876037605268864:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 4004us (4273us total) trans 34359738737 rc 0/0 00000100:00100000:2.0:1789130574.520241:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000020:00080000:2.0:1789130574.520249:0:43682:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789130574.521748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789130574.521893:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130574.521905:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.521916:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f71e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789130574.521921:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 2/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.521931:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.521954:0:43668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x24:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:1.0:1789130574.521957:0:43668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130574.521964:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 1/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.521971:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced2ea lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 43682 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.522001:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130574.522003:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130574.522005:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130574.522117:0:44371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605268992 00000100:00100000:0.0:1789130574.522131:0:44371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605268992 00002000:00100000:0.0:1789130574.522195:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xea:0x0] (0->4095) req@ffff90b3895b2580 x1876037605268992/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:290/0 lens 488/0 e 0 to 0 dl 1789130585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130574.522206:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3895b2580 with x1876037605268992 ext(0->4095) 00002000:00010000:0.0:1789130574.522213:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3895b2580 00000100:00100000:0.0:1789130574.522253:0:44371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1789130574.522264:0:44371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605268992:12345-192.168.201.39@tcp:3:lfs.0 00000100:00100000:0.0:1789130574.522544:0:44371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6f164769-cccd-48c1-b7fa-967be7565442+10:2370:x1876037605268992:12345-192.168.201.39@tcp:3:lfs.0 Request processed in 280us (804us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789130574.522553:0:44371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00002000:00100000:0.0:1789130574.522560:0:44371:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xea:0x0] (0->4095) req@ffff90b3895b2580 x1876037605268992/t0(0) o3->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:290/0 lens 488/4536 e 0 to 0 dl 1789130585 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789130574.522568:0:44371:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3895b2580 with x1876037605268992 ext(0->4095) 00002000:00010000:0.0:1789130574.522571:0:44371:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b3895b2580 00000100:00100000:0.0:1789130574.530248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.530517:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605269120 00000100:00100000:3.0:1789130574.530531:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605269120 00000100:00100000:3.0:1789130574.530689:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:3.0:1789130574.530718:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605269120:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:3.0:1789130574.530798:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.530826:0:44365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.530840:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130574.530846:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130574.530853:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.530909:0:44365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 10 pid: 44367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.530932:0:44365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 10 pid: 44367 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.530956:0:44365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626934784:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130574.531088:0:44365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7568d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130574.533692:0:44365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:44365:1876037626934784:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130574.533754:0:44365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.534177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.534419:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605269248 00000100:00100000:1.0:1789130574.534429:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605269248 00010000:00010000:1.0:1789130574.534489:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 11 pid: 44367 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.534556:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:1.0:1789130574.534572:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+11:2369:x1876037605269248:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130574.534595:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130574.534793:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 11 pid: 44367 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.534810:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 11 pid: 44367 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.534842:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab53611a/0x5c74554e47ced2e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdce expref: 11 pid: 44367 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.534984:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130574.534993:0:43664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130574.535003:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.535018:0:43664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.535056:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130574.535165:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+10:2369:x1876037605269248:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 594us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.535178:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00010000:00010000:3.0:1789130574.535958:0:44365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.535974:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536024:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536036:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536044:0:44365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536052:0:44365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130574.536058:0:44365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536068:0:44365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536086:0:44365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.536095:0:44365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11a904/0x5c74554e47ced2f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.536208:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605269120:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 5501us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.536223:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789130574.538457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.538681:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605269504 00000100:00100000:2.0:1789130574.538708:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605269504 00000100:00100000:2.0:1789130574.538812:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130574.538825:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+23:50433:x1876037605269504:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1789130574.539047:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd88 expref: 23 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130574.539409:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738738 00000001:00080000:2.0:1789130574.543784:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738739 00010000:00010000:2.0:1789130574.543930:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.543955:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 26 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.543966:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.544019:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 26 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.544038:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 26 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130574.544056:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626934912:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130574.544181:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130574.548293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.548979:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626934912:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789130574.549032:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.549554:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605269632 00000100:00100000:3.0:1789130574.549568:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605269632 00010000:00010000:0.0:1789130574.550391:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 27 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130574.550476:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789130574.550496:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:2370:x1876037605269632:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130574.550523:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130574.550535:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 27 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550565:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 27 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550667:0:45795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71a00/0x5c74554e47ced218 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acd8f expref: 27 pid: 43679 timeout: 1837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550695:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:0.0:1789130574.550713:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550726:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550736:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.550774:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130574.551104:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.551114:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130574.551307:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738740 00000001:00080000:2.0:1789130574.551629:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738741 00000100:00100000:0.0:1789130574.551766:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+28:2370:x1876037605269632:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1273us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.551778:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:2.0:1789130574.552350:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d0a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626935040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130574.552443:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130574.552523:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130574.553069:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935040 00000100:00100000:0.0:1789130574.553083:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935040 00000100:00100000:0.0:1789130574.553171:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130574.553190:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626935040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130574.553353:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626935040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.553361:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130574.553472:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d0a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626935040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789130574.554381:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738742 00000100:00100000:3.0:1789130574.554512:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626935168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789130574.554676:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130574.554743:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130574.555172:0:43685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935168 00000100:00100000:2.0:1789130574.555186:0:43685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935168 00000100:00100000:2.0:1789130574.555261:0:43685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130574.555273:0:43685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626935168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789130574.555633:0:43685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:43683:x1876037626935168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 326us (924us total) trans 34359738408 rc 0/0 00000100:00100000:2.0:1789130574.555648:0:43685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130574.555761:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626935168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130574.556079:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738743 00010000:00010000:2.0:1789130574.556173:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556190:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556203:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556213:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f70e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130574.556221:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556233:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556257:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130574.556261:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130574.556268:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.556274:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f70e00/0x5c74554e47ced2f8 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130574.559183:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130574.559367:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x30:0x0].11, 64 off9016 00000001:00080000:2.0:1789130574.559384:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738744 00010000:00010000:2.0:1789130574.559480:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b482b51500) 00010000:00010000:2.0:1789130574.559487:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130574.559506:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced203 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x22:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acd88 expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130574.559783:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:50433:x1876037605269504:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 20956us (21340us total) trans 34359738745 rc 0/0 00000100:00100000:2.0:1789130574.559800:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000020:00080000:2.0:1789130574.559810:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1789130574.565307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.565446:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605269760 00000100:00100000:3.0:1789130574.565463:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605269760 00000100:00100000:3.0:1789130574.565547:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 407 00000100:00100000:3.0:1789130574.565560:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+29:50433:x1876037605269760:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130574.565630:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130574.565828:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ff lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdd5 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.565965:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ff lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdd5 expref: 30 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.565989:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5000/0x5c74554e47ced2ff lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdd5 expref: 30 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.566022:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130574.566028:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130574.566033:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa5000, rc 0) 00000100:00100000:3.0:1789130574.566153:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+30:50433:x1876037605269760:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 591us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.566164:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 407 00000100:00100000:1.0:1789130574.572017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.572147:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270016 00000100:00100000:0.0:1789130574.572162:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270016 00000100:00100000:0.0:1789130574.572247:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1789130574.572260:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:50433:x1876037605270016:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789130574.572861:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:50433:x1876037605270016:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 598us (858us total) trans 34359738746 rc 0/0 00000100:00100000:0.0:1789130574.572875:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:1.0:1789130574.663092:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.663232:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270144 00000100:00100000:0.0:1789130574.663255:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270144 00000100:00100000:0.0:1789130574.663344:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 408 00000100:00100000:0.0:1789130574.663367:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+31:50441:x1876037605270144:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789130574.663409:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130574.663450:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acddc expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.663560:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.663579:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.663596:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130574.664030:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130574.664036:0:43681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130574.664192:0:43681:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.664247:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acddc expref: 33 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.664277:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acddc expref: 32 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.664289:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130574.664293:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130574.664299:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3800, rc 0) 00000100:00100000:0.0:1789130574.664399:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+32:50441:x1876037605270144:12345-192.168.201.39@tcp:101:stat.0 Request processed in 1044us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.664408:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 408 00000100:00100000:1.0:1789130574.676549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130574.677061:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270272 00000100:00100000:0.0:1789130574.677078:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270272 00000100:00100000:0.0:1789130574.677388:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 409 00000100:00100000:0.0:1789130574.677404:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+32:50441:x1876037605270272:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789130574.677441:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130574.677480:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acde3 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677587:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677667:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677682:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677714:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677723:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.677730:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.680193:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.680233:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.680767:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130574.680846:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00000004:00200000:0.0:1789130574.680854:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130574.681028:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681047:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681058:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681067:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681084:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681093:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130574.681100:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681113:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681135:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130574.681140:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130574.681148:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681159:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced31b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681185:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681194:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681202:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681209:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130574.681213:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681226:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681237:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8996d334 (ffff90b497c01c00) 00010000:00010000:0.0:1789130574.681490:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130574.681499:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681508:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8996d334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681581:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f2800/0x5c74554e47ced314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681679:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 33 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130574.681688:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939400) 00010000:00010000:0.0:1789130574.681691:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130574.681694:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3400, rc 0) 00000100:00100000:0.0:1789130574.682041:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+33:50441:x1876037605270272:12345-192.168.201.39@tcp:101:stat.0 Request processed in 4638us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130574.682053:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 409 00000100:00100000:1.0:1789130574.883755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.883809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.883921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.883979:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270400 00000100:00100000:3.0:1789130574.883994:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270400 00000100:00100000:3.0:1789130574.884073:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789130574.884087:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605270400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130574.884210:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2367:x1876037605270400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 126us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130574.884220:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:1.0:1789130574.890014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130574.894309:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270656 00000100:00100000:2.0:1789130574.894336:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270656 00000100:00100000:2.0:1789130574.894670:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270912 00000100:00100000:2.0:1789130574.894675:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270912 00000100:00100000:2.0:1789130574.894745:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789130574.894758:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605270656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130574.894887:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+9:2367:x1876037605270656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 131us (11077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.894897:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789130574.894925:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789130574.894933:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605270912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130574.894963:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605270912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (11041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.894969:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00080000:2.0:1789130574.895000:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130574.896307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130574.896363:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270784 00000100:00100000:1.0:1789130574.896374:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270784 00000100:00100000:1.0:1789130574.896477:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1789130574.896495:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605270784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130574.896642:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2367:x1876037605270784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130574.896673:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00080000:1.0:1789130574.896723:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130574.897537:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605270528 00000100:00100000:2.0:1789130574.897552:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605270528 00000100:00100000:2.0:1789130574.897741:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789130574.897757:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605270528:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130574.897882:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2367:x1876037605270528:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 108us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.897896:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00080000:1.0:1789130574.900540:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130574.949741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.949892:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271168 00000100:00100000:3.0:1789130574.949907:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271168 00000100:00100000:3.0:1789130574.949994:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 410 00000100:00100000:3.0:1789130574.950007:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+33:50454:x1876037605271168:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130574.950036:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130574.950072:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdea expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.950714:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.950742:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.950756:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.950818:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 34 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.950845:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 34 pid: 43679 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.950869:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b2940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626935296:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130574.951040:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130574.955312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130574.955373:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271296 00000100:00100000:3.0:1789130574.955385:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271296 00010000:00010000:3.0:1789130574.955453:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 35 pid: 43679 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130574.955501:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130574.955513:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:2369:x1876037605271296:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130574.955532:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130574.955539:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 35 pid: 43679 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130574.955551:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b2940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626935296:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130574.955552:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 35 pid: 43679 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.955581:0:43664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced329 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acde3 expref: 35 pid: 43679 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.955984:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.958541:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939400) 00010000:00010000:3.0:1789130574.958562:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.958581:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130574.958590:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130574.961588:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130574.961990:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.962007:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130574.962042:0:45555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x22:0x0]: returning size 5 00010000:00010000:1.0:1789130574.962277:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5400/0x5c74554e47ced330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdea expref: 36 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.962305:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4400/0x5c74554e47ced337 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdea expref: 35 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130574.962315:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x22:0x0].0x0 (ffff90b488939400) 00010000:00010000:1.0:1789130574.962330:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130574.962334:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4400, rc 0) 00000100:00100000:2.0:1789130574.962388:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+35:2369:x1876037605271296:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6874us (7089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130574.962403:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789130574.969530:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+34:50454:x1876037605271168:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 19506us (19785us total) trans 34359738747 rc 0/0 00000100:00100000:1.0:1789130574.969554:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 410 00010000:00010000:3.0:1789130575.509855:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130575.623706:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130575.623756:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626935424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130575.623892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130575.625931:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935424 00000100:00100000:3.0:1789130575.625954:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935424 00000100:00100000:3.0:1789130575.626089:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130575.626103:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626935424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130575.626168:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 59572224 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130575.626344:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626935424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130575.626353:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789130575.627079:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130575.627157:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626935424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789130576.521571:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130577.543283:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789130577.765573:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738403 is committed 00000001:00080000:1.0:1789130577.767061:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738401 is committed 00000004:00080000:3.0:1789130578.186921:0:43704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1741284314036ns, next at 1742284309895ns, rc = 0 00000100:00100000:3.0:1789130578.186965:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626935552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130578.187071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130578.187180:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935552 00000100:00100000:3.0:1789130578.187190:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935552 00000100:00100000:3.0:1789130578.187264:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130578.187277:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626935552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130578.187339:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3765436416 avail 3763339264 00000100:00100000:3.0:1789130578.187399:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626935552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130578.187409:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789130578.187438:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130578.187503:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626935552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130578.187735:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626935808:0@lo:400:kworker.0 00000100:00100000:0.0:1789130578.187778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130578.187811:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130578.187817:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626935936:0@lo:400:kworker.0 00000100:00100000:0.0:1789130578.187848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130578.187883:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935936 00000100:00100000:0.0:1789130578.187888:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935936 00000100:00100000:0.0:1789130578.187934:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789130578.187942:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626935936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130578.187989:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626935936:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130578.187997:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789130578.188028:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626935936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188256:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626935680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130578.188349:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626936192:0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130578.188402:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130578.188409:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626936064:0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130578.188470:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936192 00000100:00100000:1.0:1789130578.188477:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936192 00000100:00100000:3.0:1789130578.188484:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936064 00000100:00100000:3.0:1789130578.188490:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936064 00000100:00100000:1.0:1789130578.188527:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789130578.188535:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789130578.188541:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626936192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188548:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626936064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188661:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626936064:12345-0@lo:400:kworker.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130578.188668:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789130578.188694:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130578.188714:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626936064:0@lo:400:kworker.0 00000100:00100000:3.0:1789130578.188724:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626936192:0@lo:400:kworker.0 00000100:00100000:2.0:1789130578.189278:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935808 00000100:00100000:2.0:1789130578.189287:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935808 00000100:00080000:3.0:1789130578.189399:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130578.189492:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626935680 00000100:00100000:0.0:1789130578.189499:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626935680 00000100:00100000:0.0:1789130578.189541:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789130578.189545:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789130578.189555:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130578.189563:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626935808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130578.189676:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626935680:12345-0@lo:400:kworker.0 Request processed in 124us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130578.189684:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789130578.189905:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626935680:0@lo:400:kworker.0 00000100:00100000:1.0:1789130578.195381:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626936192:12345-0@lo:400:kworker.0 Request processed in 6828us (6984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130578.195404:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130578.200818:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626935808:12345-0@lo:400:kworker.0 Request processed in 11247us (13023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130578.200840:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789130578.204121:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738403 gen 2 00000004:00080000:1.0:1789130578.204143:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738402 committed transno 34359738403 00000004:00080000:1.0:1789130578.204177:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b387aa3c00, transno 34359738403 00000100:00100000:1.0:1789130578.204215:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626935808:0@lo:400:kworker.0 00010000:00010000:1.0:1789130578.566102:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130579.590138:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130579.823872:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738746 is committed 00000001:00080000:3.0:1789130579.823906:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738747 is committed 00000020:00080000:3.0:1789130579.823949:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b388e2ab40 refcount 2 committed 0 result 0 batchid 30064771690 00000020:00080000:3.0:1789130579.823958:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b388e2a0c0 00000020:00080000:3.0:1789130579.823963:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4baf51e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b3869dfc00 00000004:00080000:3.0:1789130579.823989:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:3.0:1789130579.824012:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4a7568540 refcount 2 committed 0 result 0 batchid 30064771691 00000020:00080000:3.0:1789130579.824016:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b65c3a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4a7568d80 00000020:00080000:3.0:1789130579.824019:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b65c3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b386918400 00000020:00080000:3.0:1789130579.824050:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771689 batchid updated 00000020:00080000:3.0:1789130579.824065:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771691 committed batchid 30064771689 00000020:00080000:3.0:1789130579.824703:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771689 00000100:00100000:2.0:1789130579.825351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626936320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789130579.825461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130579.825570:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936320 00000100:00100000:2.0:1789130579.825580:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936320 00000100:00100000:2.0:1789130579.825680:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789130579.825692:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626936320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789130579.825730:0:44365:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:234 count 1 00002000:00010000:2.0:1789130579.825784:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xea:0x0] initial LVB size: 5, mtime: 0x6aa3f74c, atime: 0x6aa3f74c, ctime: 0x6aa3f74c, blocks: 0xb 00010000:00010000:2.0:1789130579.825795:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130579.825818:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=1742s v=(0 0) 00010000:00010000:2.0:1789130579.825825:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130579.825834:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130579.825854:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130579.825865:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130579.825873:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130579.825905:0:44365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789130579.827397:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1876037626936320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1697us (1927us total) trans 34359738409 rc 0/0 00000100:00100000:2.0:1789130579.827413:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:0.0:1789130579.827709:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b386fe61c0/2, rc 0, transno 34359738409 00000100:00100000:0.0:1789130579.827719:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626936320:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789130579.827816:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130579.827830:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130579.827846:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b386f70c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130579.827852:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130579.827866:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130579.827894:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130579.827904:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b4a26b/0x5c74554e47ced345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130579.827935:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130579.827938:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130579.827939:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130579.830550:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738406 is committed 00000001:00080000:3.0:1789130579.830591:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738407 is committed 00000001:00080000:3.0:1789130579.830631:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738408 is committed 00000100:00100000:0.0:1789130580.020080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130580.020517:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271936 00000100:00100000:3.0:1789130580.020529:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271936 00000100:00100000:3.0:1789130580.020646:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271552 00000100:00100000:3.0:1789130580.020650:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271552 00000100:00100000:3.0:1789130580.020690:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789130580.020704:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605271936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130580.020845:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2368:x1876037605271936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130580.020854:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789130580.020875:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:3.0:1789130580.020882:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:2368:x1876037605271552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130580.020917:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:2368:x1876037605271552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130580.020924:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00080000:3.0:1789130580.020945:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130580.021143:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271680 00000100:00100000:2.0:1789130580.021148:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271680 00000100:00100000:2.0:1789130580.021194:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271808 00000100:00100000:2.0:1789130580.021198:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271808 00000100:00100000:2.0:1789130580.021216:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272064 00000100:00100000:2.0:1789130580.021218:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272064 00000100:00100000:2.0:1789130580.021248:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789130580.021256:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605271680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130580.021291:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605271680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130580.021298:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789130580.021315:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130580.021321:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605271808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130580.021346:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605271808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130580.021353:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789130580.021367:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:2.0:1789130580.021373:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2366:x1876037605272064:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1789130580.021396:0:44366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47cecede 00000100:00080000:2.0:1789130580.021406:0:44366:0:(import.c:65:import_set_state_nolock()) ffff90b386e94800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130580.021460:0:44366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738403 00000100:00100000:2.0:1789130580.021822:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+2:2366:x1876037605272064:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 448us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130580.021833:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00010000:00010000:2.0:1789130580.022031:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130580.023317:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130580.023329:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130580.026408:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605271424 00000100:00100000:1.0:1789130580.026429:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605271424 00000100:00100000:2.0:1789130580.026758:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:2.0:1789130580.026773:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605271424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130580.026884:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2368:x1876037605271424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 115us (6822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130580.026892:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000040:00080000:1.0:1789130580.615520:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130580.615536:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130580.616084:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 11 count 5 00000040:00080000:1.0:1789130580.616094:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:0.0:1789130580.617699:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130580.749089:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626936448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130580.749204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130580.749933:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936448 00000100:00100000:2.0:1789130580.749946:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936448 00000100:00100000:2.0:1789130580.750065:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789130580.750077:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626936448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130580.750128:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130580.750228:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626936448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130580.750237:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130580.750351:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626936448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789130580.750865:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130581.151322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130581.151494:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272192 00000100:00100000:0.0:1789130581.151509:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272192 00000100:00100000:0.0:1789130581.152019:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 411 00000100:00100000:0.0:1789130581.152036:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605272192:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789130581.155944:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605272192:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 3893us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130581.155966:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 411 00000100:00100000:1.0:1789130581.161365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130581.161496:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272448 00000100:00100000:2.0:1789130581.161511:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272448 00000100:00100000:2.0:1789130581.161799:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:2.0:1789130581.161812:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:50364:x1876037605272448:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789130581.162485:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:50364:x1876037605272448:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 673us (1134us total) trans 34359738748 rc 0/0 00000100:00100000:2.0:1789130581.162495:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789130581.622492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130581.622769:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272576 00000100:00100000:0.0:1789130581.622782:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272576 00000100:00100000:0.0:1789130581.622885:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 412 00000100:00100000:0.0:1789130581.622899:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:50895:x1876037605272576:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789130581.622927:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130581.622958:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdf1 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623045:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623063:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623081:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130581.623369:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1789130581.623374:0:43680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:0.0:1789130581.623468:0:43680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623503:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 7 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623525:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 6 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130581.623535:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:0.0:1789130581.623538:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130581.623543:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3200, rc 0) 00000100:00100000:0.0:1789130581.623731:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:50895:x1876037605272576:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 836us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130581.623739:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 412 00010000:00010000:2.0:1789130581.639752:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130582.663989:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789130582.844468:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:3.0:1789130582.844479:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b386e92000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 00000020:00000080:0.0:1789130582.845495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b386e92000/ab440178-5f2c-43fa-b0e2-24b6c08464d6 for lustre-OST0000 00000020:00000080:2.0:1789130582.845956:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b386e94800 for lustre-OST0000 00000100:00100000:1.0:1789130583.302076:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626936832:0@lo:400:kworker.0 00000100:00100000:1.0:1789130583.302168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130583.302259:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130583.302266:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626936960:0@lo:400:kworker.0 00000100:00100000:1.0:1789130583.302291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130583.302370:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626936704:0@lo:400:kworker.0 00000100:00100000:0.0:1789130583.302400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130583.302432:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626937216:0@lo:400:kworker.0 00000100:00100000:0.0:1789130583.302451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130583.302469:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789130583.302474:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626936576:0@lo:400:kworker.0 00000100:00100000:0.0:1789130583.302510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130583.302530:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626937088:0@lo:400:kworker.0 00000100:00100000:0.0:1789130583.302573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130583.302629:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936960 00000100:00100000:0.0:1789130583.302637:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936960 00000100:00100000:0.0:1789130583.302702:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937216 00000100:00100000:0.0:1789130583.302705:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937216 00000100:00100000:0.0:1789130583.302734:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937088 00000100:00100000:0.0:1789130583.302737:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937088 00000100:00100000:0.0:1789130583.302758:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789130583.302768:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626936960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130583.302783:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789130583.302793:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626937216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130583.302833:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626936960:12345-0@lo:400:kworker.0 Request processed in 65us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130583.302842:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789130583.302843:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626937216:12345-0@lo:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130583.302849:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789130583.302862:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789130583.302869:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130583.302897:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626937088:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130583.302908:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936832 00000100:00100000:2.0:1789130583.302947:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936704 00000100:00100000:2.0:1789130583.302952:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936704 00000100:00100000:2.0:1789130583.302989:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130583.302997:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303034:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626936704:12345-0@lo:400:kworker.0 Request processed in 39us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130583.303040:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789130583.303131:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130583.303137:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130583.303156:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626936576 00000100:00100000:2.0:1789130583.303160:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936576 00000100:00100000:2.0:1789130583.303188:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130583.303194:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626936576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303224:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3307:x1876037626936576:12345-0@lo:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130583.303231:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130583.303287:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3307:1876037626936576:0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303301:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626937088:0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b387aa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626936704:0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303321:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626937216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303352:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130583.303378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130583.303407:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626936960:0@lo:400:kworker.0 00000100:00100000:2.0:1789130583.303438:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937344 00000100:00100000:2.0:1789130583.303442:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937344 00000100:00100000:2.0:1789130583.303473:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789130583.303479:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626937344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130583.303515:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3765436416 avail 3763339264 00000100:00100000:2.0:1789130583.303562:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626937344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130583.303569:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789130583.303590:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130583.303631:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738408 gen 2 00000004:00080000:2.0:1789130583.303638:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738407 committed transno 34359738408 00000004:00080000:2.0:1789130583.303657:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738408 committed transno 34359738408 00000100:00100000:2.0:1789130583.303674:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b386fe61c0 x1876037626936320/t34359738409(34359738409) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789130595 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130583.303691:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130583.303783:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626936832 00000100:00100000:1.0:1789130583.303822:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130583.303830:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626936832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130583.303873:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626936832:12345-0@lo:400:kworker.0 Request processed in 44us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130583.303879:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130583.303905:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626936832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130583.305749:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:2.0:1789130583.685815:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130584.719024:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130584.939649:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738748 is committed 00000020:00080000:3.0:1789130584.939665:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771691 batchid updated 00000020:00080000:3.0:1789130584.939681:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771691 00000020:00080000:3.0:1789130584.939694:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771691 00000001:00080000:3.0:1789130584.946644:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 34359738409 is committed 00000100:00100000:3.0:1789130585.121063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130585.121107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130585.121148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130585.121178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130585.121218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130585.121247:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273216 00000100:00100000:3.0:1789130585.121256:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273216 00000100:00100000:3.0:1789130585.121316:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272832 00000100:00100000:3.0:1789130585.121320:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272832 00000100:00100000:3.0:1789130585.121346:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789130585.121356:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605273216:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130585.121443:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2369:x1876037605273216:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130585.121467:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789130585.121485:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789130585.121492:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:2369:x1876037605272832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130585.121532:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+15:2369:x1876037605272832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130585.121539:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789130585.121568:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272960 00000100:00100000:3.0:1789130585.121572:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272960 00000100:00100000:3.0:1789130585.121625:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273088 00000100:00100000:3.0:1789130585.121628:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273088 00000100:00100000:3.0:1789130585.121651:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130585.121658:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605272960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130585.121686:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2369:x1876037605272960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130585.121698:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789130585.121710:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789130585.121716:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605273088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130585.121750:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605273088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130585.121756:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00080000:3.0:1789130585.121772:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130585.121776:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130585.121778:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130585.121965:0:43673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605272704 00000100:00100000:2.0:1789130585.121970:0:43673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605272704 00000100:00100000:2.0:1789130585.122004:0:43673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:2.0:1789130585.122011:0:43673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605272704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130585.122043:0:43673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605272704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130585.122050:0:43673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00010000:00010000:2.0:1789130585.737061:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130585.876680:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130585.876713:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130585.877278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130585.877407:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937472 00000100:00100000:2.0:1789130585.877416:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937472 00000100:00100000:2.0:1789130585.877517:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789130585.877528:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626937472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130585.877577:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789130585.877658:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626937472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130585.877666:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789130585.877820:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130585.877869:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937472:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789130586.469298:0:47414:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 20: Auto attach works after the inode was once evicted from cache ========================================================== 08:43:04 (1789130584) 00010000:00010000:0.0:1789130586.769646:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130587.781990:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130588.421928:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626937600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130588.422025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130588.422124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626938112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.422162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130588.422183:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789130588.422190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626937728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.422223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130588.422256:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937856:0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.422271:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626938240:0@lo:400:kworker.0 00000100:00100000:0.0:1789130588.422407:0:44369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937600 00000100:00100000:0.0:1789130588.422421:0:44369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937600 00000100:00100000:0.0:1789130588.422498:0:44369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789130588.422512:0:44369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626937600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130588.422550:0:44369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3765436416 avail 3763339264 00000100:00080000:1.0:1789130588.422658:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130588.422682:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937728 00000100:00100000:1.0:1789130588.422686:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937728 00000100:00100000:1.0:1789130588.422717:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789130588.422724:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626937728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.426817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130588.426903:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626938112 00000100:00100000:3.0:1789130588.426912:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626938112 00000100:00100000:3.0:1789130588.426960:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626938240 00000100:00100000:3.0:1789130588.426963:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626938240 00000100:00100000:3.0:1789130588.427007:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789130588.427017:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626938112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.428522:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626938112:12345-0@lo:400:kworker.0 Request processed in 1500us (6351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.428535:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789130588.428567:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789130588.428577:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626938240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.428640:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626938240:12345-0@lo:400:kworker.0 Request processed in 67us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.428647:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789130588.428713:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626938240:0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.428732:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626938112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.428809:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626937984:0@lo:400:kworker.0 00000100:00080000:3.0:1789130588.428857:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130588.429218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130588.429372:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626938368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130588.429431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130588.429495:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626938368 00000100:00100000:2.0:1789130588.429503:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626938368 00000100:00100000:2.0:1789130588.429596:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789130588.429634:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626938368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130588.429694:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626938368:12345-0@lo:400:kworker.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.429706:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789130588.429732:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130588.429773:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626938368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130588.429813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130588.429933:0:44369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626937600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7421us (7903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.429946:0:44369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130588.431483:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3306:x1876037626937728:12345-0@lo:400:kworker.0 Request processed in 8751us (9251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130588.431497:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130588.440670:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3306:1876037626937728:0@lo:400:kworker.0 00000100:00100000:2.0:1789130588.440696:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 34359738409 gen 2 00000004:00080000:2.0:1789130588.440703:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b386fe61c0, transno 34359738409 00000100:00100000:2.0:1789130588.440733:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626937600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130588.442366:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937856 00000100:00100000:3.0:1789130588.442387:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937856 00000100:00100000:3.0:1789130588.442502:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626937984 00000100:00100000:3.0:1789130588.442507:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626937984 00000100:00100000:3.0:1789130588.442537:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130588.442549:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.442725:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626937856:12345-0@lo:400:kworker.0 Request processed in 178us (13984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.442734:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130588.442763:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130588.442770:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626937984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130588.442808:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626937984:12345-0@lo:400:kworker.0 Request processed in 39us (12994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.442814:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130588.443066:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626937856:0@lo:400:kworker.0 00000100:00080000:2.0:1789130588.443482:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130588.443522:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626937984:0@lo:400:kworker.0 00000100:00100000:2.0:1789130588.449079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.449286:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273472 00000100:00100000:3.0:1789130588.449298:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273472 00000100:00100000:3.0:1789130588.449383:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 413 00000100:00100000:3.0:1789130588.449394:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+15:51155:x1876037605273472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789130588.449535:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130588.449560:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced35a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdf8 expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449688:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449705:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449721:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449737:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449744:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.449751:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789130588.450359:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789130588.451809:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ced36f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.451828:0:43681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ced36f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.451840:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ced36f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130588.451853:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789130588.452048:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452057:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452078:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452084:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130588.452087:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452095:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452108:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:3.0:1789130588.452110:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130588.452115:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.452121:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced361 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453767:0:43681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453782:0:43681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453791:0:43681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453797:0:43681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789130588.453801:0:43681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453809:0:43681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453825:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b488939600) 00010000:00010000:3.0:1789130588.453828:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130588.453832:0:43681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.453839:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced368 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.461917:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4c00/0x5c74554e47ced35a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf8 expref: 18 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.461947:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ced36f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf8 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.461958:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130588.461961:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130588.461965:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4800, rc 0) 00000100:00100000:0.0:1789130588.462245:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:51155:x1876037605273472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 12851us (13184us total) trans 34359738749 rc 0/0 00000100:00100000:0.0:1789130588.462255:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 413 00000100:00100000:3.0:1789130588.477272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.477326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130588.477891:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273600 00000100:00100000:0.0:1789130588.477902:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273600 00000100:00100000:0.0:1789130588.477979:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1789130588.477991:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+17:2367:x1876037605273600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130588.478006:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130588.478032:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4800/0x5c74554e47ced36f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf8 expref: 17 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.478052:0:43666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b488939300) 00010000:00010000:0.0:1789130588.478058:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130588.478136:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+16:2367:x1876037605273600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 139us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.478144:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1789130588.479220:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273728 00000100:00100000:2.0:1789130588.479356:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273728 00000100:00100000:2.0:1789130588.479510:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 414 00000100:00100000:2.0:1789130588.479521:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:51155:x1876037605273728:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789130588.479649:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+16:51155:x1876037605273728:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 130us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.479657:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 414 00000100:00100000:3.0:1789130588.601816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130588.602068:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605273984 00000100:00100000:1.0:1789130588.602079:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605273984 00000100:00100000:1.0:1789130588.602150:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 415 00000100:00100000:1.0:1789130588.602161:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+16:51169:x1876037605273984:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789130588.602185:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130588.602188:0:45555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789130588.602216:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced30d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acddc expref: 16 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602245:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:1.0:1789130588.602250:0:45555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130588.602264:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced37d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592acdff expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602592:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602668:0:45555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602676:0:45555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602709:0:45555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 5 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.602721:0:45555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 5 pid: 43680 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130588.602734:0:45555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626938496:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130588.602825:0:45555:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130588.605708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.605802:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274112 00000100:00100000:2.0:1789130588.605812:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274112 00010000:00010000:2.0:1789130588.605885:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 6 pid: 43680 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130588.605930:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789130588.605953:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605274112:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130588.605969:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130588.605977:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 6 pid: 43680 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.605992:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 6 pid: 43680 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.606018:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:2.0:1789130588.606024:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.606033:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.606042:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.606075:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130588.606137:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab440178-5f2c-43fa-b0e2-24b6c08464d6+6:2368:x1876037605274112:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 187us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.606146:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00080000:3.0:1789130588.606479:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130588.606795:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3200/0x5c74554e47ced353 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdf1 expref: 5 pid: 43680 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130588.606812:0:45555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3895b30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:45555:1876037626938496:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130588.606841:0:45555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.606851:0:45555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.606857:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.606949:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.606960:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.606969:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130588.609727:0:45555:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xea:0x0], index 0: 0 00010000:00010000:1.0:1789130588.610773:0:45555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610793:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610804:0:45555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610842:0:45555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610850:0:45555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610858:0:45555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610865:0:45555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3fe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789130588.610870:0:45555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610878:0:45555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610890:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b497c01600) 00010000:00010000:1.0:1789130588.610894:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130588.610898:0:45555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610905:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3fe00/0x5c74554e47ced384 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130588.610918:0:45555:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000496c3de4 reply state 0000000075068318 transno 34359738750 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130588.610927:0:45555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130588.610972:0:45555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3ee00/0x5c74554e47ced37d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 18 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.610993:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 17 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.611001:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789130588.611005:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130588.611007:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130588.611097:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+18:51169:x1876037605273984:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8937us (9290us total) trans 34359738750 rc 0/0 00000100:00100000:1.0:1789130588.611117:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 415 00010000:00010000:2.0:1789130588.615174:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615200:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615209:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615222:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4bac3e400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130588.615229:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615238:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615259:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x292fee53 (ffff90b4909bdc00) 00010000:00010000:2.0:1789130588.615263:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130588.615270:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.615277:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3e400/0x5c74554e47ced38b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.616504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.617223:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274240 00000100:00100000:2.0:1789130588.617238:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274240 00000100:00100000:2.0:1789130588.617379:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789130588.617393:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+5:2368:x1876037605274240:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130588.617429:0:44365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130588.617469:0:44365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace06 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130588.617506:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789130588.617533:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=1751s v=(0 0) 00010000:00010000:2.0:1789130588.617538:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130588.617550:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 6 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.617580:0:44365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 6 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.617598:0:44365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71c00, rc 0) 00000100:00100000:2.0:1789130588.617709:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605274240:12345-192.168.201.39@tcp:101:bash.0 Request processed in 319us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.617718:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00080000:3.0:1789130588.621323:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130588.621536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.621641:0:44366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274368 00000100:00100000:2.0:1789130588.621653:0:44366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274368 00000100:00100000:2.0:1789130588.621734:0:44366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:2.0:1789130588.621748:0:44366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+6:51169:x1876037605274368:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789130588.621773:0:44366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130588.621810:0:44366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace0d expref: -99 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.621852:0:44366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.621863:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130588.621868:0:44366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130588.621874:0:44366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 7 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.621920:0:44366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.621938:0:44366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 1851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130588.621957:0:44366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f05680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626938624:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789130588.622067:0:44366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b388e2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130588.626105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.626240:0:44366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f05680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:44366:1876037626938624:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789130588.626291:0:44366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 7 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.626320:0:44366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71a00, rc 0) 00000100:00100000:2.0:1789130588.626411:0:44366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f164769-cccd-48c1-b7fa-967be7565442+7:51169:x1876037605274368:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4666us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.626423:0:44366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789130588.626590:0:43666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274496 00000100:00100000:0.0:1789130588.626644:0:43666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274496 00010000:00010000:0.0:1789130588.626692:0:43666:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 1851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130588.626730:0:43666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1789130588.626740:0:43666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b387bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605274496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130588.626759:0:43666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130588.626791:0:43666:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 1851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.626807:0:43666:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 1851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.626837:0:43666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382702c7/0x5c74554e47ced3a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace06 expref: 7 pid: 44365 timeout: 1851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.626855:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130588.626860:0:43666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130588.626871:0:43666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.626884:0:43666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.626927:0:43666:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 6 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130588.626944:0:43666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:43666:1876037626938752:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789130588.627011:0:43666:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130588.629876:0:43666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:43666:1876037626938752:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789130588.629915:0:43666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130588.629985:0:43666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b387bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f164769-cccd-48c1-b7fa-967be7565442+6:2369:x1876037605274496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3245us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.629999:0:43666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789130588.633067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.633178:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274752 00000100:00100000:2.0:1789130588.633192:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274752 00000100:00100000:2.0:1789130588.633264:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:2.0:1789130588.633275:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+17:51169:x1876037605274752:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789130588.633833:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+18:51169:x1876037605274752:12345-192.168.201.39@tcp:35:bash.0 Request processed in 556us (778us total) trans 34359738751 rc 0/0 00000100:00100000:2.0:1789130588.633843:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:1.0:1789130588.704258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130588.704343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.704508:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275008 00000100:00100000:3.0:1789130588.704522:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275008 00000100:00100000:3.0:1789130588.704651:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789130588.704665:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605275008:12345-192.168.201.39@tcp:16:kworker.0 00000100:00100000:3.0:1789130588.704840:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605275008:12345-192.168.201.39@tcp:16:kworker.0 Request processed in 177us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.704849:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1789130588.704938:0:47023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605274880 00000100:00100000:2.0:1789130588.704944:0:47023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605274880 00002000:00100000:2.0:1789130588.704983:0:47023:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xea:0x0] (0->4) req@ffff90b3895b30c0 x1876037605274880/t0(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:304/0 lens 496/0 e 0 to 0 dl 1789130599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130588.704997:0:47023:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3895b30c0 with x1876037605274880 ext(0->4) 00002000:00010000:2.0:1789130588.705007:0:47023:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3895b30c0 00000100:00100000:2.0:1789130588.705046:0:47023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789130588.705054:0:47023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+6:2368:x1876037605274880:12345-192.168.201.39@tcp:4:bash.0 00000100:00100000:2.0:1789130588.705832:0:47023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3895b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2368:x1876037605274880:12345-192.168.201.39@tcp:4:bash.0 Request processed in 773us (1585us total) trans 34359738404 rc 0/0 00000100:00100000:2.0:1789130588.705843:0:47023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00002000:00100000:2.0:1789130588.705851:0:47023:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xea:0x0] (0->4) req@ffff90b3895b30c0 x1876037605274880/t34359738404(0) o4->6f164769-cccd-48c1-b7fa-967be7565442@192.168.201.39@tcp:304/0 lens 496/448 e 0 to 0 dl 1789130599 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789130588.705860:0:47023:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b3895b30c0 with x1876037605274880 ext(0->4) 00002000:00010000:2.0:1789130588.705865:0:47023:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90b3895b30c0 00000100:00100000:3.0:1789130588.708756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.709213:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275136 00000100:00100000:2.0:1789130588.709230:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275136 00000100:00100000:2.0:1789130588.709358:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 416 00000100:00100000:2.0:1789130588.709373:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+18:51175:x1876037605275136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789130588.709420:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130588.709466:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced3ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace14 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709571:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced3b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709589:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709661:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130588.709747:0:43679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1789130588.709753:0:43679:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:2.0:1789130588.709786:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709835:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71e00/0x5c74554e47ced3ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace14 expref: 20 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709862:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b386f71c00/0x5c74554e47ced3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace14 expref: 19 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.709874:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:2.0:1789130588.709877:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130588.709881:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b386f71c00, rc 0) 00000100:00100000:2.0:1789130588.709974:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+19:51175:x1876037605275136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 605us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.709983:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 416 00000100:00100000:1.0:1789130588.715070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.715189:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275392 00000100:00100000:3.0:1789130588.715203:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275392 00000100:00100000:3.0:1789130588.715280:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 417 00000100:00100000:3.0:1789130588.715292:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+19:51175:x1876037605275392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130588.715324:0:43681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130588.715356:0:43681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced3bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace1b expref: -99 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.715519:0:43681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.715537:0:43681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.715548:0:43681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 4/0,1 mode: --/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.715855:0:43681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 20 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.715877:0:43681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 20 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.715895:0:43681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626938880:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130588.716162:0:43681:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130588.725718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130588.725841:0:43664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275520 00000100:00100000:2.0:1789130588.725855:0:43664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275520 00010000:00010000:2.0:1789130588.725914:0:43664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 21 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130588.725965:0:43664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1789130588.725977:0:43664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386eada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:2369:x1876037605275520:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130588.725997:0:43664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130588.726005:0:43664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 21 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.726023:0:43664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 21 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.726053:0:43664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:2.0:1789130588.726062:0:43664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: --/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.726079:0:43664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.726089:0:43664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.726115:0:43664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130588.726194:0:43664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f164769-cccd-48c1-b7fa-967be7565442+21:2369:x1876037605275520:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 218us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130588.726203:0:43664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00010000:00010000:3.0:1789130588.727708:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced392 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592acdff expref: 20 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.727740:0:43681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:43681:1876037626938880:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130588.727770:0:43681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.727782:0:43681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.727788:0:43681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130588.727827:0:43681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x26:0x0]: returning size 5 00010000:00010000:3.0:1789130588.728066:0:43681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced3bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace1b expref: 21 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.728099:0:43681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 3/0,0 mode: CW/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace1b expref: 20 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.728109:0:43681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:3.0:1789130588.728113:0:43681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789130588.728117:0:43681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4600, rc 0) 00000100:00100000:3.0:1789130588.728390:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386eaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f164769-cccd-48c1-b7fa-967be7565442+20:51175:x1876037605275392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 13099us (13336us total) trans 34359738752 rc 0/0 00000100:00100000:3.0:1789130588.728401:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 417 00000100:00100000:1.0:1789130588.737178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.737393:0:43680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275776 00000100:00100000:3.0:1789130588.737411:0:43680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275776 00000100:00100000:3.0:1789130588.737565:0:43680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 418 00000100:00100000:3.0:1789130588.737579:0:43680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+20:51175:x1876037605275776:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789130588.737659:0:43680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130588.737664:0:43680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789130588.737707:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3c3 lrc: 0/0,0 mode: --/CW res: [0x200003ab1:0x26:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace1b expref: 20 pid: 43681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.737735:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:3.0:1789130588.737750:0:43680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130588.737770:0:43680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced3d1 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace22 expref: -99 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.737905:0:43680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.737922:0:43680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.737936:0:43680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130588.737950:0:43680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x26:0x0]: returning size 5 00010000:00010000:3.0:1789130588.738139:0:43680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa5200/0x5c74554e47ced3d1 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace22 expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.738165:0:43680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace22 expref: 21 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.738174:0:43680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b488939600) 00010000:00010000:3.0:1789130588.738177:0:43680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789130588.738180:0:43680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4afaa4000, rc 0) 00000100:00100000:3.0:1789130588.738270:0:43680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f164769-cccd-48c1-b7fa-967be7565442+21:51175:x1876037605275776:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 693us (1106us total) trans 34359738753 rc 0/0 00000100:00100000:3.0:1789130588.738279:0:43680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 418 00000100:00100000:2.0:1789130588.747525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130588.747744:0:45555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605275904 00000100:00100000:1.0:1789130588.747759:0:45555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605275904 00000100:00100000:1.0:1789130588.747884:0:45555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 419 00000100:00100000:1.0:1789130588.747897:0:45555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+21:51175:x1876037605275904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789130588.747929:0:45555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130588.747959:0:45555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace29 expref: -99 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.748037:0:45555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.748056:0:45555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 22 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.748091:0:45555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b488939600) 00010000:00010000:1.0:1789130588.748095:0:45555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130588.748102:0:45555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4bac3f200, rc 0) 00000100:00100000:1.0:1789130588.748395:0:45555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f164769-cccd-48c1-b7fa-967be7565442+22:51175:x1876037605275904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 498us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130588.748403:0:45555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 419 00000100:00100000:1.0:1789130588.753979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.754198:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276032 00000100:00100000:3.0:1789130588.754214:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276032 00000100:00100000:3.0:1789130588.754353:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:3.0:1789130588.754367:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2370:x1876037605276032:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:3.0:1789130588.754439:0:44793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.754479:0:44793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 8 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.754489:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130588.754494:0:44793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789130588.754500:0:44793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 4/0,1 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.754545:0:44793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 8 pid: 44366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.754561:0:44793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 8 pid: 44366 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.754580:0:44793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626939008:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789130588.754751:0:44793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130588.758994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130588.759168:0:43665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276160 00000100:00100000:1.0:1789130588.759182:0:43665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276160 00010000:00010000:1.0:1789130588.759245:0:43665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 9 pid: 44366 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130588.759348:0:43665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130588.759374:0:43665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605276160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130588.759398:0:43665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789130588.759426:0:43665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xea:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1789130588.759430:0:43665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xea:0x0] updating lvb mtime from disk: 0 -> 1789130588 00002000:00010000:1.0:1789130588.759434:0:43665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xea:0x0] updating lvb ctime from disk: 0 -> 1789130588 00010000:00010000:1.0:1789130588.759441:0:43665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 9 pid: 44366 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.759471:0:43665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 9 pid: 44366 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.759509:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130588.759514:0:43665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789130588.759522:0:43665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.759541:0:43665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.759570:0:43665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130588.759687:0:43665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f164769-cccd-48c1-b7fa-967be7565442+9:2369:x1876037605276160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 327us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130588.759697:0:43665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00010000:00010000:3.0:1789130588.760225:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000606d9d61/0x5c74554e47ced3a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace0d expref: 8 pid: 44366 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.760249:0:44793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:44793:1876037626939008:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789130588.760274:0:44793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760285:0:44793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760294:0:44793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760329:0:44793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760339:0:44793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760347:0:44793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760355:0:44793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130588.760360:0:44793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760376:0:44793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760393:0:44793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.760401:0:44793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced3ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.760502:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2370:x1876037605276032:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 6138us (6539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130588.760513:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789130588.764335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130588.764451:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276416 00000100:00100000:3.0:1789130588.764469:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276416 00000100:00100000:3.0:1789130588.764551:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789130588.764564:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+22:51175:x1876037605276416:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:3.0:1789130588.764689:0:43683:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200003ab1:0x26:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace22 expref: 22 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130588.764953:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738754 00000001:00080000:3.0:1789130588.764997:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738755 00000001:00080000:3.0:1789130588.766111:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738756 00010000:00010000:3.0:1789130588.766218:0:43683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.766376:0:43683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 2/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.766389:0:43683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.766534:0:43683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 26 pid: 45555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130588.766558:0:43683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 26 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130588.766576:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626939136:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789130588.766955:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130588.772949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130588.773322:0:45795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276544 00000100:00100000:0.0:1789130588.773335:0:45795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276544 00010000:00010000:0.0:1789130588.773397:0:45795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 27 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130588.773460:0:45795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789130588.773472:0:45795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:2369:x1876037605276544:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130588.773493:0:45795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130588.773501:0:45795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 5/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 27 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.773518:0:45795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 27 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.773546:0:45795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b488939600) 00010000:00010000:0.0:1789130588.773553:0:45795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.773565:0:45795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.773574:0:45795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.773647:0:45795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130588.773738:0:45795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f164769-cccd-48c1-b7fa-967be7565442+27:2369:x1876037605276544:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 267us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.773746:0:45795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00010000:00010000:1.0:1789130588.774487:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4bac3f200/0x5c74554e47ced3e6 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592ace29 expref: 26 pid: 45555 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130588.774513:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:43683:1876037626939136:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789130588.774544:0:43683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.774559:0:43683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130588.774565:0:43683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130588.774909:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738757 00000001:00080000:1.0:1789130588.775219:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738758 00000100:00100000:1.0:1789130588.775377:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626939264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130588.775481:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130588.775530:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130588.775921:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939264 00000100:00100000:0.0:1789130588.775931:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939264 00000100:00100000:0.0:1789130588.776006:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130588.776017:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626939264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130588.776121:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626939264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.776130:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789130588.776317:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626939264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789130588.776925:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738759 00000100:00100000:1.0:1789130588.777018:0:43683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626939392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789130588.777245:0:43683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130588.777330:0:43683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130588.777478:0:43684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939392 00000100:00100000:0.0:1789130588.777485:0:43684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939392 00000100:00100000:0.0:1789130588.777580:0:43684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130588.777593:0:43684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43683:x1876037626939392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789130588.777910:0:43684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43683:x1876037626939392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 319us (837us total) trans 34359738405 rc 0/0 00000100:00100000:0.0:1789130588.777920:0:43684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130588.779028:0:43683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:43683:1876037626939392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789130588.779347:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738760 00010000:00010000:2.0:1789130588.779429:0:43683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779453:0:43683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779463:0:43683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779471:0:43683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789130588.779475:0:43683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779484:0:43683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779506:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130588.779509:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789130588.779516:0:43683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130588.779523:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4600/0x5c74554e47ced3f4 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130588.779998:0:43683:0:(mdd_object.c:4024:mdd_close()) Object [0x200003ab1:0x27:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789130588.780349:0:43683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2e:0x0].12, 64 off9008 00000004:00080000:2.0:1789130588.780364:0:43683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1751877760899ns, next at 1752877757598ns, rc = 0 00000001:00080000:2.0:1789130588.780373:0:43683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738761 00010000:00010000:2.0:1789130588.780423:0:43683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b488939600) 00010000:00010000:2.0:1789130588.780427:0:43683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789130588.780437:0:43683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4afaa4000/0x5c74554e47ced3d8 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x26:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace22 expref: 30 pid: 43680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130588.780657:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+29:51175:x1876037605276416:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 16094us (16335us total) trans 34359738762 rc 0/0 00000100:00100000:2.0:1789130588.780670:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000020:00080000:2.0:1789130588.780677:0:43683:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789130588.785276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130588.785557:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276672 00000100:00100000:0.0:1789130588.785570:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276672 00000100:00100000:0.0:1789130588.785699:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 420 00000100:00100000:0.0:1789130588.785713:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+29:51175:x1876037605276672:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789130588.785748:0:43679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130588.785784:0:43679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced3fb lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592ace30 expref: -99 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.785873:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced3fb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace30 expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.785890:0:43679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3600/0x5c74554e47ced3fb lrc: 3/0,0 mode: CR/CR res: [0x200003ab1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592ace30 expref: 30 pid: 43679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130588.785913:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130588.785917:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130588.785922:0:43679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b3873f3600, rc 0) 00000100:00100000:0.0:1789130588.786002:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:51175:x1876037605276672:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 291us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130588.786010:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 420 00000100:00100000:1.0:1789130588.798421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130588.798709:0:43682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605276928 00000100:00100000:0.0:1789130588.798725:0:43682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605276928 00000100:00100000:1.0:1789130588.799392:0:43682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:1.0:1789130588.799408:0:43682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+30:51175:x1876037605276928:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789130588.799866:0:43682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f164769-cccd-48c1-b7fa-967be7565442+31:51175:x1876037605276928:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 459us (1459us total) trans 34359738763 rc 0/0 00000100:00100000:1.0:1789130588.799876:0:43682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00010000:00010000:0.0:1789130588.805841:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130588.806534:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130588.806542:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130588.808243:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 64768 count 5 00000040:00080000:1.0:1789130588.808267:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00000100:00100000:2.0:1789130589.677529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130589.677742:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605277184 00000100:00100000:1.0:1789130589.677753:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605277184 00000100:00100000:1.0:1789130589.677816:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789130589.677826:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+31:51181:x1876037605277184:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130589.678171:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:51181:x1876037605277184:12345-192.168.201.39@tcp:35:bash.0 Request processed in 345us (652us total) trans 34359738764 rc 0/0 00000100:00100000:1.0:1789130589.678180:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789130589.692721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130589.692831:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605277440 00000100:00100000:1.0:1789130589.692841:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605277440 00000100:00100000:1.0:1789130589.692899:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:1.0:1789130589.692910:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+32:51181:x1876037605277440:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130589.693182:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:51181:x1876037605277440:12345-192.168.201.39@tcp:35:bash.0 Request processed in 274us (612us total) trans 34359738765 rc 0/0 00000100:00100000:1.0:1789130589.693190:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789130589.695353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789130589.695901:0:43683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605277696 00000100:00100000:1.0:1789130589.695913:0:43683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605277696 00000100:00100000:1.0:1789130589.695972:0:43683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:1.0:1789130589.695983:0:43683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+33:51181:x1876037605277696:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789130589.696230:0:43683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f164769-cccd-48c1-b7fa-967be7565442+34:51181:x1876037605277696:12345-192.168.201.39@tcp:35:bash.0 Request processed in 248us (884us total) trans 34359738766 rc 0/0 00000100:00100000:1.0:1789130589.696238:0:43683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00010000:00010000:2.0:1789130589.829994:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130590.093223:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738766 is committed 00000020:00080000:3.0:1789130590.093249:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b497eea6c0 refcount 2 committed 0 result 0 batchid 30064771692 00000020:00080000:3.0:1789130590.093255:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b497eeac00 00000020:00080000:3.0:1789130590.093258:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bfac3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b390cbbc00 00000004:00080000:3.0:1789130590.093300:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000100:00100000:3.0:1789130590.093481:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626939520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789130590.093551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130590.093649:0:44365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939520 00000100:00100000:3.0:1789130590.093657:0:44365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939520 00000100:00100000:3.0:1789130590.093717:0:44365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130590.093728:0:44365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626939520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789130590.093756:0:44365:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:234 count 1 00002000:00010000:3.0:1789130590.093791:0:44365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xea:0x0] initial LVB size: 5, mtime: 0x6aa3f75c, atime: 0x0, ctime: 0x6aa3f75c, blocks: 0x1 00010000:00010000:3.0:1789130590.093799:0:44365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.093816:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=1753s v=(0 0) 00010000:00010000:3.0:1789130590.093821:0:44365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130590.093827:0:44365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.093845:0:44365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.093855:0:44365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.093863:0:44365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.093881:0:44365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130590.094739:0:44365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626939520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1010us (1185us total) trans 34359738406 rc 0/0 00000100:00100000:3.0:1789130590.094748:0:44365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1789130590.094781:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130590.094797:0:43668:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130590.094804:0:43668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.094814:0:43668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4afaa5200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789130590.094819:0:43668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.094828:0:43668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.094846:0:43668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.094854:0:43668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ada6f84/0x5c74554e47ced402 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130590.094872:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130590.094874:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130590.094876:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789130590.094910:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b394c5ad00/2, rc 0, transno 34359738406 00000100:00100000:3.0:1789130590.094916:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626939520:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789130590.095250:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771692 committed batchid 30064771691 00000020:00080000:0.0:1789130590.095437:0:43718:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771691 00000100:00100000:3.0:1789130590.239152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130590.239199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130590.239231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789130590.239269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789130590.239429:0:43671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605277824 00000100:00100000:2.0:1789130590.239440:0:43671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605277824 00000100:00100000:2.0:1789130590.239502:0:43671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:2.0:1789130590.239512:0:43671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605277824:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789130590.239593:0:43671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c6b468-e11e-4c24-bf56-0ab5301cc278+13:2369:x1876037605277824:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130590.239641:0:43671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:3.0:1789130590.239912:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605278208 00000100:00100000:3.0:1789130590.239917:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605278208 00000100:00100000:3.0:1789130590.239968:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:3.0:1789130590.239977:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605278208:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789130590.240019:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab440178-5f2c-43fa-b0e2-24b6c08464d6+5:2369:x1876037605278208:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130590.240029:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:1.0:1789130590.240127:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605278080 00000100:00100000:1.0:1789130590.240132:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605278080 00000100:00100000:1.0:1789130590.240169:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605277952 00000100:00100000:1.0:1789130590.240172:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605277952 00000100:00100000:1.0:1789130590.240198:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130590.240206:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605278080:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130590.240245:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+8:2369:x1876037605278080:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130590.240252:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789130590.240265:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1789130590.240272:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605277952:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789130590.240314:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f164769-cccd-48c1-b7fa-967be7565442+7:2369:x1876037605277952:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130590.240321:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00080000:2.0:1789130590.241235:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130590.241241:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130590.241244:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130590.524344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789130590.525122:0:43679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037605278336 00000100:00100000:0.0:1789130590.525140:0:43679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037605278336 00000100:00100000:0.0:1789130590.525310:0:43679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 421 00000100:00100000:0.0:1789130590.525322:0:43679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:51193:x1876037605278336:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789130590.525659:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.525680:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.525701:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.525720:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.525727:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.525734:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527021:0:43679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527115:0:43679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527130:0:43679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130590.527195:0:43679:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527210:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527217:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527225:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527237:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130590.527243:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527252:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527266:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51b00) 00010000:00010000:0.0:1789130590.527269:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130590.527275:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527281:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3800/0x5c74554e47ced409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527296:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527302:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527309:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527313:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130590.527316:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527321:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527333:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x292fee53 (ffff90b497c01300) 00010000:00010000:0.0:1789130590.527336:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130590.527338:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527344:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3e00/0x5c74554e47ced410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x292fee53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527359:0:43679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527982:0:43679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527990:0:43679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.527995:0:43679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b3873f3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789130590.527999:0:43679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.528007:0:43679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.528021:0:43679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x26:0x0].0x0 (ffff90b497c01700) 00010000:00010000:0.0:1789130590.528024:0:43679:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130590.528028:0:43679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 2/0,0 mode: --/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130590.528033:0:43679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b3873f3400/0x5c74554e47ced417 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43679 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130590.528185:0:43679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f164769-cccd-48c1-b7fa-967be7565442+16:51193:x1876037605278336:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2858us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130590.528197:0:43679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 421 00000100:00080000:2.0:1789130590.529241:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789130590.855341:0:43713:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1789130590.855368:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x32:0x0] at index 8 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130590.855430:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x32:0x0] index 11 count 5 00000040:00080000:1.0:1789130590.855441:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 9 count 2 00010000:00010000:2.0:1789130590.855664:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130590.981995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626939648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130590.982105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130590.982287:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939648 00000100:00100000:3.0:1789130590.982299:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939648 00000100:00100000:3.0:1789130590.982376:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130590.982389:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386fe70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626939648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130590.982447:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 56164352 pending 1703936 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789130590.982522:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386fe70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626939648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130590.982530:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130590.982820:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626939648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789130591.878511:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130592.785356:0:47466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_20: @@@@@@ FAIL: /mnt/lustre/f20.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789130592.903631:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789130593.069236:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738405 is committed 00000001:00080000:3.0:1789130593.069257:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738404 is committed 00000001:00080000:3.0:1789130593.069273:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738406 is committed 00000100:00100000:3.0:1789130593.541945:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130593.541973:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626939776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130593.542060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130593.542270:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626940160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130593.542323:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130593.542329:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626940288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130593.542402:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626940160 00000100:00100000:0.0:1789130593.542403:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626939904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542423:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626940160 00000100:00100000:3.0:1789130593.542496:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626940288 00000100:00100000:0.0:1789130593.542497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130593.542503:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626940288 00000100:00100000:3.0:1789130593.542552:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789130593.542565:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626940160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130593.542567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626940416:0@lo:400:kworker.0 00000100:00100000:0.0:1789130593.542654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130593.542693:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130593.542704:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626940160:12345-0@lo:400:kworker.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130593.542707:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b394c592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626940032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542724:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789130593.542744:0:43681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626940416 00000100:00100000:3.0:1789130593.542748:0:43681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626940416 00000100:00100000:3.0:1789130593.542766:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789130593.542772:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542803:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626940288:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130593.542808:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789130593.542819:0:43681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789130593.542826:0:43681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542855:0:43681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626940416:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130593.542861:0:43681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789130593.542898:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626940288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.542909:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626940160:0@lo:400:kworker.0 00000100:00100000:2.0:1789130593.543216:0:44368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939776 00000100:00100000:2.0:1789130593.543223:0:44368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939776 00000100:00100000:2.0:1789130593.543271:0:44368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130593.543281:0:44368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b394c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626939776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130593.543311:0:44368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3765436416 avail 3763339264 00000100:00100000:2.0:1789130593.543352:0:44368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b394c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626939776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130593.543358:0:44368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789130593.543385:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130593.543390:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130593.543543:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b386fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626939776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130593.544128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130593.544311:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789130593.544460:0:43674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626939904 00000100:00100000:1.0:1789130593.544468:0:43674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626939904 00000100:00100000:1.0:1789130593.544540:0:43674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789130593.544551:0:43674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626939904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130593.544677:0:43674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a69b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2+19:3308:x1876037626939904:12345-0@lo:400:kworker.0 Request processed in 128us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130593.544686:0:43674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789130593.547263:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d4b04f-8a81-43e7-b662-2ed2ff4a71c2:3308:1876037626939904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.550692:0:44793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626940032 00000100:00100000:3.0:1789130593.550716:0:44793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626940032 00000100:00100000:3.0:1789130593.551227:0:44793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789130593.551254:0:44793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b386f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130593.551409:0:44793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b386f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626940032:12345-0@lo:400:kworker.0 Request processed in 171us (7286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130593.551420:0:44793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789130593.552148:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738406 gen 2 00000004:00080000:0.0:1789130593.552160:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738405 committed transno 34359738406 00000004:00080000:0.0:1789130593.552197:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b394c5ad00, transno 34359738406 00000100:00100000:0.0:1789130593.552220:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b394c592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626940032:0@lo:400:kworker.0 00000100:00080000:2.0:1789130593.557449:0:43675:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789130593.926751:0:43668:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130594.959163:0:43667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 71505 lines, 71505 kept, 0 dropped, 0 bad.